Nov 15 02:37:37 user nova-compute[75391]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75391) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75391) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75391) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 02:37:37 user nova-compute[75391]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:37:37 user nova-compute[75391]: INFO nova.virt.driver [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 15 02:37:37 user nova-compute[75391]: INFO nova.compute.provider_config [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] Acquiring lock "singleton_lock" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] Acquired lock "singleton_lock" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] Releasing lock "singleton_lock" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] Full set of CONF: {{(pid=75391) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ******************************************************************************** {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] Configuration options gathered from: {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ================================================================================ {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] allow_resize_to_same_host      = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] arq_binding_timeout            = 300 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] backdoor_port                  = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] backdoor_socket                = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] block_device_allocate_retries  = 300 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] block_device_allocate_retries_interval = 5 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cert                           = self.pem {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] compute_monitors               = [] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] config_dir                     = [] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] config_drive_format            = iso9660 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] config_source                  = [] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] console_host                   = user {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] control_exchange               = nova {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cpu_allocation_ratio           = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] daemon                         = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] debug                          = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] default_access_ip_network_name = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] default_availability_zone      = nova {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] default_ephemeral_format       = ext4 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] default_green_pool_size        = 1000 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] default_schedule_zone          = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] disk_allocation_ratio          = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] enable_new_services            = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] enabled_ssl_apis               = [] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] flat_injected                  = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] force_config_drive             = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] force_raw_images               = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:37 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] graceful_shutdown_timeout      = 5 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] heal_instance_info_cache_interval = 60 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] host                           = user {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] instance_build_timeout         = 0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] instance_delete_interval       = 300 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] instance_name_template         = instance-%08x {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] instance_usage_audit           = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] instance_usage_audit_period    = month {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] internal_service_availability_zone = internal {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] key                            = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] live_migration_retry_count     = 30 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] log_config_append              = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] log_dir                        = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] log_file                       = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] log_options                    = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] log_rotate_interval            = 1 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] log_rotate_interval_type       = days {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] log_rotation_type              = none {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] long_rpc_timeout               = 1800 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] max_concurrent_builds          = 10 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] max_concurrent_live_migrations = 1 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] max_concurrent_snapshots       = 5 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] max_local_block_devices        = 3 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] max_logfile_count              = 30 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] max_logfile_size_mb            = 200 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] maximum_instance_delete_attempts = 5 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] metadata_listen                = 0.0.0.0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] metadata_listen_port           = 8775 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] metadata_workers               = 3 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] migrate_max_retries            = -1 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] mkisofs_cmd                    = genisoimage {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] my_ip                          = 10.0.0.210 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] network_allocate_retries       = 0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] osapi_compute_listen_port      = 8774 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] osapi_compute_unique_server_name_scope =  {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] osapi_compute_workers          = 3 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] password_length                = 12 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] periodic_enable                = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] periodic_fuzzy_delay           = 60 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] pointer_model                  = ps2mouse {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] preallocate_images             = none {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] publish_errors                 = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] pybasedir                      = /opt/stack/nova {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ram_allocation_ratio           = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] rate_limit_burst               = 0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] rate_limit_except_level        = CRITICAL {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] rate_limit_interval            = 0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] reboot_timeout                 = 0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] reclaim_instance_interval      = 0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] record                         = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] reimage_timeout_per_gb         = 60 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] report_interval                = 120 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] rescue_timeout                 = 0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] reserved_host_cpus             = 0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] reserved_host_disk_mb          = 0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] reserved_host_memory_mb        = 512 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] reserved_huge_pages            = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] resize_confirm_window          = 0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] resize_fs_using_block_device   = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] resume_guests_state_on_host_boot = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] rpc_response_timeout           = 60 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] run_external_periodic_tasks    = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] running_deleted_instance_action = reap {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] running_deleted_instance_timeout = 0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] scheduler_instance_sync_interval = 120 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] service_down_time              = 720 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] servicegroup_driver            = db {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] shelved_offload_time           = 0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] shelved_poll_interval          = 3600 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] shutdown_timeout               = 0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] source_is_ipv6                 = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ssl_only                       = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] state_path                     = /opt/stack/data/nova {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] sync_power_state_interval      = 600 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] sync_power_state_pool_size     = 1000 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] syslog_log_facility            = LOG_USER {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] tempdir                        = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] timeout_nbd                    = 10 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] transport_url                  = **** {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] update_resources_interval      = 0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] use_cow_images                 = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] use_eventlog                   = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] use_journal                    = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] use_json                       = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] use_rootwrap_daemon            = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] use_stderr                     = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] use_syslog                     = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vcpu_pin_set                   = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vif_plugging_is_fatal          = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vif_plugging_timeout           = 0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] virt_mkfs                      = [] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] volume_usage_poll_interval     = 0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] watch_log_file                 = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] web                            = /usr/share/spice-html5 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_concurrency.disable_process_locking = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api.auth_strategy              = keystone {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api.compute_link_prefix        = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api.dhcp_domain                = novalocal {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api.enable_instance_password   = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api.glance_link_prefix         = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api.instance_list_per_project_cells = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api.list_records_by_skipping_down_cells = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api.local_metadata_per_cell    = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api.max_limit                  = 1000 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api.metadata_cache_expiration  = 15 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api.neutron_default_tenant_id  = default {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api.use_forwarded_for          = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api.use_neutron_default_nets   = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api.vendordata_dynamic_targets = [] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api.vendordata_jsonfile_path   = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.backend_argument         = **** {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.config_prefix            = cache.oslo {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.dead_timeout             = 60.0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.debug_cache_backend      = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.enable_retry_client      = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.enable_socket_keepalive  = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.enabled                  = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.expiration_time          = 600 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.hashclient_retry_attempts = 2 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.memcache_dead_retry      = 300 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.memcache_password        =  {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.memcache_sasl_enabled    = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.memcache_username        =  {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.proxies                  = [] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.retry_attempts           = 2 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.retry_delay              = 0.0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.socket_keepalive_count   = 1 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.socket_keepalive_idle    = 1 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.socket_keepalive_interval = 1 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.tls_allowed_ciphers      = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.tls_cafile               = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.tls_certfile             = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.tls_enabled              = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cache.tls_keyfile              = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cinder.auth_section            = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cinder.auth_type               = password {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cinder.cafile                  = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cinder.certfile                = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cinder.collect_timing          = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cinder.cross_az_attach         = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cinder.debug                   = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cinder.endpoint_template       = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cinder.http_retries            = 3 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cinder.insecure                = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cinder.keyfile                 = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cinder.os_region_name          = RegionOne {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cinder.split_loggers           = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cinder.timeout                 = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] compute.cpu_dedicated_set      = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] compute.cpu_shared_set         = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] compute.image_type_exclude_list = [] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] compute.resource_provider_association_refresh = 300 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] compute.shutdown_retry_interval = 10 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] conductor.workers              = 3 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] console.allowed_origins        = [] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] console.ssl_ciphers            = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] console.ssl_minimum_version    = default {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] consoleauth.token_ttl          = 600 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cyborg.cafile                  = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cyborg.certfile                = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cyborg.collect_timing          = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cyborg.connect_retries         = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cyborg.connect_retry_delay     = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cyborg.endpoint_override       = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cyborg.insecure                = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cyborg.keyfile                 = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cyborg.max_version             = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cyborg.min_version             = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cyborg.region_name             = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cyborg.service_name            = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cyborg.service_type            = accelerator {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cyborg.split_loggers           = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cyborg.status_code_retries     = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cyborg.status_code_retry_delay = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cyborg.timeout                 = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] cyborg.version                 = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] database.backend               = sqlalchemy {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] database.connection            = **** {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] database.connection_debug      = 0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] database.connection_parameters =  {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] database.connection_recycle_time = 3600 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] database.connection_trace      = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] database.db_inc_retry_interval = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] database.db_max_retries        = 20 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] database.db_max_retry_interval = 10 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] database.db_retry_interval     = 1 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] database.max_overflow          = 50 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] database.max_pool_size         = 5 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] database.max_retries           = 10 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] database.mysql_wsrep_sync_wait = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] database.pool_timeout          = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] database.retry_interval        = 10 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] database.slave_connection      = **** {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] database.sqlite_synchronous    = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api_database.backend           = sqlalchemy {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api_database.connection        = **** {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api_database.connection_debug  = 0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api_database.connection_parameters =  {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api_database.connection_recycle_time = 3600 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api_database.connection_trace  = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api_database.db_inc_retry_interval = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api_database.db_max_retries    = 20 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api_database.db_max_retry_interval = 10 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api_database.db_retry_interval = 1 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api_database.max_overflow      = 50 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api_database.max_pool_size     = 5 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api_database.max_retries       = 10 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api_database.pool_timeout      = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api_database.retry_interval    = 10 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api_database.slave_connection  = **** {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] api_database.sqlite_synchronous = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] devices.enabled_mdev_types     = [] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ephemeral_storage_encryption.enabled = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.api_servers             = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.cafile                  = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.certfile                = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.collect_timing          = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.connect_retries         = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.connect_retry_delay     = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.debug                   = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.default_trusted_certificate_ids = [] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.enable_certificate_validation = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.enable_rbd_download     = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.endpoint_override       = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.insecure                = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.keyfile                 = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.max_version             = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.min_version             = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.num_retries             = 3 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.rbd_ceph_conf           =  {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.rbd_connect_timeout     = 5 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.rbd_pool                =  {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.rbd_user                =  {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.region_name             = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.service_name            = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.service_type            = image {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.split_loggers           = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.status_code_retries     = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.status_code_retry_delay = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.timeout                 = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.verify_glance_signatures = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] glance.version                 = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] guestfs.debug                  = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] hyperv.config_drive_cdrom      = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] hyperv.config_drive_inject_password = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] hyperv.enable_remotefx         = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] hyperv.instances_path_share    =  {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] hyperv.limit_cpu_features      = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] hyperv.use_multipath_io        = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] hyperv.vswitch_name            = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] mks.enabled                    = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] image_cache.manager_interval   = 2400 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] image_cache.precache_concurrency = 1 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] image_cache.remove_unused_base_images = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] image_cache.subdirectory_name  = _base {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ironic.api_max_retries         = 60 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ironic.api_retry_interval      = 2 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ironic.auth_section            = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ironic.auth_type               = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ironic.cafile                  = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ironic.certfile                = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ironic.collect_timing          = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ironic.conductor_group         = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ironic.connect_retries         = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ironic.connect_retry_delay     = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ironic.endpoint_override       = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ironic.insecure                = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ironic.keyfile                 = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ironic.max_version             = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ironic.min_version             = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ironic.peer_list               = [] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ironic.region_name             = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ironic.serial_console_state_timeout = 10 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ironic.service_name            = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ironic.service_type            = baremetal {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ironic.split_loggers           = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ironic.status_code_retries     = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ironic.status_code_retry_delay = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ironic.timeout                 = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ironic.version                 = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] key_manager.fixed_key          = **** {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] barbican.barbican_api_version  = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] barbican.barbican_endpoint     = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] barbican.barbican_endpoint_type = public {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] barbican.barbican_region_name  = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] barbican.cafile                = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] barbican.certfile              = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] barbican.collect_timing        = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] barbican.insecure              = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] barbican.keyfile               = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] barbican.number_of_retries     = 60 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] barbican.retry_delay           = 1 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] barbican.send_service_user_token = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] barbican.split_loggers         = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] barbican.timeout               = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] barbican.verify_ssl            = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] barbican.verify_ssl_path       = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] barbican_service_user.auth_section = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] barbican_service_user.auth_type = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] barbican_service_user.cafile   = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] barbican_service_user.certfile = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] barbican_service_user.collect_timing = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] barbican_service_user.insecure = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] barbican_service_user.keyfile  = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] barbican_service_user.split_loggers = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] barbican_service_user.timeout  = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vault.approle_role_id          = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vault.approle_secret_id        = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vault.cafile                   = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vault.certfile                 = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vault.collect_timing           = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vault.insecure                 = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vault.keyfile                  = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vault.kv_mountpoint            = secret {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vault.kv_path                  = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vault.kv_version               = 2 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vault.namespace                = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vault.root_token_id            = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vault.split_loggers            = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vault.ssl_ca_crt_file          = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vault.timeout                  = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vault.use_ssl                  = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] keystone.auth_section          = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] keystone.auth_type             = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] keystone.cafile                = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] keystone.certfile              = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] keystone.collect_timing        = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] keystone.connect_retries       = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] keystone.connect_retry_delay   = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] keystone.endpoint_override     = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] keystone.insecure              = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] keystone.keyfile               = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] keystone.max_version           = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] keystone.min_version           = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] keystone.region_name           = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] keystone.service_name          = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] keystone.service_type          = identity {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] keystone.split_loggers         = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] keystone.status_code_retries   = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] keystone.status_code_retry_delay = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] keystone.timeout               = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] keystone.version               = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.connection_uri         =  {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.cpu_mode               = custom {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: WARNING oslo_config.cfg [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.cpu_power_governor_high = performance {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.cpu_power_management   = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.device_detach_attempts = 8 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.device_detach_timeout  = 20 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.disk_cachemodes        = [] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.disk_prefix            = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.enabled_perf_events    = [] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.file_backed_memory     = 0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.gid_maps               = [] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.hw_disk_discard        = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.hw_machine_type        = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.images_rbd_pool        = rbd {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.images_type            = default {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.images_volume_group    = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.inject_key             = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.inject_partition       = -2 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.inject_password        = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.iscsi_iface            = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.iser_use_multipath     = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.live_migration_downtime = 500 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.live_migration_inbound_addr = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.live_migration_scheme  = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.live_migration_timeout_action = abort {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.live_migration_tunnelled = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: WARNING oslo_config.cfg [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 15 02:37:38 user nova-compute[75391]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 15 02:37:38 user nova-compute[75391]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 15 02:37:38 user nova-compute[75391]: and ``live_migration_inbound_addr`` respectively.
Nov 15 02:37:38 user nova-compute[75391]: ).  Its value may be silently ignored in the future.
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.live_migration_with_native_tls = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.max_queues             = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.nfs_mount_options      = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.num_pcie_ports         = 0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.pmem_namespaces        = [] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.quobyte_client_cfg     = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.rbd_secret_uuid        = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.rbd_user               = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.rescue_image_id        = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.rescue_kernel_id       = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.rx_queue_size          = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.smbfs_mount_options    =  {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.snapshot_compression   = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.snapshot_image_format  = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.sparse_logical_volumes = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.swtpm_enabled          = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.swtpm_group            = tss {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.swtpm_user             = tss {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.sysinfo_serial         = unique {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.tb_cache_size          = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.tx_queue_size          = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.uid_maps               = [] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.use_virtio_for_bridges = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.virt_type              = kvm {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.volume_clear           = zero {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.volume_clear_size      = 0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.volume_use_multipath   = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.vzstorage_cache_path   = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] neutron.auth_section           = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] neutron.auth_type              = password {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] neutron.cafile                 = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] neutron.certfile               = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] neutron.collect_timing         = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] neutron.connect_retries        = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] neutron.connect_retry_delay    = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] neutron.default_floating_pool  = public {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] neutron.endpoint_override      = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] neutron.extension_sync_interval = 600 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] neutron.http_retries           = 3 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] neutron.insecure               = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] neutron.keyfile                = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] neutron.max_version            = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] neutron.min_version            = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] neutron.ovs_bridge             = br-int {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] neutron.physnets               = [] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] neutron.region_name            = RegionOne {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] neutron.service_metadata_proxy = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] neutron.service_name           = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] neutron.service_type           = network {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] neutron.split_loggers          = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] neutron.status_code_retries    = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] neutron.status_code_retry_delay = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] neutron.timeout                = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] neutron.version                = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] notifications.bdms_in_notifications = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] notifications.default_level    = INFO {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] notifications.notification_format = unversioned {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] notifications.notify_on_state_change = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] pci.alias                      = [] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] pci.device_spec                = [] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] pci.report_in_placement        = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.auth_section         = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.auth_type            = password {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.cafile               = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.certfile             = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.collect_timing       = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.connect_retries      = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.connect_retry_delay  = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.default_domain_id    = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.default_domain_name  = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.domain_id            = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.domain_name          = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.endpoint_override    = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.insecure             = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.keyfile              = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.max_version          = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.min_version          = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.password             = **** {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.project_domain_id    = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.project_domain_name  = Default {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.project_id           = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.project_name         = service {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.region_name          = RegionOne {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.service_name         = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.service_type         = placement {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.split_loggers        = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.status_code_retries  = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.status_code_retry_delay = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.system_scope         = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.timeout              = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.trust_id             = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.user_domain_id       = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.user_domain_name     = Default {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.user_id              = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.username             = placement {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] placement.version              = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] quota.cores                    = 20 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] quota.count_usage_from_placement = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] quota.injected_file_content_bytes = 10240 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] quota.injected_file_path_length = 255 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] quota.injected_files           = 5 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] quota.instances                = 10 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] quota.key_pairs                = 100 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] quota.metadata_items           = 128 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] quota.ram                      = 51200 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] quota.recheck_quota            = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] quota.server_group_members     = 10 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] quota.server_groups            = 10 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] rdp.enabled                    = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] scheduler.image_metadata_prefilter = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] scheduler.max_attempts         = 3 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] scheduler.max_placement_results = 1000 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] scheduler.workers              = 3 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] filter_scheduler.host_subset_size = 1 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] filter_scheduler.isolated_hosts = [] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] filter_scheduler.isolated_images = [] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] filter_scheduler.pci_in_placement = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] filter_scheduler.track_instance_changes = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] metrics.required               = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] metrics.weight_multiplier      = 1.0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] metrics.weight_setting         = [] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] serial_console.enabled         = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] serial_console.port_range      = 10000:20000 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] serial_console.serialproxy_port = 6083 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] service_user.auth_section      = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] service_user.auth_type         = password {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] service_user.cafile            = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] service_user.certfile          = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] service_user.collect_timing    = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] service_user.insecure          = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] service_user.keyfile           = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] service_user.send_service_user_token = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] service_user.split_loggers     = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] service_user.timeout           = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] spice.agent_enabled            = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] spice.enabled                  = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] spice.html5proxy_port          = 6082 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] spice.image_compression        = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] spice.jpeg_compression         = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] spice.playback_compression     = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] spice.server_listen            = 127.0.0.1 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] spice.streaming_mode           = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] spice.zlib_compression         = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] upgrade_levels.baseapi         = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] upgrade_levels.cert            = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] upgrade_levels.compute         = auto {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] upgrade_levels.conductor       = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] upgrade_levels.scheduler       = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vendordata_dynamic_auth.cafile = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vendordata_dynamic_auth.certfile = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vendordata_dynamic_auth.insecure = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vendordata_dynamic_auth.timeout = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vmware.api_retry_count         = 10 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vmware.ca_file                 = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vmware.cache_prefix            = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vmware.cluster_name            = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vmware.connection_pool_size    = 10 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vmware.console_delay_seconds   = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vmware.datastore_regex         = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vmware.host_ip                 = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vmware.host_password           = **** {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vmware.host_port               = 443 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vmware.host_username           = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vmware.insecure                = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vmware.integration_bridge      = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vmware.maximum_objects         = 100 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vmware.pbm_default_policy      = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vmware.pbm_enabled             = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vmware.pbm_wsdl_location       = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vmware.serial_port_proxy_uri   = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vmware.serial_port_service_uri = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vmware.task_poll_interval      = 0.5 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vmware.use_linked_clone        = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vmware.vnc_keymap              = en-us {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vmware.vnc_port                = 5900 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vmware.vnc_port_total          = 10000 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vnc.auth_schemes               = ['none'] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vnc.enabled                    = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vnc.novncproxy_port            = 6080 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vnc.vencrypt_ca_certs          = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vnc.vencrypt_client_cert       = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vnc.vencrypt_client_key        = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] workarounds.disable_rootwrap   = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] workarounds.enable_numa_live_migration = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] workarounds.libvirt_disable_apic = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] wsgi.client_socket_timeout     = 900 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] wsgi.default_pool_size         = 1000 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] wsgi.keep_alive                = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] wsgi.max_header_line           = 16384 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] wsgi.ssl_ca_file               = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] wsgi.ssl_cert_file             = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] wsgi.ssl_key_file              = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] wsgi.tcp_keepidle              = 600 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] zvm.ca_file                    = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] zvm.cloud_connector_url        = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] zvm.reachable_timeout          = 300 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_policy.enforce_new_defaults = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_policy.enforce_scope      = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_policy.policy_default_rule = default {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] profiler.connection_string     = messaging:// {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] profiler.enabled               = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] profiler.es_doc_type           = notification {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] profiler.es_scroll_size        = 10000 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] profiler.es_scroll_time        = 2m {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] profiler.filter_error_trace    = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] profiler.hmac_keys             = **** {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] profiler.sentinel_service_name = mymaster {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] profiler.socket_timeout        = 0.1 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] profiler.trace_requests        = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] profiler.trace_sqlalchemy      = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] profiler_jaeger.process_tags   = {} {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] profiler_jaeger.service_name_prefix = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] profiler_otlp.service_name_prefix = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] remote_debug.host              = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] remote_debug.port              = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_notifications.retry = -1 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_limit.auth_section        = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_limit.auth_type           = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_limit.cafile              = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_limit.certfile            = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_limit.collect_timing      = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_limit.connect_retries     = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_limit.connect_retry_delay = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_limit.endpoint_id         = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_limit.endpoint_override   = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_limit.insecure            = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_limit.keyfile             = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_limit.max_version         = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_limit.min_version         = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_limit.region_name         = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_limit.service_name        = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_limit.service_type        = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_limit.split_loggers       = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_limit.status_code_retries = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_limit.status_code_retry_delay = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_limit.timeout             = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_limit.valid_interfaces    = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_limit.version             = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_reports.file_event_handler = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] oslo_reports.log_dir           = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vif_plug_ovs_privileged.group  = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] vif_plug_ovs_privileged.user   = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] os_vif_ovs.isolate_vif         = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] os_brick.lock_path             = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] privsep_osbrick.capabilities   = [21] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] privsep_osbrick.group          = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] privsep_osbrick.helper_command = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] privsep_osbrick.user           = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] nova_sys_admin.group           = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] nova_sys_admin.helper_command  = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] nova_sys_admin.user            = None {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG oslo_service.service [None req-18299958-4b5d-42b9-a38f-e1ef16942ef2 None None] ******************************************************************************** {{(pid=75391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 15 02:37:38 user nova-compute[75391]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 15 02:37:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Connecting to libvirt: qemu:///system {{(pid=75391) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f6245973040> {{(pid=75391) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 15 02:37:38 user nova-compute[75391]: libvirt:  error : internal error: could not initialize domain event timer
Nov 15 02:37:38 user nova-compute[75391]: WARNING nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 15 02:37:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f6245973040> {{(pid=75391) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Starting native event thread {{(pid=75391) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Starting green dispatch thread {{(pid=75391) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 15 02:37:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Starting connection event dispatch thread {{(pid=75391) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 15 02:37:38 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Connection event '1' reason 'None'
Nov 15 02:37:38 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 15 02:37:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.mount [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Initialising _HostMountState generation 0 {{(pid=75391) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 15 02:37:45 user nova-compute[75391]: INFO nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Libvirt host capabilities <capabilities>
Nov 15 02:37:45 user nova-compute[75391]:   <host>
Nov 15 02:37:45 user nova-compute[75391]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 15 02:37:45 user nova-compute[75391]:     <cpu>
Nov 15 02:37:45 user nova-compute[75391]:       <arch>x86_64</arch>
Nov 15 02:37:45 user nova-compute[75391]:       <model>IvyBridge-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <vendor>Intel</vendor>
Nov 15 02:37:45 user nova-compute[75391]:       <microcode version='1070'/>
Nov 15 02:37:45 user nova-compute[75391]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 15 02:37:45 user nova-compute[75391]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature name='ss'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature name='vmx'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature name='pcid'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature name='osxsave'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature name='hypervisor'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature name='arat'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature name='tsc_adjust'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature name='md-clear'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature name='stibp'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature name='arch-capabilities'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature name='ssbd'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature name='invtsc'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature name='rsba'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature name='skip-l1dfl-vmentry'/>
Nov 15 02:37:45 user nova-compute[75391]:       <pages unit='KiB' size='4'/>
Nov 15 02:37:45 user nova-compute[75391]:       <pages unit='KiB' size='2048'/>
Nov 15 02:37:45 user nova-compute[75391]:     </cpu>
Nov 15 02:37:45 user nova-compute[75391]:     <power_management>
Nov 15 02:37:45 user nova-compute[75391]:       <suspend_mem/>
Nov 15 02:37:45 user nova-compute[75391]:       <suspend_disk/>
Nov 15 02:37:45 user nova-compute[75391]:       <suspend_hybrid/>
Nov 15 02:37:45 user nova-compute[75391]:     </power_management>
Nov 15 02:37:45 user nova-compute[75391]:     <iommu support='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     <migration_features>
Nov 15 02:37:45 user nova-compute[75391]:       <live/>
Nov 15 02:37:45 user nova-compute[75391]:       <uri_transports>
Nov 15 02:37:45 user nova-compute[75391]:         <uri_transport>tcp</uri_transport>
Nov 15 02:37:45 user nova-compute[75391]:         <uri_transport>rdma</uri_transport>
Nov 15 02:37:45 user nova-compute[75391]:       </uri_transports>
Nov 15 02:37:45 user nova-compute[75391]:     </migration_features>
Nov 15 02:37:45 user nova-compute[75391]:     <topology>
Nov 15 02:37:45 user nova-compute[75391]:       <cells num='2'>
Nov 15 02:37:45 user nova-compute[75391]:         <cell id='0'>
Nov 15 02:37:45 user nova-compute[75391]:           <memory unit='KiB'>8140616</memory>
Nov 15 02:37:45 user nova-compute[75391]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 15 02:37:45 user nova-compute[75391]:           <pages unit='KiB' size='2048'>0</pages>
Nov 15 02:37:45 user nova-compute[75391]:           <distances>
Nov 15 02:37:45 user nova-compute[75391]:             <sibling id='0' value='10'/>
Nov 15 02:37:45 user nova-compute[75391]:             <sibling id='1' value='20'/>
Nov 15 02:37:45 user nova-compute[75391]:           </distances>
Nov 15 02:37:45 user nova-compute[75391]:           <cpus num='6'>
Nov 15 02:37:45 user nova-compute[75391]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 15 02:37:45 user nova-compute[75391]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 15 02:37:45 user nova-compute[75391]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 15 02:37:45 user nova-compute[75391]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 15 02:37:45 user nova-compute[75391]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 15 02:37:45 user nova-compute[75391]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 15 02:37:45 user nova-compute[75391]:           </cpus>
Nov 15 02:37:45 user nova-compute[75391]:         </cell>
Nov 15 02:37:45 user nova-compute[75391]:         <cell id='1'>
Nov 15 02:37:45 user nova-compute[75391]:           <memory unit='KiB'>8255068</memory>
Nov 15 02:37:45 user nova-compute[75391]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 15 02:37:45 user nova-compute[75391]:           <pages unit='KiB' size='2048'>0</pages>
Nov 15 02:37:45 user nova-compute[75391]:           <distances>
Nov 15 02:37:45 user nova-compute[75391]:             <sibling id='0' value='20'/>
Nov 15 02:37:45 user nova-compute[75391]:             <sibling id='1' value='10'/>
Nov 15 02:37:45 user nova-compute[75391]:           </distances>
Nov 15 02:37:45 user nova-compute[75391]:           <cpus num='6'>
Nov 15 02:37:45 user nova-compute[75391]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 15 02:37:45 user nova-compute[75391]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 15 02:37:45 user nova-compute[75391]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 15 02:37:45 user nova-compute[75391]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 15 02:37:45 user nova-compute[75391]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 15 02:37:45 user nova-compute[75391]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 15 02:37:45 user nova-compute[75391]:           </cpus>
Nov 15 02:37:45 user nova-compute[75391]:         </cell>
Nov 15 02:37:45 user nova-compute[75391]:       </cells>
Nov 15 02:37:45 user nova-compute[75391]:     </topology>
Nov 15 02:37:45 user nova-compute[75391]:     <cache>
Nov 15 02:37:45 user nova-compute[75391]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 15 02:37:45 user nova-compute[75391]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 15 02:37:45 user nova-compute[75391]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 15 02:37:45 user nova-compute[75391]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 15 02:37:45 user nova-compute[75391]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 15 02:37:45 user nova-compute[75391]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 15 02:37:45 user nova-compute[75391]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 15 02:37:45 user nova-compute[75391]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 15 02:37:45 user nova-compute[75391]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 15 02:37:45 user nova-compute[75391]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 15 02:37:45 user nova-compute[75391]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 15 02:37:45 user nova-compute[75391]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 15 02:37:45 user nova-compute[75391]:     </cache>
Nov 15 02:37:45 user nova-compute[75391]:     <secmodel>
Nov 15 02:37:45 user nova-compute[75391]:       <model>apparmor</model>
Nov 15 02:37:45 user nova-compute[75391]:       <doi>0</doi>
Nov 15 02:37:45 user nova-compute[75391]:     </secmodel>
Nov 15 02:37:45 user nova-compute[75391]:     <secmodel>
Nov 15 02:37:45 user nova-compute[75391]:       <model>dac</model>
Nov 15 02:37:45 user nova-compute[75391]:       <doi>0</doi>
Nov 15 02:37:45 user nova-compute[75391]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 15 02:37:45 user nova-compute[75391]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 15 02:37:45 user nova-compute[75391]:     </secmodel>
Nov 15 02:37:45 user nova-compute[75391]:   </host>
Nov 15 02:37:45 user nova-compute[75391]:   <guest>
Nov 15 02:37:45 user nova-compute[75391]:     <os_type>hvm</os_type>
Nov 15 02:37:45 user nova-compute[75391]:     <arch name='alpha'>
Nov 15 02:37:45 user nova-compute[75391]:       <wordsize>64</wordsize>
Nov 15 02:37:45 user nova-compute[75391]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>clipper</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <domain type='qemu'/>
Nov 15 02:37:45 user nova-compute[75391]:     </arch>
Nov 15 02:37:45 user nova-compute[75391]:     <features>
Nov 15 02:37:45 user nova-compute[75391]:       <cpuselection/>
Nov 15 02:37:45 user nova-compute[75391]:       <deviceboot/>
Nov 15 02:37:45 user nova-compute[75391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     </features>
Nov 15 02:37:45 user nova-compute[75391]:   </guest>
Nov 15 02:37:45 user nova-compute[75391]:   <guest>
Nov 15 02:37:45 user nova-compute[75391]:     <os_type>hvm</os_type>
Nov 15 02:37:45 user nova-compute[75391]:     <arch name='armv6l'>
Nov 15 02:37:45 user nova-compute[75391]:       <wordsize>32</wordsize>
Nov 15 02:37:45 user nova-compute[75391]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>spitz</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>nuri</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>kzm</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>sx1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>z2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>tosa</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>n810</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>n800</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>terrier</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>midway</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>microbit</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>verdex</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>highbank</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>akita</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>connex</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>collie</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <domain type='qemu'/>
Nov 15 02:37:45 user nova-compute[75391]:     </arch>
Nov 15 02:37:45 user nova-compute[75391]:     <features>
Nov 15 02:37:45 user nova-compute[75391]:       <cpuselection/>
Nov 15 02:37:45 user nova-compute[75391]:       <deviceboot/>
Nov 15 02:37:45 user nova-compute[75391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     </features>
Nov 15 02:37:45 user nova-compute[75391]:   </guest>
Nov 15 02:37:45 user nova-compute[75391]:   <guest>
Nov 15 02:37:45 user nova-compute[75391]:     <os_type>hvm</os_type>
Nov 15 02:37:45 user nova-compute[75391]:     <arch name='armv7l'>
Nov 15 02:37:45 user nova-compute[75391]:       <wordsize>32</wordsize>
Nov 15 02:37:45 user nova-compute[75391]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>spitz</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>nuri</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>kzm</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>sx1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>z2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>tosa</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>n810</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>n800</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>terrier</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>midway</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>microbit</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>verdex</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>highbank</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>akita</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>connex</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>collie</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <domain type='qemu'/>
Nov 15 02:37:45 user nova-compute[75391]:     </arch>
Nov 15 02:37:45 user nova-compute[75391]:     <features>
Nov 15 02:37:45 user nova-compute[75391]:       <cpuselection/>
Nov 15 02:37:45 user nova-compute[75391]:       <deviceboot/>
Nov 15 02:37:45 user nova-compute[75391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     </features>
Nov 15 02:37:45 user nova-compute[75391]:   </guest>
Nov 15 02:37:45 user nova-compute[75391]:   <guest>
Nov 15 02:37:45 user nova-compute[75391]:     <os_type>hvm</os_type>
Nov 15 02:37:45 user nova-compute[75391]:     <arch name='aarch64'>
Nov 15 02:37:45 user nova-compute[75391]:       <wordsize>64</wordsize>
Nov 15 02:37:45 user nova-compute[75391]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>spitz</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>nuri</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>kzm</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>sx1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>z2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>tosa</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>n810</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>n800</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>terrier</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>midway</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>microbit</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>verdex</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>raspi3b</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>highbank</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>akita</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>connex</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>collie</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <domain type='qemu'/>
Nov 15 02:37:45 user nova-compute[75391]:     </arch>
Nov 15 02:37:45 user nova-compute[75391]:     <features>
Nov 15 02:37:45 user nova-compute[75391]:       <acpi default='on' toggle='yes'/>
Nov 15 02:37:45 user nova-compute[75391]:       <cpuselection/>
Nov 15 02:37:45 user nova-compute[75391]:       <deviceboot/>
Nov 15 02:37:45 user nova-compute[75391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     </features>
Nov 15 02:37:45 user nova-compute[75391]:   </guest>
Nov 15 02:37:45 user nova-compute[75391]:   <guest>
Nov 15 02:37:45 user nova-compute[75391]:     <os_type>hvm</os_type>
Nov 15 02:37:45 user nova-compute[75391]:     <arch name='cris'>
Nov 15 02:37:45 user nova-compute[75391]:       <wordsize>32</wordsize>
Nov 15 02:37:45 user nova-compute[75391]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <domain type='qemu'/>
Nov 15 02:37:45 user nova-compute[75391]:     </arch>
Nov 15 02:37:45 user nova-compute[75391]:     <features>
Nov 15 02:37:45 user nova-compute[75391]:       <cpuselection/>
Nov 15 02:37:45 user nova-compute[75391]:       <deviceboot/>
Nov 15 02:37:45 user nova-compute[75391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     </features>
Nov 15 02:37:45 user nova-compute[75391]:   </guest>
Nov 15 02:37:45 user nova-compute[75391]:   <guest>
Nov 15 02:37:45 user nova-compute[75391]:     <os_type>hvm</os_type>
Nov 15 02:37:45 user nova-compute[75391]:     <arch name='i686'>
Nov 15 02:37:45 user nova-compute[75391]:       <wordsize>32</wordsize>
Nov 15 02:37:45 user nova-compute[75391]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>x-remote</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>isapc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>microvm</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <domain type='qemu'/>
Nov 15 02:37:45 user nova-compute[75391]:       <domain type='kvm'/>
Nov 15 02:37:45 user nova-compute[75391]:     </arch>
Nov 15 02:37:45 user nova-compute[75391]:     <features>
Nov 15 02:37:45 user nova-compute[75391]:       <pae/>
Nov 15 02:37:45 user nova-compute[75391]:       <nonpae/>
Nov 15 02:37:45 user nova-compute[75391]:       <acpi default='on' toggle='yes'/>
Nov 15 02:37:45 user nova-compute[75391]:       <apic default='on' toggle='no'/>
Nov 15 02:37:45 user nova-compute[75391]:       <cpuselection/>
Nov 15 02:37:45 user nova-compute[75391]:       <deviceboot/>
Nov 15 02:37:45 user nova-compute[75391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     </features>
Nov 15 02:37:45 user nova-compute[75391]:   </guest>
Nov 15 02:37:45 user nova-compute[75391]:   <guest>
Nov 15 02:37:45 user nova-compute[75391]:     <os_type>hvm</os_type>
Nov 15 02:37:45 user nova-compute[75391]:     <arch name='m68k'>
Nov 15 02:37:45 user nova-compute[75391]:       <wordsize>32</wordsize>
Nov 15 02:37:45 user nova-compute[75391]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>an5206</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>q800</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>next-cube</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <domain type='qemu'/>
Nov 15 02:37:45 user nova-compute[75391]:     </arch>
Nov 15 02:37:45 user nova-compute[75391]:     <features>
Nov 15 02:37:45 user nova-compute[75391]:       <cpuselection/>
Nov 15 02:37:45 user nova-compute[75391]:       <deviceboot/>
Nov 15 02:37:45 user nova-compute[75391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     </features>
Nov 15 02:37:45 user nova-compute[75391]:   </guest>
Nov 15 02:37:45 user nova-compute[75391]:   <guest>
Nov 15 02:37:45 user nova-compute[75391]:     <os_type>hvm</os_type>
Nov 15 02:37:45 user nova-compute[75391]:     <arch name='microblaze'>
Nov 15 02:37:45 user nova-compute[75391]:       <wordsize>32</wordsize>
Nov 15 02:37:45 user nova-compute[75391]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <domain type='qemu'/>
Nov 15 02:37:45 user nova-compute[75391]:     </arch>
Nov 15 02:37:45 user nova-compute[75391]:     <features>
Nov 15 02:37:45 user nova-compute[75391]:       <cpuselection/>
Nov 15 02:37:45 user nova-compute[75391]:       <deviceboot/>
Nov 15 02:37:45 user nova-compute[75391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     </features>
Nov 15 02:37:45 user nova-compute[75391]:   </guest>
Nov 15 02:37:45 user nova-compute[75391]:   <guest>
Nov 15 02:37:45 user nova-compute[75391]:     <os_type>hvm</os_type>
Nov 15 02:37:45 user nova-compute[75391]:     <arch name='microblazeel'>
Nov 15 02:37:45 user nova-compute[75391]:       <wordsize>32</wordsize>
Nov 15 02:37:45 user nova-compute[75391]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <domain type='qemu'/>
Nov 15 02:37:45 user nova-compute[75391]:     </arch>
Nov 15 02:37:45 user nova-compute[75391]:     <features>
Nov 15 02:37:45 user nova-compute[75391]:       <cpuselection/>
Nov 15 02:37:45 user nova-compute[75391]:       <deviceboot/>
Nov 15 02:37:45 user nova-compute[75391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     </features>
Nov 15 02:37:45 user nova-compute[75391]:   </guest>
Nov 15 02:37:45 user nova-compute[75391]:   <guest>
Nov 15 02:37:45 user nova-compute[75391]:     <os_type>hvm</os_type>
Nov 15 02:37:45 user nova-compute[75391]:     <arch name='mips'>
Nov 15 02:37:45 user nova-compute[75391]:       <wordsize>32</wordsize>
Nov 15 02:37:45 user nova-compute[75391]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='16'>malta</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <domain type='qemu'/>
Nov 15 02:37:45 user nova-compute[75391]:     </arch>
Nov 15 02:37:45 user nova-compute[75391]:     <features>
Nov 15 02:37:45 user nova-compute[75391]:       <cpuselection/>
Nov 15 02:37:45 user nova-compute[75391]:       <deviceboot/>
Nov 15 02:37:45 user nova-compute[75391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     </features>
Nov 15 02:37:45 user nova-compute[75391]:   </guest>
Nov 15 02:37:45 user nova-compute[75391]:   <guest>
Nov 15 02:37:45 user nova-compute[75391]:     <os_type>hvm</os_type>
Nov 15 02:37:45 user nova-compute[75391]:     <arch name='mipsel'>
Nov 15 02:37:45 user nova-compute[75391]:       <wordsize>32</wordsize>
Nov 15 02:37:45 user nova-compute[75391]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='16'>malta</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <domain type='qemu'/>
Nov 15 02:37:45 user nova-compute[75391]:     </arch>
Nov 15 02:37:45 user nova-compute[75391]:     <features>
Nov 15 02:37:45 user nova-compute[75391]:       <cpuselection/>
Nov 15 02:37:45 user nova-compute[75391]:       <deviceboot/>
Nov 15 02:37:45 user nova-compute[75391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     </features>
Nov 15 02:37:45 user nova-compute[75391]:   </guest>
Nov 15 02:37:45 user nova-compute[75391]:   <guest>
Nov 15 02:37:45 user nova-compute[75391]:     <os_type>hvm</os_type>
Nov 15 02:37:45 user nova-compute[75391]:     <arch name='mips64'>
Nov 15 02:37:45 user nova-compute[75391]:       <wordsize>64</wordsize>
Nov 15 02:37:45 user nova-compute[75391]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='16'>malta</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>pica61</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>magnum</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <domain type='qemu'/>
Nov 15 02:37:45 user nova-compute[75391]:     </arch>
Nov 15 02:37:45 user nova-compute[75391]:     <features>
Nov 15 02:37:45 user nova-compute[75391]:       <cpuselection/>
Nov 15 02:37:45 user nova-compute[75391]:       <deviceboot/>
Nov 15 02:37:45 user nova-compute[75391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     </features>
Nov 15 02:37:45 user nova-compute[75391]:   </guest>
Nov 15 02:37:45 user nova-compute[75391]:   <guest>
Nov 15 02:37:45 user nova-compute[75391]:     <os_type>hvm</os_type>
Nov 15 02:37:45 user nova-compute[75391]:     <arch name='mips64el'>
Nov 15 02:37:45 user nova-compute[75391]:       <wordsize>64</wordsize>
Nov 15 02:37:45 user nova-compute[75391]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='16'>malta</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>pica61</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>magnum</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='16'>boston</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <domain type='qemu'/>
Nov 15 02:37:45 user nova-compute[75391]:     </arch>
Nov 15 02:37:45 user nova-compute[75391]:     <features>
Nov 15 02:37:45 user nova-compute[75391]:       <cpuselection/>
Nov 15 02:37:45 user nova-compute[75391]:       <deviceboot/>
Nov 15 02:37:45 user nova-compute[75391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     </features>
Nov 15 02:37:45 user nova-compute[75391]:   </guest>
Nov 15 02:37:45 user nova-compute[75391]:   <guest>
Nov 15 02:37:45 user nova-compute[75391]:     <os_type>hvm</os_type>
Nov 15 02:37:45 user nova-compute[75391]:     <arch name='ppc'>
Nov 15 02:37:45 user nova-compute[75391]:       <wordsize>32</wordsize>
Nov 15 02:37:45 user nova-compute[75391]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mac99</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>40p</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>taihu</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <domain type='qemu'/>
Nov 15 02:37:45 user nova-compute[75391]:     </arch>
Nov 15 02:37:45 user nova-compute[75391]:     <features>
Nov 15 02:37:45 user nova-compute[75391]:       <cpuselection/>
Nov 15 02:37:45 user nova-compute[75391]:       <deviceboot/>
Nov 15 02:37:45 user nova-compute[75391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     </features>
Nov 15 02:37:45 user nova-compute[75391]:   </guest>
Nov 15 02:37:45 user nova-compute[75391]:   <guest>
Nov 15 02:37:45 user nova-compute[75391]:     <os_type>hvm</os_type>
Nov 15 02:37:45 user nova-compute[75391]:     <arch name='ppc64'>
Nov 15 02:37:45 user nova-compute[75391]:       <wordsize>64</wordsize>
Nov 15 02:37:45 user nova-compute[75391]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2048'>powernv9</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>taihu</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2048'>powernv10</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>40p</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mac99</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2048'>powernv8</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <domain type='qemu'/>
Nov 15 02:37:45 user nova-compute[75391]:     </arch>
Nov 15 02:37:45 user nova-compute[75391]:     <features>
Nov 15 02:37:45 user nova-compute[75391]:       <cpuselection/>
Nov 15 02:37:45 user nova-compute[75391]:       <deviceboot/>
Nov 15 02:37:45 user nova-compute[75391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     </features>
Nov 15 02:37:45 user nova-compute[75391]:   </guest>
Nov 15 02:37:45 user nova-compute[75391]:   <guest>
Nov 15 02:37:45 user nova-compute[75391]:     <os_type>hvm</os_type>
Nov 15 02:37:45 user nova-compute[75391]:     <arch name='ppc64le'>
Nov 15 02:37:45 user nova-compute[75391]:       <wordsize>64</wordsize>
Nov 15 02:37:45 user nova-compute[75391]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2048'>powernv9</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>taihu</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2048'>powernv10</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>40p</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>mac99</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2048'>powernv8</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <domain type='qemu'/>
Nov 15 02:37:45 user nova-compute[75391]:     </arch>
Nov 15 02:37:45 user nova-compute[75391]:     <features>
Nov 15 02:37:45 user nova-compute[75391]:       <cpuselection/>
Nov 15 02:37:45 user nova-compute[75391]:       <deviceboot/>
Nov 15 02:37:45 user nova-compute[75391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     </features>
Nov 15 02:37:45 user nova-compute[75391]:   </guest>
Nov 15 02:37:45 user nova-compute[75391]:   <guest>
Nov 15 02:37:45 user nova-compute[75391]:     <os_type>hvm</os_type>
Nov 15 02:37:45 user nova-compute[75391]:     <arch name='riscv32'>
Nov 15 02:37:45 user nova-compute[75391]:       <wordsize>32</wordsize>
Nov 15 02:37:45 user nova-compute[75391]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='8'>spike</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>opentitan</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='5'>sifive_u</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>sifive_e</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='8'>virt</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <domain type='qemu'/>
Nov 15 02:37:45 user nova-compute[75391]:     </arch>
Nov 15 02:37:45 user nova-compute[75391]:     <features>
Nov 15 02:37:45 user nova-compute[75391]:       <cpuselection/>
Nov 15 02:37:45 user nova-compute[75391]:       <deviceboot/>
Nov 15 02:37:45 user nova-compute[75391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     </features>
Nov 15 02:37:45 user nova-compute[75391]:   </guest>
Nov 15 02:37:45 user nova-compute[75391]:   <guest>
Nov 15 02:37:45 user nova-compute[75391]:     <os_type>hvm</os_type>
Nov 15 02:37:45 user nova-compute[75391]:     <arch name='riscv64'>
Nov 15 02:37:45 user nova-compute[75391]:       <wordsize>64</wordsize>
Nov 15 02:37:45 user nova-compute[75391]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='8'>spike</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='5'>sifive_u</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>shakti_c</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>sifive_e</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='8'>virt</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <domain type='qemu'/>
Nov 15 02:37:45 user nova-compute[75391]:     </arch>
Nov 15 02:37:45 user nova-compute[75391]:     <features>
Nov 15 02:37:45 user nova-compute[75391]:       <cpuselection/>
Nov 15 02:37:45 user nova-compute[75391]:       <deviceboot/>
Nov 15 02:37:45 user nova-compute[75391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     </features>
Nov 15 02:37:45 user nova-compute[75391]:   </guest>
Nov 15 02:37:45 user nova-compute[75391]:   <guest>
Nov 15 02:37:45 user nova-compute[75391]:     <os_type>hvm</os_type>
Nov 15 02:37:45 user nova-compute[75391]:     <arch name='s390x'>
Nov 15 02:37:45 user nova-compute[75391]:       <wordsize>64</wordsize>
Nov 15 02:37:45 user nova-compute[75391]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <domain type='qemu'/>
Nov 15 02:37:45 user nova-compute[75391]:     </arch>
Nov 15 02:37:45 user nova-compute[75391]:     <features>
Nov 15 02:37:45 user nova-compute[75391]:       <cpuselection/>
Nov 15 02:37:45 user nova-compute[75391]:       <deviceboot/>
Nov 15 02:37:45 user nova-compute[75391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     </features>
Nov 15 02:37:45 user nova-compute[75391]:   </guest>
Nov 15 02:37:45 user nova-compute[75391]:   <guest>
Nov 15 02:37:45 user nova-compute[75391]:     <os_type>hvm</os_type>
Nov 15 02:37:45 user nova-compute[75391]:     <arch name='sh4'>
Nov 15 02:37:45 user nova-compute[75391]:       <wordsize>32</wordsize>
Nov 15 02:37:45 user nova-compute[75391]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>shix</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>r2d</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <domain type='qemu'/>
Nov 15 02:37:45 user nova-compute[75391]:     </arch>
Nov 15 02:37:45 user nova-compute[75391]:     <features>
Nov 15 02:37:45 user nova-compute[75391]:       <cpuselection/>
Nov 15 02:37:45 user nova-compute[75391]:       <deviceboot/>
Nov 15 02:37:45 user nova-compute[75391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     </features>
Nov 15 02:37:45 user nova-compute[75391]:   </guest>
Nov 15 02:37:45 user nova-compute[75391]:   <guest>
Nov 15 02:37:45 user nova-compute[75391]:     <os_type>hvm</os_type>
Nov 15 02:37:45 user nova-compute[75391]:     <arch name='sh4eb'>
Nov 15 02:37:45 user nova-compute[75391]:       <wordsize>64</wordsize>
Nov 15 02:37:45 user nova-compute[75391]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>shix</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>r2d</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <domain type='qemu'/>
Nov 15 02:37:45 user nova-compute[75391]:     </arch>
Nov 15 02:37:45 user nova-compute[75391]:     <features>
Nov 15 02:37:45 user nova-compute[75391]:       <cpuselection/>
Nov 15 02:37:45 user nova-compute[75391]:       <deviceboot/>
Nov 15 02:37:45 user nova-compute[75391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     </features>
Nov 15 02:37:45 user nova-compute[75391]:   </guest>
Nov 15 02:37:45 user nova-compute[75391]:   <guest>
Nov 15 02:37:45 user nova-compute[75391]:     <os_type>hvm</os_type>
Nov 15 02:37:45 user nova-compute[75391]:     <arch name='sparc'>
Nov 15 02:37:45 user nova-compute[75391]:       <wordsize>32</wordsize>
Nov 15 02:37:45 user nova-compute[75391]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>SS-5</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>SS-20</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>LX</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>SS-4</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>SS-10</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>Voyager</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <domain type='qemu'/>
Nov 15 02:37:45 user nova-compute[75391]:     </arch>
Nov 15 02:37:45 user nova-compute[75391]:     <features>
Nov 15 02:37:45 user nova-compute[75391]:       <cpuselection/>
Nov 15 02:37:45 user nova-compute[75391]:       <deviceboot/>
Nov 15 02:37:45 user nova-compute[75391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     </features>
Nov 15 02:37:45 user nova-compute[75391]:   </guest>
Nov 15 02:37:45 user nova-compute[75391]:   <guest>
Nov 15 02:37:45 user nova-compute[75391]:     <os_type>hvm</os_type>
Nov 15 02:37:45 user nova-compute[75391]:     <arch name='sparc64'>
Nov 15 02:37:45 user nova-compute[75391]:       <wordsize>64</wordsize>
Nov 15 02:37:45 user nova-compute[75391]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>sun4u</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>niagara</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>sun4v</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <domain type='qemu'/>
Nov 15 02:37:45 user nova-compute[75391]:     </arch>
Nov 15 02:37:45 user nova-compute[75391]:     <features>
Nov 15 02:37:45 user nova-compute[75391]:       <cpuselection/>
Nov 15 02:37:45 user nova-compute[75391]:       <deviceboot/>
Nov 15 02:37:45 user nova-compute[75391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     </features>
Nov 15 02:37:45 user nova-compute[75391]:   </guest>
Nov 15 02:37:45 user nova-compute[75391]:   <guest>
Nov 15 02:37:45 user nova-compute[75391]:     <os_type>hvm</os_type>
Nov 15 02:37:45 user nova-compute[75391]:     <arch name='x86_64'>
Nov 15 02:37:45 user nova-compute[75391]:       <wordsize>64</wordsize>
Nov 15 02:37:45 user nova-compute[75391]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>x-remote</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='1'>isapc</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>microvm</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <domain type='qemu'/>
Nov 15 02:37:45 user nova-compute[75391]:       <domain type='kvm'/>
Nov 15 02:37:45 user nova-compute[75391]:     </arch>
Nov 15 02:37:45 user nova-compute[75391]:     <features>
Nov 15 02:37:45 user nova-compute[75391]:       <acpi default='on' toggle='yes'/>
Nov 15 02:37:45 user nova-compute[75391]:       <apic default='on' toggle='no'/>
Nov 15 02:37:45 user nova-compute[75391]:       <cpuselection/>
Nov 15 02:37:45 user nova-compute[75391]:       <deviceboot/>
Nov 15 02:37:45 user nova-compute[75391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     </features>
Nov 15 02:37:45 user nova-compute[75391]:   </guest>
Nov 15 02:37:45 user nova-compute[75391]:   <guest>
Nov 15 02:37:45 user nova-compute[75391]:     <os_type>hvm</os_type>
Nov 15 02:37:45 user nova-compute[75391]:     <arch name='xtensa'>
Nov 15 02:37:45 user nova-compute[75391]:       <wordsize>32</wordsize>
Nov 15 02:37:45 user nova-compute[75391]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>sim</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='32'>kc705</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='32'>ml605</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='32'>virt</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='32'>lx200</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='32'>lx60</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <domain type='qemu'/>
Nov 15 02:37:45 user nova-compute[75391]:     </arch>
Nov 15 02:37:45 user nova-compute[75391]:     <features>
Nov 15 02:37:45 user nova-compute[75391]:       <cpuselection/>
Nov 15 02:37:45 user nova-compute[75391]:       <deviceboot/>
Nov 15 02:37:45 user nova-compute[75391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     </features>
Nov 15 02:37:45 user nova-compute[75391]:   </guest>
Nov 15 02:37:45 user nova-compute[75391]:   <guest>
Nov 15 02:37:45 user nova-compute[75391]:     <os_type>hvm</os_type>
Nov 15 02:37:45 user nova-compute[75391]:     <arch name='xtensaeb'>
Nov 15 02:37:45 user nova-compute[75391]:       <wordsize>32</wordsize>
Nov 15 02:37:45 user nova-compute[75391]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='4'>sim</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='32'>kc705</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='32'>ml605</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='32'>virt</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='32'>lx200</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='32'>lx60</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 15 02:37:45 user nova-compute[75391]:       <domain type='qemu'/>
Nov 15 02:37:45 user nova-compute[75391]:     </arch>
Nov 15 02:37:45 user nova-compute[75391]:     <features>
Nov 15 02:37:45 user nova-compute[75391]:       <cpuselection/>
Nov 15 02:37:45 user nova-compute[75391]:       <deviceboot/>
Nov 15 02:37:45 user nova-compute[75391]:       <disksnapshot default='on' toggle='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     </features>
Nov 15 02:37:45 user nova-compute[75391]:   </guest>
Nov 15 02:37:45 user nova-compute[75391]: </capabilities>
Nov 15 02:37:45 user nova-compute[75391]: 
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'ubuntu', 'q35'} {{(pid=75391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 15 02:37:45 user nova-compute[75391]: <domainCapabilities>
Nov 15 02:37:45 user nova-compute[75391]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 02:37:45 user nova-compute[75391]:   <domain>kvm</domain>
Nov 15 02:37:45 user nova-compute[75391]:   <machine>pc-q35-jammy</machine>
Nov 15 02:37:45 user nova-compute[75391]:   <arch>i686</arch>
Nov 15 02:37:45 user nova-compute[75391]:   <vcpu max='288'/>
Nov 15 02:37:45 user nova-compute[75391]:   <iothreads supported='yes'/>
Nov 15 02:37:45 user nova-compute[75391]:   <os supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:     <enum name='firmware'/>
Nov 15 02:37:45 user nova-compute[75391]:     <loader supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 02:37:45 user nova-compute[75391]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 02:37:45 user nova-compute[75391]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 02:37:45 user nova-compute[75391]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 02:37:45 user nova-compute[75391]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='type'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>rom</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>pflash</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='readonly'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>yes</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>no</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='secure'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>no</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </loader>
Nov 15 02:37:45 user nova-compute[75391]:   </os>
Nov 15 02:37:45 user nova-compute[75391]:   <cpu>
Nov 15 02:37:45 user nova-compute[75391]:     <mode name='host-passthrough' supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='hostPassthroughMigratable'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>off</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </mode>
Nov 15 02:37:45 user nova-compute[75391]:     <mode name='maximum' supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='maximumMigratable'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>on</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>off</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </mode>
Nov 15 02:37:45 user nova-compute[75391]:     <mode name='host-model' supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <vendor>Intel</vendor>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='ss'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='vmx'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='pcid'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='hypervisor'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='arat'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='umip'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='md-clear'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='stibp'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='ssbd'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='ibpb'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='ibrs'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='amd-stibp'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='disable' name='erms'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='disable' name='lm'/>
Nov 15 02:37:45 user nova-compute[75391]:     </mode>
Nov 15 02:37:45 user nova-compute[75391]:     <mode name='custom' supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>qemu64</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>qemu32</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>phenom</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>pentium3</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>pentium2</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>pentium</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>n270</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>kvm64</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>kvm32</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>coreduo</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>core2duo</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>athlon</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Westmere</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Snowridge</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Server</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Client</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>SandyBridge</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Penryn</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Opteron_G5</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Opteron_G4</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Opteron_G3</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Opteron_G2</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Opteron_G1</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Nehalem</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>IvyBridge</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Icelake-Server</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Haswell</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>EPYC-Rome</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>EPYC-Milan</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>EPYC</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Dhyana</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Cooperlake</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Conroe</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Broadwell</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>486</model>
Nov 15 02:37:45 user nova-compute[75391]:     </mode>
Nov 15 02:37:45 user nova-compute[75391]:   </cpu>
Nov 15 02:37:45 user nova-compute[75391]:   <memoryBacking supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:     <enum name='sourceType'>
Nov 15 02:37:45 user nova-compute[75391]:       <value>file</value>
Nov 15 02:37:45 user nova-compute[75391]:       <value>anonymous</value>
Nov 15 02:37:45 user nova-compute[75391]:       <value>memfd</value>
Nov 15 02:37:45 user nova-compute[75391]:     </enum>
Nov 15 02:37:45 user nova-compute[75391]:   </memoryBacking>
Nov 15 02:37:45 user nova-compute[75391]:   <devices>
Nov 15 02:37:45 user nova-compute[75391]:     <disk supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='diskDevice'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>disk</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>cdrom</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>floppy</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>lun</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='bus'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>fdc</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>scsi</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>usb</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>sata</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='model'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio-transitional</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio-non-transitional</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </disk>
Nov 15 02:37:45 user nova-compute[75391]:     <graphics supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='type'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>sdl</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>vnc</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>spice</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>egl-headless</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </graphics>
Nov 15 02:37:45 user nova-compute[75391]:     <video supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='modelType'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>vga</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>cirrus</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>vmvga</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>qxl</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>none</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>bochs</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>ramfb</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </video>
Nov 15 02:37:45 user nova-compute[75391]:     <hostdev supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='mode'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>subsystem</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='startupPolicy'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>default</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>mandatory</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>requisite</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>optional</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='subsysType'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>usb</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>pci</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>scsi</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='capsType'/>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='pciBackend'/>
Nov 15 02:37:45 user nova-compute[75391]:     </hostdev>
Nov 15 02:37:45 user nova-compute[75391]:     <rng supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='model'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio-transitional</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio-non-transitional</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='backendModel'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>random</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>egd</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>builtin</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </rng>
Nov 15 02:37:45 user nova-compute[75391]:     <filesystem supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='driverType'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>path</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>handle</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtiofs</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </filesystem>
Nov 15 02:37:45 user nova-compute[75391]:     <tpm supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='model'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>tpm-tis</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>tpm-crb</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='backendModel'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>passthrough</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>emulator</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </tpm>
Nov 15 02:37:45 user nova-compute[75391]:   </devices>
Nov 15 02:37:45 user nova-compute[75391]:   <features>
Nov 15 02:37:45 user nova-compute[75391]:     <gic supported='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     <vmcoreinfo supported='yes'/>
Nov 15 02:37:45 user nova-compute[75391]:     <genid supported='yes'/>
Nov 15 02:37:45 user nova-compute[75391]:     <backingStoreInput supported='yes'/>
Nov 15 02:37:45 user nova-compute[75391]:     <backup supported='yes'/>
Nov 15 02:37:45 user nova-compute[75391]:     <sev supported='no'/>
Nov 15 02:37:45 user nova-compute[75391]:   </features>
Nov 15 02:37:45 user nova-compute[75391]: </domainCapabilities>
Nov 15 02:37:45 user nova-compute[75391]:  {{(pid=75391) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 15 02:37:45 user nova-compute[75391]: <domainCapabilities>
Nov 15 02:37:45 user nova-compute[75391]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 02:37:45 user nova-compute[75391]:   <domain>kvm</domain>
Nov 15 02:37:45 user nova-compute[75391]:   <machine>pc-i440fx-6.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:   <arch>i686</arch>
Nov 15 02:37:45 user nova-compute[75391]:   <vcpu max='255'/>
Nov 15 02:37:45 user nova-compute[75391]:   <iothreads supported='yes'/>
Nov 15 02:37:45 user nova-compute[75391]:   <os supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:     <enum name='firmware'/>
Nov 15 02:37:45 user nova-compute[75391]:     <loader supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 02:37:45 user nova-compute[75391]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 02:37:45 user nova-compute[75391]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 02:37:45 user nova-compute[75391]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 02:37:45 user nova-compute[75391]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='type'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>rom</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>pflash</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='readonly'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>yes</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>no</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='secure'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>no</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </loader>
Nov 15 02:37:45 user nova-compute[75391]:   </os>
Nov 15 02:37:45 user nova-compute[75391]:   <cpu>
Nov 15 02:37:45 user nova-compute[75391]:     <mode name='host-passthrough' supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='hostPassthroughMigratable'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>off</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </mode>
Nov 15 02:37:45 user nova-compute[75391]:     <mode name='maximum' supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='maximumMigratable'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>on</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>off</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </mode>
Nov 15 02:37:45 user nova-compute[75391]:     <mode name='host-model' supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <vendor>Intel</vendor>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='ss'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='vmx'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='pcid'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='hypervisor'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='arat'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='umip'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='md-clear'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='stibp'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='ssbd'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='ibpb'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='ibrs'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='amd-stibp'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='disable' name='erms'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='disable' name='lm'/>
Nov 15 02:37:45 user nova-compute[75391]:     </mode>
Nov 15 02:37:45 user nova-compute[75391]:     <mode name='custom' supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>qemu64</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>qemu32</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>phenom</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>pentium3</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>pentium2</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>pentium</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>n270</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>kvm64</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>kvm32</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>coreduo</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>core2duo</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>athlon</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Westmere</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Snowridge</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Server</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Client</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>SandyBridge</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Penryn</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Opteron_G5</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Opteron_G4</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Opteron_G3</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Opteron_G2</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Opteron_G1</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Nehalem</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>IvyBridge</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Icelake-Server</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Haswell</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>EPYC-Rome</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>EPYC-Milan</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>EPYC</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Dhyana</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Cooperlake</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Conroe</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Broadwell</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>486</model>
Nov 15 02:37:45 user nova-compute[75391]:     </mode>
Nov 15 02:37:45 user nova-compute[75391]:   </cpu>
Nov 15 02:37:45 user nova-compute[75391]:   <memoryBacking supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:     <enum name='sourceType'>
Nov 15 02:37:45 user nova-compute[75391]:       <value>file</value>
Nov 15 02:37:45 user nova-compute[75391]:       <value>anonymous</value>
Nov 15 02:37:45 user nova-compute[75391]:       <value>memfd</value>
Nov 15 02:37:45 user nova-compute[75391]:     </enum>
Nov 15 02:37:45 user nova-compute[75391]:   </memoryBacking>
Nov 15 02:37:45 user nova-compute[75391]:   <devices>
Nov 15 02:37:45 user nova-compute[75391]:     <disk supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='diskDevice'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>disk</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>cdrom</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>floppy</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>lun</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='bus'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>ide</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>fdc</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>scsi</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>usb</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>sata</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='model'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio-transitional</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio-non-transitional</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </disk>
Nov 15 02:37:45 user nova-compute[75391]:     <graphics supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='type'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>sdl</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>vnc</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>spice</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>egl-headless</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </graphics>
Nov 15 02:37:45 user nova-compute[75391]:     <video supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='modelType'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>vga</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>cirrus</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>vmvga</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>qxl</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>none</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>bochs</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>ramfb</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </video>
Nov 15 02:37:45 user nova-compute[75391]:     <hostdev supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='mode'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>subsystem</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='startupPolicy'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>default</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>mandatory</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>requisite</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>optional</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='subsysType'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>usb</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>pci</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>scsi</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='capsType'/>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='pciBackend'/>
Nov 15 02:37:45 user nova-compute[75391]:     </hostdev>
Nov 15 02:37:45 user nova-compute[75391]:     <rng supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='model'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio-transitional</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio-non-transitional</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='backendModel'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>random</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>egd</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>builtin</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </rng>
Nov 15 02:37:45 user nova-compute[75391]:     <filesystem supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='driverType'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>path</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>handle</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtiofs</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </filesystem>
Nov 15 02:37:45 user nova-compute[75391]:     <tpm supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='model'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>tpm-tis</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>tpm-crb</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='backendModel'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>passthrough</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>emulator</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </tpm>
Nov 15 02:37:45 user nova-compute[75391]:   </devices>
Nov 15 02:37:45 user nova-compute[75391]:   <features>
Nov 15 02:37:45 user nova-compute[75391]:     <gic supported='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     <vmcoreinfo supported='yes'/>
Nov 15 02:37:45 user nova-compute[75391]:     <genid supported='yes'/>
Nov 15 02:37:45 user nova-compute[75391]:     <backingStoreInput supported='yes'/>
Nov 15 02:37:45 user nova-compute[75391]:     <backup supported='yes'/>
Nov 15 02:37:45 user nova-compute[75391]:     <sev supported='no'/>
Nov 15 02:37:45 user nova-compute[75391]:   </features>
Nov 15 02:37:45 user nova-compute[75391]: </domainCapabilities>
Nov 15 02:37:45 user nova-compute[75391]:  {{(pid=75391) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 15 02:37:45 user nova-compute[75391]: <domainCapabilities>
Nov 15 02:37:45 user nova-compute[75391]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 02:37:45 user nova-compute[75391]:   <domain>kvm</domain>
Nov 15 02:37:45 user nova-compute[75391]:   <machine>pc-i440fx-jammy</machine>
Nov 15 02:37:45 user nova-compute[75391]:   <arch>i686</arch>
Nov 15 02:37:45 user nova-compute[75391]:   <vcpu max='255'/>
Nov 15 02:37:45 user nova-compute[75391]:   <iothreads supported='yes'/>
Nov 15 02:37:45 user nova-compute[75391]:   <os supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:     <enum name='firmware'/>
Nov 15 02:37:45 user nova-compute[75391]:     <loader supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 02:37:45 user nova-compute[75391]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 02:37:45 user nova-compute[75391]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 02:37:45 user nova-compute[75391]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 02:37:45 user nova-compute[75391]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='type'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>rom</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>pflash</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='readonly'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>yes</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>no</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='secure'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>no</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </loader>
Nov 15 02:37:45 user nova-compute[75391]:   </os>
Nov 15 02:37:45 user nova-compute[75391]:   <cpu>
Nov 15 02:37:45 user nova-compute[75391]:     <mode name='host-passthrough' supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='hostPassthroughMigratable'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>off</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </mode>
Nov 15 02:37:45 user nova-compute[75391]:     <mode name='maximum' supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='maximumMigratable'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>on</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>off</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </mode>
Nov 15 02:37:45 user nova-compute[75391]:     <mode name='host-model' supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <vendor>Intel</vendor>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='ss'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='vmx'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='pcid'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='hypervisor'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='arat'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='umip'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='md-clear'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='stibp'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='ssbd'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='ibpb'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='ibrs'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='amd-stibp'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='disable' name='erms'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='disable' name='lm'/>
Nov 15 02:37:45 user nova-compute[75391]:     </mode>
Nov 15 02:37:45 user nova-compute[75391]:     <mode name='custom' supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>qemu64</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>qemu32</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>phenom</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>pentium3</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>pentium2</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>pentium</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>n270</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>kvm64</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>kvm32</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>coreduo</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>core2duo</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>athlon</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Westmere</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Snowridge</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Server</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Client</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>SandyBridge</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Penryn</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Opteron_G5</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Opteron_G4</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Opteron_G3</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Opteron_G2</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Opteron_G1</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Nehalem</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>IvyBridge</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Icelake-Server</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Haswell</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>EPYC-Rome</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>EPYC-Milan</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>EPYC</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Dhyana</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Cooperlake</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Conroe</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Broadwell</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>486</model>
Nov 15 02:37:45 user nova-compute[75391]:     </mode>
Nov 15 02:37:45 user nova-compute[75391]:   </cpu>
Nov 15 02:37:45 user nova-compute[75391]:   <memoryBacking supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:     <enum name='sourceType'>
Nov 15 02:37:45 user nova-compute[75391]:       <value>file</value>
Nov 15 02:37:45 user nova-compute[75391]:       <value>anonymous</value>
Nov 15 02:37:45 user nova-compute[75391]:       <value>memfd</value>
Nov 15 02:37:45 user nova-compute[75391]:     </enum>
Nov 15 02:37:45 user nova-compute[75391]:   </memoryBacking>
Nov 15 02:37:45 user nova-compute[75391]:   <devices>
Nov 15 02:37:45 user nova-compute[75391]:     <disk supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='diskDevice'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>disk</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>cdrom</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>floppy</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>lun</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='bus'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>ide</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>fdc</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>scsi</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>usb</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>sata</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='model'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio-transitional</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio-non-transitional</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </disk>
Nov 15 02:37:45 user nova-compute[75391]:     <graphics supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='type'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>sdl</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>vnc</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>spice</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>egl-headless</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </graphics>
Nov 15 02:37:45 user nova-compute[75391]:     <video supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='modelType'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>vga</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>cirrus</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>vmvga</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>qxl</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>none</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>bochs</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>ramfb</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </video>
Nov 15 02:37:45 user nova-compute[75391]:     <hostdev supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='mode'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>subsystem</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='startupPolicy'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>default</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>mandatory</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>requisite</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>optional</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='subsysType'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>usb</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>pci</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>scsi</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='capsType'/>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='pciBackend'/>
Nov 15 02:37:45 user nova-compute[75391]:     </hostdev>
Nov 15 02:37:45 user nova-compute[75391]:     <rng supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='model'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio-transitional</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio-non-transitional</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='backendModel'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>random</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>egd</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>builtin</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </rng>
Nov 15 02:37:45 user nova-compute[75391]:     <filesystem supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='driverType'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>path</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>handle</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtiofs</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </filesystem>
Nov 15 02:37:45 user nova-compute[75391]:     <tpm supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='model'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>tpm-tis</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>tpm-crb</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='backendModel'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>passthrough</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>emulator</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </tpm>
Nov 15 02:37:45 user nova-compute[75391]:   </devices>
Nov 15 02:37:45 user nova-compute[75391]:   <features>
Nov 15 02:37:45 user nova-compute[75391]:     <gic supported='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     <vmcoreinfo supported='yes'/>
Nov 15 02:37:45 user nova-compute[75391]:     <genid supported='yes'/>
Nov 15 02:37:45 user nova-compute[75391]:     <backingStoreInput supported='yes'/>
Nov 15 02:37:45 user nova-compute[75391]:     <backup supported='yes'/>
Nov 15 02:37:45 user nova-compute[75391]:     <sev supported='no'/>
Nov 15 02:37:45 user nova-compute[75391]:   </features>
Nov 15 02:37:45 user nova-compute[75391]: </domainCapabilities>
Nov 15 02:37:45 user nova-compute[75391]:  {{(pid=75391) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 15 02:37:45 user nova-compute[75391]: <domainCapabilities>
Nov 15 02:37:45 user nova-compute[75391]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 02:37:45 user nova-compute[75391]:   <domain>kvm</domain>
Nov 15 02:37:45 user nova-compute[75391]:   <machine>pc-q35-6.2</machine>
Nov 15 02:37:45 user nova-compute[75391]:   <arch>i686</arch>
Nov 15 02:37:45 user nova-compute[75391]:   <vcpu max='288'/>
Nov 15 02:37:45 user nova-compute[75391]:   <iothreads supported='yes'/>
Nov 15 02:37:45 user nova-compute[75391]:   <os supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:     <enum name='firmware'/>
Nov 15 02:37:45 user nova-compute[75391]:     <loader supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 02:37:45 user nova-compute[75391]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 02:37:45 user nova-compute[75391]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 02:37:45 user nova-compute[75391]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 02:37:45 user nova-compute[75391]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='type'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>rom</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>pflash</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='readonly'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>yes</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>no</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='secure'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>no</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </loader>
Nov 15 02:37:45 user nova-compute[75391]:   </os>
Nov 15 02:37:45 user nova-compute[75391]:   <cpu>
Nov 15 02:37:45 user nova-compute[75391]:     <mode name='host-passthrough' supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='hostPassthroughMigratable'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>off</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </mode>
Nov 15 02:37:45 user nova-compute[75391]:     <mode name='maximum' supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='maximumMigratable'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>on</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>off</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </mode>
Nov 15 02:37:45 user nova-compute[75391]:     <mode name='host-model' supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <vendor>Intel</vendor>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='ss'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='vmx'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='pcid'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='hypervisor'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='arat'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='umip'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='md-clear'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='stibp'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='ssbd'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='ibpb'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='ibrs'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='amd-stibp'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='disable' name='erms'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='disable' name='lm'/>
Nov 15 02:37:45 user nova-compute[75391]:     </mode>
Nov 15 02:37:45 user nova-compute[75391]:     <mode name='custom' supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>qemu64</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>qemu32</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>phenom</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>pentium3</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>pentium2</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>pentium</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>n270</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>kvm64</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>kvm32</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>coreduo</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>core2duo</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>athlon</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Westmere</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Snowridge</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Server</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Client</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>SandyBridge</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Penryn</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Opteron_G5</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Opteron_G4</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Opteron_G3</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Opteron_G2</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Opteron_G1</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Nehalem</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>IvyBridge</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Icelake-Server</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Haswell</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>EPYC-Rome</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>EPYC-Milan</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>EPYC</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Dhyana</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Cooperlake</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Conroe</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Broadwell</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>486</model>
Nov 15 02:37:45 user nova-compute[75391]:     </mode>
Nov 15 02:37:45 user nova-compute[75391]:   </cpu>
Nov 15 02:37:45 user nova-compute[75391]:   <memoryBacking supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:     <enum name='sourceType'>
Nov 15 02:37:45 user nova-compute[75391]:       <value>file</value>
Nov 15 02:37:45 user nova-compute[75391]:       <value>anonymous</value>
Nov 15 02:37:45 user nova-compute[75391]:       <value>memfd</value>
Nov 15 02:37:45 user nova-compute[75391]:     </enum>
Nov 15 02:37:45 user nova-compute[75391]:   </memoryBacking>
Nov 15 02:37:45 user nova-compute[75391]:   <devices>
Nov 15 02:37:45 user nova-compute[75391]:     <disk supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='diskDevice'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>disk</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>cdrom</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>floppy</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>lun</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='bus'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>fdc</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>scsi</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>usb</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>sata</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='model'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio-transitional</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio-non-transitional</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </disk>
Nov 15 02:37:45 user nova-compute[75391]:     <graphics supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='type'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>sdl</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>vnc</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>spice</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>egl-headless</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </graphics>
Nov 15 02:37:45 user nova-compute[75391]:     <video supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='modelType'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>vga</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>cirrus</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>vmvga</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>qxl</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>none</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>bochs</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>ramfb</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </video>
Nov 15 02:37:45 user nova-compute[75391]:     <hostdev supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='mode'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>subsystem</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='startupPolicy'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>default</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>mandatory</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>requisite</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>optional</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='subsysType'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>usb</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>pci</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>scsi</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='capsType'/>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='pciBackend'/>
Nov 15 02:37:45 user nova-compute[75391]:     </hostdev>
Nov 15 02:37:45 user nova-compute[75391]:     <rng supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='model'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio-transitional</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio-non-transitional</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='backendModel'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>random</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>egd</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>builtin</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </rng>
Nov 15 02:37:45 user nova-compute[75391]:     <filesystem supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='driverType'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>path</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>handle</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtiofs</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </filesystem>
Nov 15 02:37:45 user nova-compute[75391]:     <tpm supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='model'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>tpm-tis</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>tpm-crb</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='backendModel'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>passthrough</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>emulator</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </tpm>
Nov 15 02:37:45 user nova-compute[75391]:   </devices>
Nov 15 02:37:45 user nova-compute[75391]:   <features>
Nov 15 02:37:45 user nova-compute[75391]:     <gic supported='no'/>
Nov 15 02:37:45 user nova-compute[75391]:     <vmcoreinfo supported='yes'/>
Nov 15 02:37:45 user nova-compute[75391]:     <genid supported='yes'/>
Nov 15 02:37:45 user nova-compute[75391]:     <backingStoreInput supported='yes'/>
Nov 15 02:37:45 user nova-compute[75391]:     <backup supported='yes'/>
Nov 15 02:37:45 user nova-compute[75391]:     <sev supported='no'/>
Nov 15 02:37:45 user nova-compute[75391]:   </features>
Nov 15 02:37:45 user nova-compute[75391]: </domainCapabilities>
Nov 15 02:37:45 user nova-compute[75391]:  {{(pid=75391) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=75391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'ubuntu', 'q35'} {{(pid=75391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 02:37:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 15 02:37:45 user nova-compute[75391]: <domainCapabilities>
Nov 15 02:37:45 user nova-compute[75391]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 02:37:45 user nova-compute[75391]:   <domain>kvm</domain>
Nov 15 02:37:45 user nova-compute[75391]:   <machine>pc-q35-jammy</machine>
Nov 15 02:37:45 user nova-compute[75391]:   <arch>x86_64</arch>
Nov 15 02:37:45 user nova-compute[75391]:   <vcpu max='288'/>
Nov 15 02:37:45 user nova-compute[75391]:   <iothreads supported='yes'/>
Nov 15 02:37:45 user nova-compute[75391]:   <os supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:     <enum name='firmware'>
Nov 15 02:37:45 user nova-compute[75391]:       <value>efi</value>
Nov 15 02:37:45 user nova-compute[75391]:     </enum>
Nov 15 02:37:45 user nova-compute[75391]:     <loader supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 15 02:37:45 user nova-compute[75391]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 15 02:37:45 user nova-compute[75391]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='type'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>rom</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>pflash</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='readonly'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>yes</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>no</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='secure'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>yes</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>no</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </loader>
Nov 15 02:37:45 user nova-compute[75391]:   </os>
Nov 15 02:37:45 user nova-compute[75391]:   <cpu>
Nov 15 02:37:45 user nova-compute[75391]:     <mode name='host-passthrough' supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='hostPassthroughMigratable'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>on</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>off</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </mode>
Nov 15 02:37:45 user nova-compute[75391]:     <mode name='maximum' supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='maximumMigratable'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>on</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>off</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </mode>
Nov 15 02:37:45 user nova-compute[75391]:     <mode name='host-model' supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <vendor>Intel</vendor>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='ss'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='vmx'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='pcid'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='hypervisor'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='arat'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='umip'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='md-clear'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='stibp'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='ssbd'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='invtsc'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='ibpb'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='ibrs'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='amd-stibp'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='rsba'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='disable' name='erms'/>
Nov 15 02:37:45 user nova-compute[75391]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 02:37:45 user nova-compute[75391]:     </mode>
Nov 15 02:37:45 user nova-compute[75391]:     <mode name='custom' supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>qemu64</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>qemu32</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>phenom</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>pentium3</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>pentium2</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>pentium</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>n270</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>kvm64</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>kvm32</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>coreduo</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>core2duo</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>athlon</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>Westmere</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Snowridge</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Server</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Skylake-Client</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>SandyBridge</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>Penryn</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Opteron_G5</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Opteron_G4</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Opteron_G3</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Opteron_G2</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>Opteron_G1</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>Nehalem</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>IvyBridge</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Icelake-Server</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Haswell</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>EPYC-Rome</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>EPYC-Milan</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>EPYC</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Dhyana</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Cooperlake</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>Conroe</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='no'>Broadwell</model>
Nov 15 02:37:45 user nova-compute[75391]:       <model usable='yes'>486</model>
Nov 15 02:37:45 user nova-compute[75391]:     </mode>
Nov 15 02:37:45 user nova-compute[75391]:   </cpu>
Nov 15 02:37:45 user nova-compute[75391]:   <memoryBacking supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:     <enum name='sourceType'>
Nov 15 02:37:45 user nova-compute[75391]:       <value>file</value>
Nov 15 02:37:45 user nova-compute[75391]:       <value>anonymous</value>
Nov 15 02:37:45 user nova-compute[75391]:       <value>memfd</value>
Nov 15 02:37:45 user nova-compute[75391]:     </enum>
Nov 15 02:37:45 user nova-compute[75391]:   </memoryBacking>
Nov 15 02:37:45 user nova-compute[75391]:   <devices>
Nov 15 02:37:45 user nova-compute[75391]:     <disk supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='diskDevice'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>disk</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>cdrom</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>floppy</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>lun</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='bus'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>fdc</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>scsi</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>usb</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>sata</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='model'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio-transitional</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio-non-transitional</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </disk>
Nov 15 02:37:45 user nova-compute[75391]:     <graphics supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='type'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>sdl</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>vnc</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>spice</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>egl-headless</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </graphics>
Nov 15 02:37:45 user nova-compute[75391]:     <video supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='modelType'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>vga</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>cirrus</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>vmvga</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>qxl</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>none</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>bochs</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>ramfb</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </video>
Nov 15 02:37:45 user nova-compute[75391]:     <hostdev supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='mode'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>subsystem</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='startupPolicy'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>default</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>mandatory</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>requisite</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>optional</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='subsysType'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>usb</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>pci</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>scsi</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='capsType'/>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='pciBackend'/>
Nov 15 02:37:45 user nova-compute[75391]:     </hostdev>
Nov 15 02:37:45 user nova-compute[75391]:     <rng supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='model'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio-transitional</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtio-non-transitional</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='backendModel'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>random</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>egd</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>builtin</value>
Nov 15 02:37:45 user nova-compute[75391]:       </enum>
Nov 15 02:37:45 user nova-compute[75391]:     </rng>
Nov 15 02:37:45 user nova-compute[75391]:     <filesystem supported='yes'>
Nov 15 02:37:45 user nova-compute[75391]:       <enum name='driverType'>
Nov 15 02:37:45 user nova-compute[75391]:         <value>path</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>handle</value>
Nov 15 02:37:45 user nova-compute[75391]:         <value>virtiofs</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </filesystem>
Nov 15 02:37:46 user nova-compute[75391]:     <tpm supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='model'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>tpm-tis</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>tpm-crb</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='backendModel'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>passthrough</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>emulator</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </tpm>
Nov 15 02:37:46 user nova-compute[75391]:   </devices>
Nov 15 02:37:46 user nova-compute[75391]:   <features>
Nov 15 02:37:46 user nova-compute[75391]:     <gic supported='no'/>
Nov 15 02:37:46 user nova-compute[75391]:     <vmcoreinfo supported='yes'/>
Nov 15 02:37:46 user nova-compute[75391]:     <genid supported='yes'/>
Nov 15 02:37:46 user nova-compute[75391]:     <backingStoreInput supported='yes'/>
Nov 15 02:37:46 user nova-compute[75391]:     <backup supported='yes'/>
Nov 15 02:37:46 user nova-compute[75391]:     <sev supported='no'/>
Nov 15 02:37:46 user nova-compute[75391]:   </features>
Nov 15 02:37:46 user nova-compute[75391]: </domainCapabilities>
Nov 15 02:37:46 user nova-compute[75391]:  {{(pid=75391) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 02:37:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 15 02:37:46 user nova-compute[75391]: <domainCapabilities>
Nov 15 02:37:46 user nova-compute[75391]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 02:37:46 user nova-compute[75391]:   <domain>kvm</domain>
Nov 15 02:37:46 user nova-compute[75391]:   <machine>pc-i440fx-6.2</machine>
Nov 15 02:37:46 user nova-compute[75391]:   <arch>x86_64</arch>
Nov 15 02:37:46 user nova-compute[75391]:   <vcpu max='255'/>
Nov 15 02:37:46 user nova-compute[75391]:   <iothreads supported='yes'/>
Nov 15 02:37:46 user nova-compute[75391]:   <os supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:     <enum name='firmware'>
Nov 15 02:37:46 user nova-compute[75391]:       <value>efi</value>
Nov 15 02:37:46 user nova-compute[75391]:     </enum>
Nov 15 02:37:46 user nova-compute[75391]:     <loader supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='type'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>rom</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>pflash</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='readonly'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>yes</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>no</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='secure'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>no</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </loader>
Nov 15 02:37:46 user nova-compute[75391]:   </os>
Nov 15 02:37:46 user nova-compute[75391]:   <cpu>
Nov 15 02:37:46 user nova-compute[75391]:     <mode name='host-passthrough' supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='hostPassthroughMigratable'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>on</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>off</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </mode>
Nov 15 02:37:46 user nova-compute[75391]:     <mode name='maximum' supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='maximumMigratable'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>on</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>off</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </mode>
Nov 15 02:37:46 user nova-compute[75391]:     <mode name='host-model' supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <vendor>Intel</vendor>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='ss'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='vmx'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='pcid'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='hypervisor'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='arat'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='umip'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='md-clear'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='stibp'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='ssbd'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='invtsc'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='ibpb'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='ibrs'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='amd-stibp'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='rsba'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='disable' name='erms'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 02:37:46 user nova-compute[75391]:     </mode>
Nov 15 02:37:46 user nova-compute[75391]:     <mode name='custom' supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>qemu64</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>qemu32</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>phenom</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>pentium3</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>pentium2</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>pentium</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>n270</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>kvm64</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>kvm32</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>coreduo</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>core2duo</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>athlon</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>Westmere</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Snowridge</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Skylake-Server</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Skylake-Client</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>SandyBridge</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>Penryn</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Opteron_G5</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Opteron_G4</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Opteron_G3</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Opteron_G2</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>Opteron_G1</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>Nehalem</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>IvyBridge</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Icelake-Server</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Haswell</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>EPYC-Rome</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>EPYC-Milan</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>EPYC</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Dhyana</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Cooperlake</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>Conroe</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Broadwell</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>486</model>
Nov 15 02:37:46 user nova-compute[75391]:     </mode>
Nov 15 02:37:46 user nova-compute[75391]:   </cpu>
Nov 15 02:37:46 user nova-compute[75391]:   <memoryBacking supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:     <enum name='sourceType'>
Nov 15 02:37:46 user nova-compute[75391]:       <value>file</value>
Nov 15 02:37:46 user nova-compute[75391]:       <value>anonymous</value>
Nov 15 02:37:46 user nova-compute[75391]:       <value>memfd</value>
Nov 15 02:37:46 user nova-compute[75391]:     </enum>
Nov 15 02:37:46 user nova-compute[75391]:   </memoryBacking>
Nov 15 02:37:46 user nova-compute[75391]:   <devices>
Nov 15 02:37:46 user nova-compute[75391]:     <disk supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='diskDevice'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>disk</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>cdrom</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>floppy</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>lun</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='bus'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>ide</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>fdc</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>scsi</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>usb</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>sata</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='model'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>virtio-transitional</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>virtio-non-transitional</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </disk>
Nov 15 02:37:46 user nova-compute[75391]:     <graphics supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='type'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>sdl</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>vnc</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>spice</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>egl-headless</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </graphics>
Nov 15 02:37:46 user nova-compute[75391]:     <video supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='modelType'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>vga</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>cirrus</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>vmvga</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>qxl</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>none</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>bochs</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>ramfb</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </video>
Nov 15 02:37:46 user nova-compute[75391]:     <hostdev supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='mode'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>subsystem</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='startupPolicy'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>default</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>mandatory</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>requisite</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>optional</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='subsysType'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>usb</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>pci</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>scsi</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='capsType'/>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='pciBackend'/>
Nov 15 02:37:46 user nova-compute[75391]:     </hostdev>
Nov 15 02:37:46 user nova-compute[75391]:     <rng supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='model'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>virtio-transitional</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>virtio-non-transitional</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='backendModel'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>random</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>egd</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>builtin</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </rng>
Nov 15 02:37:46 user nova-compute[75391]:     <filesystem supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='driverType'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>path</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>handle</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>virtiofs</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </filesystem>
Nov 15 02:37:46 user nova-compute[75391]:     <tpm supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='model'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>tpm-tis</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>tpm-crb</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='backendModel'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>passthrough</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>emulator</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </tpm>
Nov 15 02:37:46 user nova-compute[75391]:   </devices>
Nov 15 02:37:46 user nova-compute[75391]:   <features>
Nov 15 02:37:46 user nova-compute[75391]:     <gic supported='no'/>
Nov 15 02:37:46 user nova-compute[75391]:     <vmcoreinfo supported='yes'/>
Nov 15 02:37:46 user nova-compute[75391]:     <genid supported='yes'/>
Nov 15 02:37:46 user nova-compute[75391]:     <backingStoreInput supported='yes'/>
Nov 15 02:37:46 user nova-compute[75391]:     <backup supported='yes'/>
Nov 15 02:37:46 user nova-compute[75391]:     <sev supported='no'/>
Nov 15 02:37:46 user nova-compute[75391]:   </features>
Nov 15 02:37:46 user nova-compute[75391]: </domainCapabilities>
Nov 15 02:37:46 user nova-compute[75391]:  {{(pid=75391) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 02:37:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 15 02:37:46 user nova-compute[75391]: <domainCapabilities>
Nov 15 02:37:46 user nova-compute[75391]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 02:37:46 user nova-compute[75391]:   <domain>kvm</domain>
Nov 15 02:37:46 user nova-compute[75391]:   <machine>pc-i440fx-jammy</machine>
Nov 15 02:37:46 user nova-compute[75391]:   <arch>x86_64</arch>
Nov 15 02:37:46 user nova-compute[75391]:   <vcpu max='255'/>
Nov 15 02:37:46 user nova-compute[75391]:   <iothreads supported='yes'/>
Nov 15 02:37:46 user nova-compute[75391]:   <os supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:     <enum name='firmware'>
Nov 15 02:37:46 user nova-compute[75391]:       <value>efi</value>
Nov 15 02:37:46 user nova-compute[75391]:     </enum>
Nov 15 02:37:46 user nova-compute[75391]:     <loader supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='type'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>rom</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>pflash</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='readonly'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>yes</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>no</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='secure'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>no</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </loader>
Nov 15 02:37:46 user nova-compute[75391]:   </os>
Nov 15 02:37:46 user nova-compute[75391]:   <cpu>
Nov 15 02:37:46 user nova-compute[75391]:     <mode name='host-passthrough' supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='hostPassthroughMigratable'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>on</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>off</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </mode>
Nov 15 02:37:46 user nova-compute[75391]:     <mode name='maximum' supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='maximumMigratable'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>on</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>off</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </mode>
Nov 15 02:37:46 user nova-compute[75391]:     <mode name='host-model' supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <vendor>Intel</vendor>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='ss'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='vmx'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='pcid'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='hypervisor'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='arat'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='umip'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='md-clear'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='stibp'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='ssbd'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='invtsc'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='ibpb'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='ibrs'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='amd-stibp'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='rsba'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='disable' name='erms'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 02:37:46 user nova-compute[75391]:     </mode>
Nov 15 02:37:46 user nova-compute[75391]:     <mode name='custom' supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>qemu64</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>qemu32</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>phenom</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>pentium3</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>pentium2</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>pentium</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>n270</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>kvm64</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>kvm32</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>coreduo</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>core2duo</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>athlon</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>Westmere</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Snowridge</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Skylake-Server</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Skylake-Client</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>SandyBridge</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>Penryn</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Opteron_G5</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Opteron_G4</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Opteron_G3</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Opteron_G2</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>Opteron_G1</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>Nehalem</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>IvyBridge</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Icelake-Server</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Haswell</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>EPYC-Rome</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>EPYC-Milan</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>EPYC</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Dhyana</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Cooperlake</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>Conroe</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Broadwell</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>486</model>
Nov 15 02:37:46 user nova-compute[75391]:     </mode>
Nov 15 02:37:46 user nova-compute[75391]:   </cpu>
Nov 15 02:37:46 user nova-compute[75391]:   <memoryBacking supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:     <enum name='sourceType'>
Nov 15 02:37:46 user nova-compute[75391]:       <value>file</value>
Nov 15 02:37:46 user nova-compute[75391]:       <value>anonymous</value>
Nov 15 02:37:46 user nova-compute[75391]:       <value>memfd</value>
Nov 15 02:37:46 user nova-compute[75391]:     </enum>
Nov 15 02:37:46 user nova-compute[75391]:   </memoryBacking>
Nov 15 02:37:46 user nova-compute[75391]:   <devices>
Nov 15 02:37:46 user nova-compute[75391]:     <disk supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='diskDevice'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>disk</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>cdrom</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>floppy</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>lun</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='bus'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>ide</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>fdc</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>scsi</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>usb</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>sata</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='model'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>virtio-transitional</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>virtio-non-transitional</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </disk>
Nov 15 02:37:46 user nova-compute[75391]:     <graphics supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='type'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>sdl</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>vnc</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>spice</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>egl-headless</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </graphics>
Nov 15 02:37:46 user nova-compute[75391]:     <video supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='modelType'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>vga</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>cirrus</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>vmvga</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>qxl</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>none</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>bochs</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>ramfb</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </video>
Nov 15 02:37:46 user nova-compute[75391]:     <hostdev supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='mode'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>subsystem</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='startupPolicy'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>default</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>mandatory</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>requisite</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>optional</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='subsysType'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>usb</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>pci</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>scsi</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='capsType'/>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='pciBackend'/>
Nov 15 02:37:46 user nova-compute[75391]:     </hostdev>
Nov 15 02:37:46 user nova-compute[75391]:     <rng supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='model'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>virtio-transitional</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>virtio-non-transitional</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='backendModel'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>random</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>egd</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>builtin</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </rng>
Nov 15 02:37:46 user nova-compute[75391]:     <filesystem supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='driverType'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>path</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>handle</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>virtiofs</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </filesystem>
Nov 15 02:37:46 user nova-compute[75391]:     <tpm supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='model'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>tpm-tis</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>tpm-crb</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='backendModel'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>passthrough</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>emulator</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </tpm>
Nov 15 02:37:46 user nova-compute[75391]:   </devices>
Nov 15 02:37:46 user nova-compute[75391]:   <features>
Nov 15 02:37:46 user nova-compute[75391]:     <gic supported='no'/>
Nov 15 02:37:46 user nova-compute[75391]:     <vmcoreinfo supported='yes'/>
Nov 15 02:37:46 user nova-compute[75391]:     <genid supported='yes'/>
Nov 15 02:37:46 user nova-compute[75391]:     <backingStoreInput supported='yes'/>
Nov 15 02:37:46 user nova-compute[75391]:     <backup supported='yes'/>
Nov 15 02:37:46 user nova-compute[75391]:     <sev supported='no'/>
Nov 15 02:37:46 user nova-compute[75391]:   </features>
Nov 15 02:37:46 user nova-compute[75391]: </domainCapabilities>
Nov 15 02:37:46 user nova-compute[75391]:  {{(pid=75391) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 02:37:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 15 02:37:46 user nova-compute[75391]: <domainCapabilities>
Nov 15 02:37:46 user nova-compute[75391]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 02:37:46 user nova-compute[75391]:   <domain>kvm</domain>
Nov 15 02:37:46 user nova-compute[75391]:   <machine>pc-q35-6.2</machine>
Nov 15 02:37:46 user nova-compute[75391]:   <arch>x86_64</arch>
Nov 15 02:37:46 user nova-compute[75391]:   <vcpu max='288'/>
Nov 15 02:37:46 user nova-compute[75391]:   <iothreads supported='yes'/>
Nov 15 02:37:46 user nova-compute[75391]:   <os supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:     <enum name='firmware'>
Nov 15 02:37:46 user nova-compute[75391]:       <value>efi</value>
Nov 15 02:37:46 user nova-compute[75391]:     </enum>
Nov 15 02:37:46 user nova-compute[75391]:     <loader supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 15 02:37:46 user nova-compute[75391]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 15 02:37:46 user nova-compute[75391]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='type'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>rom</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>pflash</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='readonly'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>yes</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>no</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='secure'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>yes</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>no</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </loader>
Nov 15 02:37:46 user nova-compute[75391]:   </os>
Nov 15 02:37:46 user nova-compute[75391]:   <cpu>
Nov 15 02:37:46 user nova-compute[75391]:     <mode name='host-passthrough' supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='hostPassthroughMigratable'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>on</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>off</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </mode>
Nov 15 02:37:46 user nova-compute[75391]:     <mode name='maximum' supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='maximumMigratable'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>on</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>off</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </mode>
Nov 15 02:37:46 user nova-compute[75391]:     <mode name='host-model' supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <vendor>Intel</vendor>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='ss'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='vmx'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='pcid'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='hypervisor'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='arat'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='umip'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='md-clear'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='stibp'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='ssbd'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='invtsc'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='ibpb'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='ibrs'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='amd-stibp'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='rsba'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='disable' name='erms'/>
Nov 15 02:37:46 user nova-compute[75391]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 02:37:46 user nova-compute[75391]:     </mode>
Nov 15 02:37:46 user nova-compute[75391]:     <mode name='custom' supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>qemu64</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>qemu32</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>phenom</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>pentium3</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>pentium2</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>pentium</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>n270</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>kvm64</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>kvm32</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>coreduo</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>core2duo</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>athlon</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>Westmere</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Snowridge</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Skylake-Server</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Skylake-Client</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>SandyBridge</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>Penryn</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Opteron_G5</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Opteron_G4</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Opteron_G3</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Opteron_G2</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>Opteron_G1</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>Nehalem</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>IvyBridge</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Icelake-Server</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Haswell</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>EPYC-Rome</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>EPYC-Milan</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>EPYC</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Dhyana</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Cooperlake</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>Conroe</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='no'>Broadwell</model>
Nov 15 02:37:46 user nova-compute[75391]:       <model usable='yes'>486</model>
Nov 15 02:37:46 user nova-compute[75391]:     </mode>
Nov 15 02:37:46 user nova-compute[75391]:   </cpu>
Nov 15 02:37:46 user nova-compute[75391]:   <memoryBacking supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:     <enum name='sourceType'>
Nov 15 02:37:46 user nova-compute[75391]:       <value>file</value>
Nov 15 02:37:46 user nova-compute[75391]:       <value>anonymous</value>
Nov 15 02:37:46 user nova-compute[75391]:       <value>memfd</value>
Nov 15 02:37:46 user nova-compute[75391]:     </enum>
Nov 15 02:37:46 user nova-compute[75391]:   </memoryBacking>
Nov 15 02:37:46 user nova-compute[75391]:   <devices>
Nov 15 02:37:46 user nova-compute[75391]:     <disk supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='diskDevice'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>disk</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>cdrom</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>floppy</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>lun</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='bus'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>fdc</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>scsi</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>usb</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>sata</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='model'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>virtio-transitional</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>virtio-non-transitional</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </disk>
Nov 15 02:37:46 user nova-compute[75391]:     <graphics supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='type'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>sdl</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>vnc</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>spice</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>egl-headless</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </graphics>
Nov 15 02:37:46 user nova-compute[75391]:     <video supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='modelType'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>vga</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>cirrus</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>vmvga</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>qxl</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>none</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>bochs</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>ramfb</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </video>
Nov 15 02:37:46 user nova-compute[75391]:     <hostdev supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='mode'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>subsystem</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='startupPolicy'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>default</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>mandatory</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>requisite</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>optional</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='subsysType'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>usb</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>pci</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>scsi</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='capsType'/>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='pciBackend'/>
Nov 15 02:37:46 user nova-compute[75391]:     </hostdev>
Nov 15 02:37:46 user nova-compute[75391]:     <rng supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='model'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>virtio</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>virtio-transitional</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>virtio-non-transitional</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='backendModel'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>random</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>egd</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>builtin</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </rng>
Nov 15 02:37:46 user nova-compute[75391]:     <filesystem supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='driverType'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>path</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>handle</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>virtiofs</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </filesystem>
Nov 15 02:37:46 user nova-compute[75391]:     <tpm supported='yes'>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='model'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>tpm-tis</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>tpm-crb</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:       <enum name='backendModel'>
Nov 15 02:37:46 user nova-compute[75391]:         <value>passthrough</value>
Nov 15 02:37:46 user nova-compute[75391]:         <value>emulator</value>
Nov 15 02:37:46 user nova-compute[75391]:       </enum>
Nov 15 02:37:46 user nova-compute[75391]:     </tpm>
Nov 15 02:37:46 user nova-compute[75391]:   </devices>
Nov 15 02:37:46 user nova-compute[75391]:   <features>
Nov 15 02:37:46 user nova-compute[75391]:     <gic supported='no'/>
Nov 15 02:37:46 user nova-compute[75391]:     <vmcoreinfo supported='yes'/>
Nov 15 02:37:46 user nova-compute[75391]:     <genid supported='yes'/>
Nov 15 02:37:46 user nova-compute[75391]:     <backingStoreInput supported='yes'/>
Nov 15 02:37:46 user nova-compute[75391]:     <backup supported='yes'/>
Nov 15 02:37:46 user nova-compute[75391]:     <sev supported='no'/>
Nov 15 02:37:46 user nova-compute[75391]:   </features>
Nov 15 02:37:46 user nova-compute[75391]: </domainCapabilities>
Nov 15 02:37:46 user nova-compute[75391]:  {{(pid=75391) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 02:37:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 02:37:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 02:37:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 02:37:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Checking secure boot support for host arch (x86_64) {{(pid=75391) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 02:37:46 user nova-compute[75391]: INFO nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Secure Boot support detected
Nov 15 02:37:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] cpu compare xml: <cpu match="exact">
Nov 15 02:37:46 user nova-compute[75391]:   <model>Nehalem</model>
Nov 15 02:37:46 user nova-compute[75391]: </cpu>
Nov 15 02:37:46 user nova-compute[75391]:  {{(pid=75391) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 15 02:37:46 user nova-compute[75391]: INFO nova.virt.node [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Generated node identity fa8a32f4-c234-4e10-a8fe-db43b3c4c62e
Nov 15 02:37:46 user nova-compute[75391]: INFO nova.virt.node [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Wrote node identity fa8a32f4-c234-4e10-a8fe-db43b3c4c62e to /opt/stack/data/nova/compute_id
Nov 15 02:37:46 user nova-compute[75391]: WARNING nova.compute.manager [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Compute nodes ['fa8a32f4-c234-4e10-a8fe-db43b3c4c62e'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 15 02:37:46 user nova-compute[75391]: INFO nova.compute.manager [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 15 02:37:46 user nova-compute[75391]: WARNING nova.compute.manager [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 15 02:37:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:37:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:37:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:37:46 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:37:46 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:37:46 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:37:46 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Hypervisor/Node resource view: name=user free_ram=10942MB free_disk=26.084991455078125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:37:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:37:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:37:46 user nova-compute[75391]: WARNING nova.compute.resource_tracker [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] No compute node record for user:fa8a32f4-c234-4e10-a8fe-db43b3c4c62e: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host fa8a32f4-c234-4e10-a8fe-db43b3c4c62e could not be found.
Nov 15 02:37:46 user nova-compute[75391]: INFO nova.compute.resource_tracker [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Compute node record created for user:user with uuid: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e
Nov 15 02:37:46 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:37:46 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:37:46 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] [req-c907d52f-5013-4f2c-871a-3640f5945c67] Created resource provider record via placement API for resource provider with UUID fa8a32f4-c234-4e10-a8fe-db43b3c4c62e and name user.
Nov 15 02:37:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75391) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 15 02:37:46 user nova-compute[75391]: INFO nova.virt.libvirt.host [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] kernel doesn't support AMD SEV
Nov 15 02:37:46 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Updating inventory in ProviderTree for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 02:37:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:37:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Libvirt baseline CPU <cpu>
Nov 15 02:37:46 user nova-compute[75391]:   <arch>x86_64</arch>
Nov 15 02:37:46 user nova-compute[75391]:   <model>Nehalem</model>
Nov 15 02:37:46 user nova-compute[75391]:   <vendor>Intel</vendor>
Nov 15 02:37:46 user nova-compute[75391]:   <topology sockets="6" cores="1" threads="1"/>
Nov 15 02:37:46 user nova-compute[75391]: </cpu>
Nov 15 02:37:46 user nova-compute[75391]:  {{(pid=75391) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 15 02:37:46 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Updated inventory for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 15 02:37:46 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Updating resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e generation from 0 to 1 during operation: update_inventory {{(pid=75391) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 15 02:37:46 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Updating inventory in ProviderTree for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 02:37:46 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Updating resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e generation from 1 to 2 during operation: update_traits {{(pid=75391) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 15 02:37:46 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:37:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.616s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:37:46 user nova-compute[75391]: DEBUG nova.service [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Creating RPC server for service compute {{(pid=75391) start /opt/stack/nova/nova/service.py:182}}
Nov 15 02:37:46 user nova-compute[75391]: DEBUG nova.service [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] Join ServiceGroup membership for this service compute {{(pid=75391) start /opt/stack/nova/nova/service.py:199}}
Nov 15 02:37:46 user nova-compute[75391]: DEBUG nova.servicegroup.drivers.db [None req-6e1031a9-3347-40cd-9519-c5e4d9ef6cbd None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75391) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 15 02:38:46 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:38:46 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:38:46 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:38:46 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 02:38:46 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Didn't find any instances for network info cache update. {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 02:38:46 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:38:46 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:38:46 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:38:46 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:38:46 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:38:46 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_power_states {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:38:47 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:38:47 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:38:47 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:38:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:38:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:38:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:38:47 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:38:47 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:38:47 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:38:47 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=10349MB free_disk=25.988693237304688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:38:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:38:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:38:47 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:38:47 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:38:47 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:38:47 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:38:47 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:38:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:38:47 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:39:38 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:39:38 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:39:38 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:39:38 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 02:39:38 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Didn't find any instances for network info cache update. {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 02:39:38 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:39:38 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:39:38 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:39:38 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:39:38 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:39:38 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:39:38 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:39:39 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:39:39 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:39:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:39:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:39:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:39:39 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:39:40 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:39:40 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:39:40 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=10317MB free_disk=26.041973114013672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:39:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:39:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:39:40 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:39:40 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:39:40 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:39:40 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:39:40 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:39:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:40:38 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:40:38 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:40:38 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 02:40:38 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Didn't find any instances for network info cache update. {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 02:40:38 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:40:38 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:40:38 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:40:38 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:40:39 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:40:39 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:40:39 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:40:40 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:40:41 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:40:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:40:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:40:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:40:41 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:40:41 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:40:41 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:40:41 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=10276MB free_disk=25.805416107177734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:40:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:40:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:40:42 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:40:42 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:40:42 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:40:42 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:40:42 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:40:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.112s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:41:38 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:41:38 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:41:38 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 02:41:38 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Didn't find any instances for network info cache update. {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 02:41:39 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:41:39 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:41:39 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:41:39 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:41:40 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:41:40 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:41:40 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:41:40 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:41:42 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:41:42 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:41:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:41:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:41:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:41:42 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:41:43 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:41:43 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:41:43 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=9607MB free_disk=25.824539184570312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:41:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:41:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:41:43 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:41:43 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:41:43 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:41:43 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:41:43 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:41:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.128s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:41:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "9744c8a1-046e-4a00-92e0-92ebb3275ea9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:41:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "9744c8a1-046e-4a00-92e0-92ebb3275ea9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:41:47 user nova-compute[75391]: DEBUG nova.compute.manager [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:41:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:41:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:41:48 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:41:48 user nova-compute[75391]: INFO nova.compute.claims [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Claim successful on node user
Nov 15 02:41:48 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:41:48 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:41:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.583s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:41:48 user nova-compute[75391]: DEBUG nova.compute.manager [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:41:48 user nova-compute[75391]: DEBUG nova.compute.manager [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:41:48 user nova-compute[75391]: DEBUG nova.network.neutron [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:41:48 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:41:48 user nova-compute[75391]: DEBUG nova.compute.manager [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:41:49 user nova-compute[75391]: DEBUG nova.compute.manager [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:41:49 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:41:49 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Creating image(s)
Nov 15 02:41:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "/opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:41:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "/opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:41:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "/opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:41:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:41:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:41:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a.part --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:41:49 user nova-compute[75391]: DEBUG nova.policy [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0aa106a59c374dde99b7697f94407339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63a88a9fe824c3e9c0807a50b569d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:41:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a.part --force-share --output=json" returned: 0 in 0.179s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:41:49 user nova-compute[75391]: DEBUG nova.virt.images [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] f31cb507-389e-424c-b4dc-02c610b0b558 was qcow2, converting to raw {{(pid=75391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 02:41:49 user nova-compute[75391]: DEBUG nova.privsep.utils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 02:41:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a.part /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a.converted {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:41:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a.part /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a.converted" returned: 0 in 0.439s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:41:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a.converted --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:41:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a.converted --force-share --output=json" returned: 0 in 0.203s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:41:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.078s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:41:50 user nova-compute[75391]: INFO oslo.privsep.daemon [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp9w6dcr34/privsep.sock']
Nov 15 02:41:50 user sudo[84676]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp9w6dcr34/privsep.sock
Nov 15 02:41:50 user sudo[84676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 02:41:51 user sudo[84676]: pam_unix(sudo:session): session closed for user root
Nov 15 02:41:51 user nova-compute[75391]: INFO oslo.privsep.daemon [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Spawned new privsep daemon via rootwrap
Nov 15 02:41:51 user nova-compute[75391]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 02:41:51 user nova-compute[75391]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 02:41:51 user nova-compute[75391]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 15 02:41:51 user nova-compute[75391]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84681
Nov 15 02:41:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:41:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.185s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:41:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:41:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:41:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:41:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.186s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:41:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:41:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk 1073741824" returned: 0 in 0.037s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:41:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:41:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:41:52 user nova-compute[75391]: DEBUG nova.network.neutron [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Successfully created port: dc4f904f-dd76-4f25-b9e6-41cc42493911 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:41:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.163s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:41:52 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:41:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:41:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:41:52 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Cannot resize image /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:41:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:41:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Ensure instance console log exists: /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:41:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:41:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:41:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:41:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:41:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:41:53 user nova-compute[75391]: DEBUG nova.compute.manager [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:41:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:41:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:41:53 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:41:53 user nova-compute[75391]: INFO nova.compute.claims [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Claim successful on node user
Nov 15 02:41:53 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG nova.compute.manager [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG nova.compute.manager [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG nova.network.neutron [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:41:54 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:41:54 user nova-compute[75391]: DEBUG nova.compute.manager [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG nova.network.neutron [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Successfully updated port: dc4f904f-dd76-4f25-b9e6-41cc42493911 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "refresh_cache-9744c8a1-046e-4a00-92e0-92ebb3275ea9" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquired lock "refresh_cache-9744c8a1-046e-4a00-92e0-92ebb3275ea9" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG nova.network.neutron [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG nova.compute.manager [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:41:54 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Creating image(s)
Nov 15 02:41:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "/opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "/opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "/opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG nova.policy [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '34b23ed566024cc3a90f97206ea8162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfefdbf9f31b47d4a76d8fb06414eb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.174s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG nova.network.neutron [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.164s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "fc9484c0-9083-4797-8ab1-2ad392822ce8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "fc9484c0-9083-4797-8ab1-2ad392822ce8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG nova.compute.manager [req-648c12af-9c54-4fc4-a936-8eca464fdc7b req-363c1720-6327-4f8a-b709-4d6cd653a8c5 service nova] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Received event network-changed-dc4f904f-dd76-4f25-b9e6-41cc42493911 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG nova.compute.manager [req-648c12af-9c54-4fc4-a936-8eca464fdc7b req-363c1720-6327-4f8a-b709-4d6cd653a8c5 service nova] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Refreshing instance network info cache due to event network-changed-dc4f904f-dd76-4f25-b9e6-41cc42493911. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-648c12af-9c54-4fc4-a936-8eca464fdc7b req-363c1720-6327-4f8a-b709-4d6cd653a8c5 service nova] Acquiring lock "refresh_cache-9744c8a1-046e-4a00-92e0-92ebb3275ea9" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk 1073741824" returned: 0 in 0.062s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:41:54 user nova-compute[75391]: INFO nova.compute.claims [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Claim successful on node user
Nov 15 02:41:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.186s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:41:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Cannot resize image /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Ensure instance console log exists: /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.network.neutron [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Updating instance_info_cache with network_info: [{"id": "dc4f904f-dd76-4f25-b9e6-41cc42493911", "address": "fa:16:3e:e6:ec:c3", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4f904f-dd", "ovs_interfaceid": "dc4f904f-dd76-4f25-b9e6-41cc42493911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Releasing lock "refresh_cache-9744c8a1-046e-4a00-92e0-92ebb3275ea9" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.compute.manager [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Instance network_info: |[{"id": "dc4f904f-dd76-4f25-b9e6-41cc42493911", "address": "fa:16:3e:e6:ec:c3", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4f904f-dd", "ovs_interfaceid": "dc4f904f-dd76-4f25-b9e6-41cc42493911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-648c12af-9c54-4fc4-a936-8eca464fdc7b req-363c1720-6327-4f8a-b709-4d6cd653a8c5 service nova] Acquired lock "refresh_cache-9744c8a1-046e-4a00-92e0-92ebb3275ea9" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.network.neutron [req-648c12af-9c54-4fc4-a936-8eca464fdc7b req-363c1720-6327-4f8a-b709-4d6cd653a8c5 service nova] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Refreshing network info cache for port dc4f904f-dd76-4f25-b9e6-41cc42493911 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Start _get_guest_xml network_info=[{"id": "dc4f904f-dd76-4f25-b9e6-41cc42493911", "address": "fa:16:3e:e6:ec:c3", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4f904f-dd", "ovs_interfaceid": "dc4f904f-dd76-4f25-b9e6-41cc42493911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:41:55 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:41:55 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.privsep.utils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1769560489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1769560489',id=1,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e63a88a9fe824c3e9c0807a50b569d54',ramdisk_id='',reservation_id='r-37a096xw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-141063167',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:41:49Z,user_data=None,user_id='0aa106a59c374dde99b7697f94407339',uuid=9744c8a1-046e-4a00-92e0-92ebb3275ea9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc4f904f-dd76-4f25-b9e6-41cc42493911", "address": "fa:16:3e:e6:ec:c3", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4f904f-dd", "ovs_interfaceid": "dc4f904f-dd76-4f25-b9e6-41cc42493911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Converting VIF {"id": "dc4f904f-dd76-4f25-b9e6-41cc42493911", "address": "fa:16:3e:e6:ec:c3", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4f904f-dd", "ovs_interfaceid": "dc4f904f-dd76-4f25-b9e6-41cc42493911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ec:c3,bridge_name='br-int',has_traffic_filtering=True,id=dc4f904f-dd76-4f25-b9e6-41cc42493911,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4f904f-dd') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.objects.instance [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lazy-loading 'pci_devices' on Instance uuid 9744c8a1-046e-4a00-92e0-92ebb3275ea9 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:41:55 user nova-compute[75391]:   <uuid>9744c8a1-046e-4a00-92e0-92ebb3275ea9</uuid>
Nov 15 02:41:55 user nova-compute[75391]:   <name>instance-00000001</name>
Nov 15 02:41:55 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:41:55 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:41:55 user nova-compute[75391]:   <metadata>
Nov 15 02:41:55 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:41:55 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:41:55 user nova-compute[75391]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1769560489</nova:name>
Nov 15 02:41:55 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:41:55</nova:creationTime>
Nov 15 02:41:55 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:41:55 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:41:55 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:41:55 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:41:55 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:41:55 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:41:55 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:41:55 user nova-compute[75391]:       <nova:owner>
Nov 15 02:41:55 user nova-compute[75391]:         <nova:user uuid="0aa106a59c374dde99b7697f94407339">tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member</nova:user>
Nov 15 02:41:55 user nova-compute[75391]:         <nova:project uuid="e63a88a9fe824c3e9c0807a50b569d54">tempest-ServerBootFromVolumeStableRescueTest-141063167</nova:project>
Nov 15 02:41:55 user nova-compute[75391]:       </nova:owner>
Nov 15 02:41:55 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:41:55 user nova-compute[75391]:       <nova:ports>
Nov 15 02:41:55 user nova-compute[75391]:         <nova:port uuid="dc4f904f-dd76-4f25-b9e6-41cc42493911">
Nov 15 02:41:55 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 02:41:55 user nova-compute[75391]:         </nova:port>
Nov 15 02:41:55 user nova-compute[75391]:       </nova:ports>
Nov 15 02:41:55 user nova-compute[75391]:     </nova:instance>
Nov 15 02:41:55 user nova-compute[75391]:   </metadata>
Nov 15 02:41:55 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:41:55 user nova-compute[75391]:     <system>
Nov 15 02:41:55 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:41:55 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:41:55 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:41:55 user nova-compute[75391]:       <entry name="serial">9744c8a1-046e-4a00-92e0-92ebb3275ea9</entry>
Nov 15 02:41:55 user nova-compute[75391]:       <entry name="uuid">9744c8a1-046e-4a00-92e0-92ebb3275ea9</entry>
Nov 15 02:41:55 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:41:55 user nova-compute[75391]:     </system>
Nov 15 02:41:55 user nova-compute[75391]:   </sysinfo>
Nov 15 02:41:55 user nova-compute[75391]:   <os>
Nov 15 02:41:55 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:41:55 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:41:55 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:41:55 user nova-compute[75391]:   </os>
Nov 15 02:41:55 user nova-compute[75391]:   <features>
Nov 15 02:41:55 user nova-compute[75391]:     <acpi/>
Nov 15 02:41:55 user nova-compute[75391]:     <apic/>
Nov 15 02:41:55 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:41:55 user nova-compute[75391]:   </features>
Nov 15 02:41:55 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:41:55 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:41:55 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:41:55 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:41:55 user nova-compute[75391]:   </clock>
Nov 15 02:41:55 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:41:55 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:41:55 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:41:55 user nova-compute[75391]:   </cpu>
Nov 15 02:41:55 user nova-compute[75391]:   <devices>
Nov 15 02:41:55 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:41:55 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:41:55 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk"/>
Nov 15 02:41:55 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:41:55 user nova-compute[75391]:     </disk>
Nov 15 02:41:55 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:41:55 user nova-compute[75391]:       <mac address="fa:16:3e:e6:ec:c3"/>
Nov 15 02:41:55 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:41:55 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:41:55 user nova-compute[75391]:       <target dev="tapdc4f904f-dd"/>
Nov 15 02:41:55 user nova-compute[75391]:     </interface>
Nov 15 02:41:55 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:41:55 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/console.log" append="off"/>
Nov 15 02:41:55 user nova-compute[75391]:     </serial>
Nov 15 02:41:55 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:41:55 user nova-compute[75391]:     <video>
Nov 15 02:41:55 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:41:55 user nova-compute[75391]:     </video>
Nov 15 02:41:55 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:41:55 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:41:55 user nova-compute[75391]:     </rng>
Nov 15 02:41:55 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:41:55 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:41:55 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:41:55 user nova-compute[75391]:     </memballoon>
Nov 15 02:41:55 user nova-compute[75391]:   </devices>
Nov 15 02:41:55 user nova-compute[75391]: </domain>
Nov 15 02:41:55 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1769560489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1769560489',id=1,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e63a88a9fe824c3e9c0807a50b569d54',ramdisk_id='',reservation_id='r-37a096xw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-141063167',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:41:49Z,user_data=None,user_id='0aa106a59c374dde99b7697f94407339',uuid=9744c8a1-046e-4a00-92e0-92ebb3275ea9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc4f904f-dd76-4f25-b9e6-41cc42493911", "address": "fa:16:3e:e6:ec:c3", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4f904f-dd", "ovs_interfaceid": "dc4f904f-dd76-4f25-b9e6-41cc42493911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Converting VIF {"id": "dc4f904f-dd76-4f25-b9e6-41cc42493911", "address": "fa:16:3e:e6:ec:c3", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4f904f-dd", "ovs_interfaceid": "dc4f904f-dd76-4f25-b9e6-41cc42493911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ec:c3,bridge_name='br-int',has_traffic_filtering=True,id=dc4f904f-dd76-4f25-b9e6-41cc42493911,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4f904f-dd') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG os_vif [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ec:c3,bridge_name='br-int',has_traffic_filtering=True,id=dc4f904f-dd76-4f25-b9e6-41cc42493911,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4f904f-dd') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Created schema index Interface.name {{(pid=75391) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Created schema index Port.name {{(pid=75391) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Created schema index Bridge.name {{(pid=75391) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [POLLOUT] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '54280ec4-4c72-5085-8024-cb51ec28fb24', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:41:55 user nova-compute[75391]: INFO oslo.privsep.daemon [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpjwrekz4g/privsep.sock']
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:41:55 user sudo[84788]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpjwrekz4g/privsep.sock
Nov 15 02:41:55 user sudo[84788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.770s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.network.neutron [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Successfully created port: c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:41:55 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:41:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.policy [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f6ea5480ad1e49afa394e636c37e3b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81798f0465704c4d9c09d8c3d3175ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:41:55 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Creating image(s)
Nov 15 02:41:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "/opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "/opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:41:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:41:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.196s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:41:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:41:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:41:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:41:56 user nova-compute[75391]: DEBUG nova.network.neutron [req-648c12af-9c54-4fc4-a936-8eca464fdc7b req-363c1720-6327-4f8a-b709-4d6cd653a8c5 service nova] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Updated VIF entry in instance network info cache for port dc4f904f-dd76-4f25-b9e6-41cc42493911. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:41:56 user nova-compute[75391]: DEBUG nova.network.neutron [req-648c12af-9c54-4fc4-a936-8eca464fdc7b req-363c1720-6327-4f8a-b709-4d6cd653a8c5 service nova] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Updating instance_info_cache with network_info: [{"id": "dc4f904f-dd76-4f25-b9e6-41cc42493911", "address": "fa:16:3e:e6:ec:c3", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4f904f-dd", "ovs_interfaceid": "dc4f904f-dd76-4f25-b9e6-41cc42493911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:41:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-648c12af-9c54-4fc4-a936-8eca464fdc7b req-363c1720-6327-4f8a-b709-4d6cd653a8c5 service nova] Releasing lock "refresh_cache-9744c8a1-046e-4a00-92e0-92ebb3275ea9" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:41:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:41:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.190s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:41:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:41:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk 1073741824" returned: 0 in 0.056s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:41:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:41:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:41:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.222s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:41:56 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:41:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:41:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:41:56 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Cannot resize image /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:41:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:41:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Ensure instance console log exists: /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:41:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:41:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:41:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:41:56 user sudo[84788]: pam_unix(sudo:session): session closed for user root
Nov 15 02:41:56 user nova-compute[75391]: INFO oslo.privsep.daemon [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Spawned new privsep daemon via rootwrap
Nov 15 02:41:56 user nova-compute[75391]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 02:41:56 user nova-compute[75391]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 02:41:56 user nova-compute[75391]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 15 02:41:56 user nova-compute[75391]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84808
Nov 15 02:41:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:41:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:41:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:41:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:41:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc4f904f-dd, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:41:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc4f904f-dd, col_values=(('qos', UUID('f2248ab6-9038-4352-ae3d-b0aaf26cc6b9')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:41:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc4f904f-dd, col_values=(('external_ids', {'iface-id': 'dc4f904f-dd76-4f25-b9e6-41cc42493911', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:ec:c3', 'vm-uuid': '9744c8a1-046e-4a00-92e0-92ebb3275ea9'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:41:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:41:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:41:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:41:57 user nova-compute[75391]: INFO os_vif [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ec:c3,bridge_name='br-int',has_traffic_filtering=True,id=dc4f904f-dd76-4f25-b9e6-41cc42493911,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4f904f-dd')
Nov 15 02:41:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:41:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] No VIF found with MAC fa:16:3e:e6:ec:c3, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:41:57 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Successfully created port: d8f34e4c-5c99-45eb-a282-a721a2019209 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:41:58 user nova-compute[75391]: DEBUG nova.network.neutron [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Successfully updated port: c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:41:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "refresh_cache-ebb7e616-3c05-4d99-a0b3-76dc1723e82d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:41:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquired lock "refresh_cache-ebb7e616-3c05-4d99-a0b3-76dc1723e82d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:41:58 user nova-compute[75391]: DEBUG nova.network.neutron [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:41:58 user nova-compute[75391]: DEBUG nova.network.neutron [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:41:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:41:58 user nova-compute[75391]: DEBUG nova.compute.manager [req-1f45b353-9c98-445f-a120-4106503994c7 req-9f7c8eab-8a78-42f5-8a32-4e041e91393a service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Received event network-changed-c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:41:58 user nova-compute[75391]: DEBUG nova.compute.manager [req-1f45b353-9c98-445f-a120-4106503994c7 req-9f7c8eab-8a78-42f5-8a32-4e041e91393a service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Refreshing instance network info cache due to event network-changed-c9643afc-4454-4d29-b8a2-5422753857b0. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:41:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1f45b353-9c98-445f-a120-4106503994c7 req-9f7c8eab-8a78-42f5-8a32-4e041e91393a service nova] Acquiring lock "refresh_cache-ebb7e616-3c05-4d99-a0b3-76dc1723e82d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:41:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.network.neutron [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Updating instance_info_cache with network_info: [{"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Releasing lock "refresh_cache-ebb7e616-3c05-4d99-a0b3-76dc1723e82d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.compute.manager [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Instance network_info: |[{"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1f45b353-9c98-445f-a120-4106503994c7 req-9f7c8eab-8a78-42f5-8a32-4e041e91393a service nova] Acquired lock "refresh_cache-ebb7e616-3c05-4d99-a0b3-76dc1723e82d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.network.neutron [req-1f45b353-9c98-445f-a120-4106503994c7 req-9f7c8eab-8a78-42f5-8a32-4e041e91393a service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Refreshing network info cache for port c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Start _get_guest_xml network_info=[{"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:41:59 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:41:59 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-689614808',display_name='tempest-ServerActionsTestOtherB-server-689614808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-689614808',id=2,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2usIoDVXl+b9hE3o9jGzEYasMoeupEZWjgdC34QhkyFhqHaktIVO5IuSwbU0DElzd5MkeVTBrP68npXS/361ypXFAC7mDzbXraFDprW+Txm/mxv6ZY7FykX6U+2H5j7A==',key_name='tempest-keypair-1921719925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfefdbf9f31b47d4a76d8fb06414eb5a',ramdisk_id='',reservation_id='r-qacecpst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-5763420',owner_user_name='tempest-ServerActionsTestOtherB-5763420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:41:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34b23ed566024cc3a90f97206ea8162d',uuid=ebb7e616-3c05-4d99-a0b3-76dc1723e82d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Converting VIF {"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:35:a3,bridge_name='br-int',has_traffic_filtering=True,id=c9643afc-4454-4d29-b8a2-5422753857b0,network=Network(db549bf7-e039-4ea4-ac62-b5c090652e6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9643afc-44') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.objects.instance [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lazy-loading 'pci_devices' on Instance uuid ebb7e616-3c05-4d99-a0b3-76dc1723e82d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:41:59 user nova-compute[75391]:   <uuid>ebb7e616-3c05-4d99-a0b3-76dc1723e82d</uuid>
Nov 15 02:41:59 user nova-compute[75391]:   <name>instance-00000002</name>
Nov 15 02:41:59 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:41:59 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:41:59 user nova-compute[75391]:   <metadata>
Nov 15 02:41:59 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:41:59 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:41:59 user nova-compute[75391]:       <nova:name>tempest-ServerActionsTestOtherB-server-689614808</nova:name>
Nov 15 02:41:59 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:41:59</nova:creationTime>
Nov 15 02:41:59 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:41:59 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:41:59 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:41:59 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:41:59 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:41:59 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:41:59 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:41:59 user nova-compute[75391]:       <nova:owner>
Nov 15 02:41:59 user nova-compute[75391]:         <nova:user uuid="34b23ed566024cc3a90f97206ea8162d">tempest-ServerActionsTestOtherB-5763420-project-member</nova:user>
Nov 15 02:41:59 user nova-compute[75391]:         <nova:project uuid="dfefdbf9f31b47d4a76d8fb06414eb5a">tempest-ServerActionsTestOtherB-5763420</nova:project>
Nov 15 02:41:59 user nova-compute[75391]:       </nova:owner>
Nov 15 02:41:59 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:41:59 user nova-compute[75391]:       <nova:ports>
Nov 15 02:41:59 user nova-compute[75391]:         <nova:port uuid="c9643afc-4454-4d29-b8a2-5422753857b0">
Nov 15 02:41:59 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 02:41:59 user nova-compute[75391]:         </nova:port>
Nov 15 02:41:59 user nova-compute[75391]:       </nova:ports>
Nov 15 02:41:59 user nova-compute[75391]:     </nova:instance>
Nov 15 02:41:59 user nova-compute[75391]:   </metadata>
Nov 15 02:41:59 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:41:59 user nova-compute[75391]:     <system>
Nov 15 02:41:59 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:41:59 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:41:59 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:41:59 user nova-compute[75391]:       <entry name="serial">ebb7e616-3c05-4d99-a0b3-76dc1723e82d</entry>
Nov 15 02:41:59 user nova-compute[75391]:       <entry name="uuid">ebb7e616-3c05-4d99-a0b3-76dc1723e82d</entry>
Nov 15 02:41:59 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:41:59 user nova-compute[75391]:     </system>
Nov 15 02:41:59 user nova-compute[75391]:   </sysinfo>
Nov 15 02:41:59 user nova-compute[75391]:   <os>
Nov 15 02:41:59 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:41:59 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:41:59 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:41:59 user nova-compute[75391]:   </os>
Nov 15 02:41:59 user nova-compute[75391]:   <features>
Nov 15 02:41:59 user nova-compute[75391]:     <acpi/>
Nov 15 02:41:59 user nova-compute[75391]:     <apic/>
Nov 15 02:41:59 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:41:59 user nova-compute[75391]:   </features>
Nov 15 02:41:59 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:41:59 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:41:59 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:41:59 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:41:59 user nova-compute[75391]:   </clock>
Nov 15 02:41:59 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:41:59 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:41:59 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:41:59 user nova-compute[75391]:   </cpu>
Nov 15 02:41:59 user nova-compute[75391]:   <devices>
Nov 15 02:41:59 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:41:59 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:41:59 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk"/>
Nov 15 02:41:59 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:41:59 user nova-compute[75391]:     </disk>
Nov 15 02:41:59 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:41:59 user nova-compute[75391]:       <mac address="fa:16:3e:79:35:a3"/>
Nov 15 02:41:59 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:41:59 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:41:59 user nova-compute[75391]:       <target dev="tapc9643afc-44"/>
Nov 15 02:41:59 user nova-compute[75391]:     </interface>
Nov 15 02:41:59 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:41:59 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/console.log" append="off"/>
Nov 15 02:41:59 user nova-compute[75391]:     </serial>
Nov 15 02:41:59 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:41:59 user nova-compute[75391]:     <video>
Nov 15 02:41:59 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:41:59 user nova-compute[75391]:     </video>
Nov 15 02:41:59 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:41:59 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:41:59 user nova-compute[75391]:     </rng>
Nov 15 02:41:59 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:41:59 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:41:59 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:41:59 user nova-compute[75391]:     </memballoon>
Nov 15 02:41:59 user nova-compute[75391]:   </devices>
Nov 15 02:41:59 user nova-compute[75391]: </domain>
Nov 15 02:41:59 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-689614808',display_name='tempest-ServerActionsTestOtherB-server-689614808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-689614808',id=2,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2usIoDVXl+b9hE3o9jGzEYasMoeupEZWjgdC34QhkyFhqHaktIVO5IuSwbU0DElzd5MkeVTBrP68npXS/361ypXFAC7mDzbXraFDprW+Txm/mxv6ZY7FykX6U+2H5j7A==',key_name='tempest-keypair-1921719925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfefdbf9f31b47d4a76d8fb06414eb5a',ramdisk_id='',reservation_id='r-qacecpst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-5763420',owner_user_name='tempest-ServerActionsTestOtherB-5763420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:41:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34b23ed566024cc3a90f97206ea8162d',uuid=ebb7e616-3c05-4d99-a0b3-76dc1723e82d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Converting VIF {"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:35:a3,bridge_name='br-int',has_traffic_filtering=True,id=c9643afc-4454-4d29-b8a2-5422753857b0,network=Network(db549bf7-e039-4ea4-ac62-b5c090652e6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9643afc-44') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG os_vif [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:35:a3,bridge_name='br-int',has_traffic_filtering=True,id=c9643afc-4454-4d29-b8a2-5422753857b0,network=Network(db549bf7-e039-4ea4-ac62-b5c090652e6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9643afc-44') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0463733-cee5-5ff3-8620-fd8a83e092b2', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9643afc-44, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9643afc-44, col_values=(('qos', UUID('7131d657-b4d1-425a-9799-3bd22b431c1d')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9643afc-44, col_values=(('external_ids', {'iface-id': 'c9643afc-4454-4d29-b8a2-5422753857b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:35:a3', 'vm-uuid': 'ebb7e616-3c05-4d99-a0b3-76dc1723e82d'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:41:59 user nova-compute[75391]: INFO os_vif [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:35:a3,bridge_name='br-int',has_traffic_filtering=True,id=c9643afc-4454-4d29-b8a2-5422753857b0,network=Network(db549bf7-e039-4ea4-ac62-b5c090652e6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9643afc-44')
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:41:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] No VIF found with MAC fa:16:3e:79:35:a3, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:42:01 user nova-compute[75391]: DEBUG nova.compute.manager [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:42:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:42:01 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Instance spawned successfully.
Nov 15 02:42:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:42:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:01 user nova-compute[75391]: DEBUG nova.network.neutron [req-1f45b353-9c98-445f-a120-4106503994c7 req-9f7c8eab-8a78-42f5-8a32-4e041e91393a service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Updated VIF entry in instance network info cache for port c9643afc-4454-4d29-b8a2-5422753857b0. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:42:01 user nova-compute[75391]: DEBUG nova.network.neutron [req-1f45b353-9c98-445f-a120-4106503994c7 req-9f7c8eab-8a78-42f5-8a32-4e041e91393a service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Updating instance_info_cache with network_info: [{"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:42:01 user nova-compute[75391]: INFO nova.compute.manager [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Took 12.18 seconds to spawn the instance on the hypervisor.
Nov 15 02:42:01 user nova-compute[75391]: DEBUG nova.compute.manager [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:42:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1f45b353-9c98-445f-a120-4106503994c7 req-9f7c8eab-8a78-42f5-8a32-4e041e91393a service nova] Releasing lock "refresh_cache-ebb7e616-3c05-4d99-a0b3-76dc1723e82d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:42:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:01 user nova-compute[75391]: INFO nova.compute.manager [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Took 13.28 seconds to build instance.
Nov 15 02:42:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:01 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Successfully updated port: d8f34e4c-5c99-45eb-a282-a721a2019209 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:42:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "refresh_cache-fc9484c0-9083-4797-8ab1-2ad392822ce8" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:42:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquired lock "refresh_cache-fc9484c0-9083-4797-8ab1-2ad392822ce8" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:42:01 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:42:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-39e7054b-343e-4ce6-be93-811a8c85f377 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "9744c8a1-046e-4a00-92e0-92ebb3275ea9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.990s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:01 user nova-compute[75391]: DEBUG nova.compute.manager [req-24f7d10e-0203-4e7c-881d-2767502f9952 req-a9ccbe04-fa29-4949-b38e-f86edf04e2d8 service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Received event network-changed-d8f34e4c-5c99-45eb-a282-a721a2019209 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:01 user nova-compute[75391]: DEBUG nova.compute.manager [req-24f7d10e-0203-4e7c-881d-2767502f9952 req-a9ccbe04-fa29-4949-b38e-f86edf04e2d8 service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Refreshing instance network info cache due to event network-changed-d8f34e4c-5c99-45eb-a282-a721a2019209. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:42:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-24f7d10e-0203-4e7c-881d-2767502f9952 req-a9ccbe04-fa29-4949-b38e-f86edf04e2d8 service nova] Acquiring lock "refresh_cache-fc9484c0-9083-4797-8ab1-2ad392822ce8" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:42:01 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Updating instance_info_cache with network_info: [{"id": "d8f34e4c-5c99-45eb-a282-a721a2019209", "address": "fa:16:3e:ca:58:46", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f34e4c-5c", "ovs_interfaceid": "d8f34e4c-5c99-45eb-a282-a721a2019209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Releasing lock "refresh_cache-fc9484c0-9083-4797-8ab1-2ad392822ce8" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Instance network_info: |[{"id": "d8f34e4c-5c99-45eb-a282-a721a2019209", "address": "fa:16:3e:ca:58:46", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f34e4c-5c", "ovs_interfaceid": "d8f34e4c-5c99-45eb-a282-a721a2019209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-24f7d10e-0203-4e7c-881d-2767502f9952 req-a9ccbe04-fa29-4949-b38e-f86edf04e2d8 service nova] Acquired lock "refresh_cache-fc9484c0-9083-4797-8ab1-2ad392822ce8" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.network.neutron [req-24f7d10e-0203-4e7c-881d-2767502f9952 req-a9ccbe04-fa29-4949-b38e-f86edf04e2d8 service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Refreshing network info cache for port d8f34e4c-5c99-45eb-a282-a721a2019209 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Start _get_guest_xml network_info=[{"id": "d8f34e4c-5c99-45eb-a282-a721a2019209", "address": "fa:16:3e:ca:58:46", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f34e4c-5c", "ovs_interfaceid": "d8f34e4c-5c99-45eb-a282-a721a2019209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:42:02 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:42:02 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-300199683',display_name='tempest-ServerActionsTestOtherA-server-300199683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-300199683',id=3,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItI9ByRPHa+npkHzUM7/DmFQcMmvmf/UTbrL8IIRz+RgnE4/GT/cT4MtYBSEthl3H1QqF7/CYKc5G1nHfxc2lqIIfQchUdl2quGrdDYzv011COZxukmBFCsP+0gJadT/A==',key_name='tempest-keypair-1167614249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81798f0465704c4d9c09d8c3d3175ac5',ramdisk_id='',reservation_id='r-j2v8xjn2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1177660790',owner_user_name='tempest-ServerActionsTestOtherA-1177660790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ea5480ad1e49afa394e636c37e3b70',uuid=fc9484c0-9083-4797-8ab1-2ad392822ce8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8f34e4c-5c99-45eb-a282-a721a2019209", "address": "fa:16:3e:ca:58:46", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f34e4c-5c", "ovs_interfaceid": "d8f34e4c-5c99-45eb-a282-a721a2019209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converting VIF {"id": "d8f34e4c-5c99-45eb-a282-a721a2019209", "address": "fa:16:3e:ca:58:46", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f34e4c-5c", "ovs_interfaceid": "d8f34e4c-5c99-45eb-a282-a721a2019209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:58:46,bridge_name='br-int',has_traffic_filtering=True,id=d8f34e4c-5c99-45eb-a282-a721a2019209,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8f34e4c-5c') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.objects.instance [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lazy-loading 'pci_devices' on Instance uuid fc9484c0-9083-4797-8ab1-2ad392822ce8 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:42:02 user nova-compute[75391]:   <uuid>fc9484c0-9083-4797-8ab1-2ad392822ce8</uuid>
Nov 15 02:42:02 user nova-compute[75391]:   <name>instance-00000003</name>
Nov 15 02:42:02 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:42:02 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:42:02 user nova-compute[75391]:   <metadata>
Nov 15 02:42:02 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:42:02 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:42:02 user nova-compute[75391]:       <nova:name>tempest-ServerActionsTestOtherA-server-300199683</nova:name>
Nov 15 02:42:02 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:42:02</nova:creationTime>
Nov 15 02:42:02 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:42:02 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:42:02 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:42:02 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:42:02 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:42:02 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:42:02 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:42:02 user nova-compute[75391]:       <nova:owner>
Nov 15 02:42:02 user nova-compute[75391]:         <nova:user uuid="f6ea5480ad1e49afa394e636c37e3b70">tempest-ServerActionsTestOtherA-1177660790-project-member</nova:user>
Nov 15 02:42:02 user nova-compute[75391]:         <nova:project uuid="81798f0465704c4d9c09d8c3d3175ac5">tempest-ServerActionsTestOtherA-1177660790</nova:project>
Nov 15 02:42:02 user nova-compute[75391]:       </nova:owner>
Nov 15 02:42:02 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:42:02 user nova-compute[75391]:       <nova:ports>
Nov 15 02:42:02 user nova-compute[75391]:         <nova:port uuid="d8f34e4c-5c99-45eb-a282-a721a2019209">
Nov 15 02:42:02 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 02:42:02 user nova-compute[75391]:         </nova:port>
Nov 15 02:42:02 user nova-compute[75391]:       </nova:ports>
Nov 15 02:42:02 user nova-compute[75391]:     </nova:instance>
Nov 15 02:42:02 user nova-compute[75391]:   </metadata>
Nov 15 02:42:02 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:42:02 user nova-compute[75391]:     <system>
Nov 15 02:42:02 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:42:02 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:42:02 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:42:02 user nova-compute[75391]:       <entry name="serial">fc9484c0-9083-4797-8ab1-2ad392822ce8</entry>
Nov 15 02:42:02 user nova-compute[75391]:       <entry name="uuid">fc9484c0-9083-4797-8ab1-2ad392822ce8</entry>
Nov 15 02:42:02 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:42:02 user nova-compute[75391]:     </system>
Nov 15 02:42:02 user nova-compute[75391]:   </sysinfo>
Nov 15 02:42:02 user nova-compute[75391]:   <os>
Nov 15 02:42:02 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:42:02 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:42:02 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:42:02 user nova-compute[75391]:   </os>
Nov 15 02:42:02 user nova-compute[75391]:   <features>
Nov 15 02:42:02 user nova-compute[75391]:     <acpi/>
Nov 15 02:42:02 user nova-compute[75391]:     <apic/>
Nov 15 02:42:02 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:42:02 user nova-compute[75391]:   </features>
Nov 15 02:42:02 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:42:02 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:42:02 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:42:02 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:42:02 user nova-compute[75391]:   </clock>
Nov 15 02:42:02 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:42:02 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:42:02 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:42:02 user nova-compute[75391]:   </cpu>
Nov 15 02:42:02 user nova-compute[75391]:   <devices>
Nov 15 02:42:02 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:42:02 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:42:02 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk"/>
Nov 15 02:42:02 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:42:02 user nova-compute[75391]:     </disk>
Nov 15 02:42:02 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:42:02 user nova-compute[75391]:       <mac address="fa:16:3e:ca:58:46"/>
Nov 15 02:42:02 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:42:02 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:42:02 user nova-compute[75391]:       <target dev="tapd8f34e4c-5c"/>
Nov 15 02:42:02 user nova-compute[75391]:     </interface>
Nov 15 02:42:02 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:42:02 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/console.log" append="off"/>
Nov 15 02:42:02 user nova-compute[75391]:     </serial>
Nov 15 02:42:02 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:42:02 user nova-compute[75391]:     <video>
Nov 15 02:42:02 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:42:02 user nova-compute[75391]:     </video>
Nov 15 02:42:02 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:42:02 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:42:02 user nova-compute[75391]:     </rng>
Nov 15 02:42:02 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:42:02 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:42:02 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:42:02 user nova-compute[75391]:     </memballoon>
Nov 15 02:42:02 user nova-compute[75391]:   </devices>
Nov 15 02:42:02 user nova-compute[75391]: </domain>
Nov 15 02:42:02 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-300199683',display_name='tempest-ServerActionsTestOtherA-server-300199683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-300199683',id=3,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItI9ByRPHa+npkHzUM7/DmFQcMmvmf/UTbrL8IIRz+RgnE4/GT/cT4MtYBSEthl3H1QqF7/CYKc5G1nHfxc2lqIIfQchUdl2quGrdDYzv011COZxukmBFCsP+0gJadT/A==',key_name='tempest-keypair-1167614249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81798f0465704c4d9c09d8c3d3175ac5',ramdisk_id='',reservation_id='r-j2v8xjn2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1177660790',owner_user_name='tempest-ServerActionsTestOtherA-1177660790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ea5480ad1e49afa394e636c37e3b70',uuid=fc9484c0-9083-4797-8ab1-2ad392822ce8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8f34e4c-5c99-45eb-a282-a721a2019209", "address": "fa:16:3e:ca:58:46", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f34e4c-5c", "ovs_interfaceid": "d8f34e4c-5c99-45eb-a282-a721a2019209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converting VIF {"id": "d8f34e4c-5c99-45eb-a282-a721a2019209", "address": "fa:16:3e:ca:58:46", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f34e4c-5c", "ovs_interfaceid": "d8f34e4c-5c99-45eb-a282-a721a2019209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:58:46,bridge_name='br-int',has_traffic_filtering=True,id=d8f34e4c-5c99-45eb-a282-a721a2019209,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8f34e4c-5c') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG os_vif [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:58:46,bridge_name='br-int',has_traffic_filtering=True,id=d8f34e4c-5c99-45eb-a282-a721a2019209,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8f34e4c-5c') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '07453278-5575-5ca5-8c2c-67d7cb6daebe', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8f34e4c-5c, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd8f34e4c-5c, col_values=(('qos', UUID('f9ff80f7-5571-4ab6-aaff-3c3238945fa6')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd8f34e4c-5c, col_values=(('external_ids', {'iface-id': 'd8f34e4c-5c99-45eb-a282-a721a2019209', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:58:46', 'vm-uuid': 'fc9484c0-9083-4797-8ab1-2ad392822ce8'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:02 user nova-compute[75391]: INFO os_vif [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:58:46,bridge_name='br-int',has_traffic_filtering=True,id=d8f34e4c-5c99-45eb-a282-a721a2019209,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8f34e4c-5c')
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:42:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] No VIF found with MAC fa:16:3e:ca:58:46, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:42:03 user nova-compute[75391]: DEBUG nova.network.neutron [req-24f7d10e-0203-4e7c-881d-2767502f9952 req-a9ccbe04-fa29-4949-b38e-f86edf04e2d8 service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Updated VIF entry in instance network info cache for port d8f34e4c-5c99-45eb-a282-a721a2019209. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:42:03 user nova-compute[75391]: DEBUG nova.network.neutron [req-24f7d10e-0203-4e7c-881d-2767502f9952 req-a9ccbe04-fa29-4949-b38e-f86edf04e2d8 service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Updating instance_info_cache with network_info: [{"id": "d8f34e4c-5c99-45eb-a282-a721a2019209", "address": "fa:16:3e:ca:58:46", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f34e4c-5c", "ovs_interfaceid": "d8f34e4c-5c99-45eb-a282-a721a2019209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:42:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-24f7d10e-0203-4e7c-881d-2767502f9952 req-a9ccbe04-fa29-4949-b38e-f86edf04e2d8 service nova] Releasing lock "refresh_cache-fc9484c0-9083-4797-8ab1-2ad392822ce8" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:42:04 user nova-compute[75391]: DEBUG nova.compute.manager [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:42:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:42:04 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Instance spawned successfully.
Nov 15 02:42:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:42:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Acquiring lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:04 user nova-compute[75391]: DEBUG nova.compute.manager [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:42:04 user nova-compute[75391]: INFO nova.compute.manager [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Took 10.08 seconds to spawn the instance on the hypervisor.
Nov 15 02:42:04 user nova-compute[75391]: DEBUG nova.compute.manager [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:42:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:04 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:42:04 user nova-compute[75391]: INFO nova.compute.claims [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Claim successful on node user
Nov 15 02:42:04 user nova-compute[75391]: INFO nova.compute.manager [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Took 10.89 seconds to build instance.
Nov 15 02:42:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7764e2d7-9ca4-4c3f-8e1f-59c86ce6a433 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.017s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:05 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:42:05 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:42:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.621s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:05 user nova-compute[75391]: DEBUG nova.compute.manager [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:42:05 user nova-compute[75391]: DEBUG nova.compute.manager [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:42:05 user nova-compute[75391]: DEBUG nova.network.neutron [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:42:05 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:42:05 user nova-compute[75391]: DEBUG nova.compute.manager [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:42:05 user nova-compute[75391]: DEBUG nova.policy [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f67781b1c37f4b7dbabdfa16d7b891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9265d1e4bccb467fbf0c738844d8735b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:42:05 user nova-compute[75391]: DEBUG nova.compute.manager [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:42:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:42:05 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Creating image(s)
Nov 15 02:42:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "/opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "/opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.238s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.269s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk 1073741824" returned: 0 in 0.087s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.365s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.250s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:06 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:42:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:06 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Cannot resize image /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:42:06 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:42:06 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Ensure instance console log exists: /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:42:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:07 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:42:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:42:07 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Instance spawned successfully.
Nov 15 02:42:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:42:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:07 user nova-compute[75391]: INFO nova.compute.manager [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Took 11.42 seconds to spawn the instance on the hypervisor.
Nov 15 02:42:07 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:42:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:07 user nova-compute[75391]: INFO nova.compute.manager [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Took 12.74 seconds to build instance.
Nov 15 02:42:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ff89d684-8600-41c3-9c77-141330d3b231 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "fc9484c0-9083-4797-8ab1-2ad392822ce8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.920s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:08 user nova-compute[75391]: DEBUG nova.network.neutron [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Successfully created port: 4ff5dedb-acb1-489b-a2dc-18a0f53f2933 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:42:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Acquiring lock "f5586645-063f-463f-b03a-16e783b1c2d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "f5586645-063f-463f-b03a-16e783b1c2d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:09 user nova-compute[75391]: DEBUG nova.compute.manager [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:42:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:09 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:42:09 user nova-compute[75391]: INFO nova.compute.claims [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Claim successful on node user
Nov 15 02:42:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Acquiring lock "60093cdf-015e-4c39-a514-1818a6e55385" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "60093cdf-015e-4c39-a514-1818a6e55385" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:10 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:42:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:10 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:42:10 user nova-compute[75391]: DEBUG nova.network.neutron [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Successfully updated port: 4ff5dedb-acb1-489b-a2dc-18a0f53f2933 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:42:10 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:42:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Acquiring lock "refresh_cache-1ee84f40-ff95-41d2-97f6-2ef320cdf9f2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:42:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Acquired lock "refresh_cache-1ee84f40-ff95-41d2-97f6-2ef320cdf9f2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:42:10 user nova-compute[75391]: DEBUG nova.network.neutron [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:42:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.627s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:10 user nova-compute[75391]: DEBUG nova.compute.manager [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:42:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.264s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:10 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:42:10 user nova-compute[75391]: INFO nova.compute.claims [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Claim successful on node user
Nov 15 02:42:10 user nova-compute[75391]: DEBUG nova.compute.manager [req-bcc07046-46b5-4b40-b96a-4b92beb8a763 req-b7fbcd4b-5bb7-41d7-9ad9-0adbf08e5fa6 service nova] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Received event network-changed-4ff5dedb-acb1-489b-a2dc-18a0f53f2933 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:10 user nova-compute[75391]: DEBUG nova.compute.manager [req-bcc07046-46b5-4b40-b96a-4b92beb8a763 req-b7fbcd4b-5bb7-41d7-9ad9-0adbf08e5fa6 service nova] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Refreshing instance network info cache due to event network-changed-4ff5dedb-acb1-489b-a2dc-18a0f53f2933. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:42:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bcc07046-46b5-4b40-b96a-4b92beb8a763 req-b7fbcd4b-5bb7-41d7-9ad9-0adbf08e5fa6 service nova] Acquiring lock "refresh_cache-1ee84f40-ff95-41d2-97f6-2ef320cdf9f2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:42:10 user nova-compute[75391]: DEBUG nova.network.neutron [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:42:10 user nova-compute[75391]: DEBUG nova.compute.manager [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:42:10 user nova-compute[75391]: DEBUG nova.network.neutron [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:42:10 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 15 02:42:10 user nova-compute[75391]: DEBUG nova.compute.manager [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:42:10 user nova-compute[75391]: DEBUG nova.compute.manager [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:42:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:42:10 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Creating image(s)
Nov 15 02:42:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5586645-063f-463f-b03a-16e783b1c2d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "/opt/stack/data/nova/instances/f5586645-063f-463f-b03a-16e783b1c2d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "/opt/stack/data/nova/instances/f5586645-063f-463f-b03a-16e783b1c2d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Acquiring lock "492432f921f89469381625e9482c741ebcd1a5f8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "492432f921f89469381625e9482c741ebcd1a5f8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:11 user nova-compute[75391]: DEBUG nova.policy [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a9243da3ef1d4dfa898d30615f838aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5682e8d440c343039dc2baf1d2687863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:42:11 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:42:11 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:42:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/492432f921f89469381625e9482c741ebcd1a5f8.part --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.060s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:11 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:42:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Acquiring lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Acquiring lock "1fc39b27-762e-4bc8-90ba-0215d65710ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lock "1fc39b27-762e-4bc8-90ba-0215d65710ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:11 user nova-compute[75391]: DEBUG nova.compute.manager [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:42:11 user nova-compute[75391]: DEBUG nova.compute.manager [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:42:11 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:42:11 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:42:11 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:42:11 user nova-compute[75391]: DEBUG nova.network.neutron [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Updating instance_info_cache with network_info: [{"id": "4ff5dedb-acb1-489b-a2dc-18a0f53f2933", "address": "fa:16:3e:2e:13:88", "network": {"id": "cb1a9e37-451d-43be-ab84-a0ebe7ab264b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500424491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9265d1e4bccb467fbf0c738844d8735b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff5dedb-ac", "ovs_interfaceid": "4ff5dedb-acb1-489b-a2dc-18a0f53f2933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:42:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/492432f921f89469381625e9482c741ebcd1a5f8.part --force-share --output=json" returned: 0 in 0.263s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:11 user nova-compute[75391]: DEBUG nova.virt.images [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] eefcf20c-f561-43b7-8801-e4dd7714fa4f was qcow2, converting to raw {{(pid=75391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 02:42:11 user nova-compute[75391]: DEBUG nova.privsep.utils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 02:42:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/492432f921f89469381625e9482c741ebcd1a5f8.part /opt/stack/data/nova/instances/_base/492432f921f89469381625e9482c741ebcd1a5f8.converted {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Releasing lock "refresh_cache-1ee84f40-ff95-41d2-97f6-2ef320cdf9f2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:42:11 user nova-compute[75391]: DEBUG nova.compute.manager [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Instance network_info: |[{"id": "4ff5dedb-acb1-489b-a2dc-18a0f53f2933", "address": "fa:16:3e:2e:13:88", "network": {"id": "cb1a9e37-451d-43be-ab84-a0ebe7ab264b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500424491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9265d1e4bccb467fbf0c738844d8735b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff5dedb-ac", "ovs_interfaceid": "4ff5dedb-acb1-489b-a2dc-18a0f53f2933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:42:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bcc07046-46b5-4b40-b96a-4b92beb8a763 req-b7fbcd4b-5bb7-41d7-9ad9-0adbf08e5fa6 service nova] Acquired lock "refresh_cache-1ee84f40-ff95-41d2-97f6-2ef320cdf9f2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:42:11 user nova-compute[75391]: DEBUG nova.network.neutron [req-bcc07046-46b5-4b40-b96a-4b92beb8a763 req-b7fbcd4b-5bb7-41d7-9ad9-0adbf08e5fa6 service nova] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Refreshing network info cache for port 4ff5dedb-acb1-489b-a2dc-18a0f53f2933 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:42:11 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Start _get_guest_xml network_info=[{"id": "4ff5dedb-acb1-489b-a2dc-18a0f53f2933", "address": "fa:16:3e:2e:13:88", "network": {"id": "cb1a9e37-451d-43be-ab84-a0ebe7ab264b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500424491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9265d1e4bccb467fbf0c738844d8735b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff5dedb-ac", "ovs_interfaceid": "4ff5dedb-acb1-489b-a2dc-18a0f53f2933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:42:11 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:42:11 user nova-compute[75391]: DEBUG nova.policy [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '541a74f4f1004769b64f8086feae6255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e357f7331b8042adbc7e74190412daa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:42:12 user nova-compute[75391]: INFO nova.compute.claims [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Claim successful on node user
Nov 15 02:42:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/492432f921f89469381625e9482c741ebcd1a5f8.part /opt/stack/data/nova/instances/_base/492432f921f89469381625e9482c741ebcd1a5f8.converted" returned: 0 in 0.202s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/492432f921f89469381625e9482c741ebcd1a5f8.converted --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:12 user nova-compute[75391]: INFO nova.virt.block_device [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Booting with volume 7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 at /dev/vda
Nov 15 02:42:12 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:42:12 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:42:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:42:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-439567025',display_name='tempest-VolumesAdminNegativeTest-server-439567025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-439567025',id=4,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMg5eEtMXdKfc7PFWzAV+AIelSB6Q9qOzaUk8uWrd3TtoLu7xrWJCMx+fxwoiekH4SGPErp3QN4SBcAbpps9eEHbjuimftpBd1SGDvpueZq3zEuNmogj4lbaz3907rsJsQ==',key_name='tempest-keypair-1446273857',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9265d1e4bccb467fbf0c738844d8735b',ramdisk_id='',reservation_id='r-9d4577kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1405215089',owner_user_name='tempest-VolumesAdminNegativeTest-1405215089-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f67781b1c37f4b7dbabdfa16d7b891d0',uuid=1ee84f40-ff95-41d2-97f6-2ef320cdf9f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ff5dedb-acb1-489b-a2dc-18a0f53f2933", "address": "fa:16:3e:2e:13:88", "network": {"id": "cb1a9e37-451d-43be-ab84-a0ebe7ab264b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500424491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9265d1e4bccb467fbf0c738844d8735b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff5dedb-ac", "ovs_interfaceid": "4ff5dedb-acb1-489b-a2dc-18a0f53f2933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Converting VIF {"id": "4ff5dedb-acb1-489b-a2dc-18a0f53f2933", "address": "fa:16:3e:2e:13:88", "network": {"id": "cb1a9e37-451d-43be-ab84-a0ebe7ab264b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500424491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9265d1e4bccb467fbf0c738844d8735b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff5dedb-ac", "ovs_interfaceid": "4ff5dedb-acb1-489b-a2dc-18a0f53f2933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:13:88,bridge_name='br-int',has_traffic_filtering=True,id=4ff5dedb-acb1-489b-a2dc-18a0f53f2933,network=Network(cb1a9e37-451d-43be-ab84-a0ebe7ab264b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff5dedb-ac') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG nova.objects.instance [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG os_brick.utils [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:42:12 user nova-compute[75391]: INFO oslo.privsep.daemon [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmparpeqa3o/privsep.sock']
Nov 15 02:42:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/492432f921f89469381625e9482c741ebcd1a5f8.converted --force-share --output=json" returned: 0 in 0.283s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:42:12 user nova-compute[75391]:   <uuid>1ee84f40-ff95-41d2-97f6-2ef320cdf9f2</uuid>
Nov 15 02:42:12 user nova-compute[75391]:   <name>instance-00000004</name>
Nov 15 02:42:12 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:42:12 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:42:12 user nova-compute[75391]:   <metadata>
Nov 15 02:42:12 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:42:12 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:42:12 user nova-compute[75391]:       <nova:name>tempest-VolumesAdminNegativeTest-server-439567025</nova:name>
Nov 15 02:42:12 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:42:12</nova:creationTime>
Nov 15 02:42:12 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:42:12 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:42:12 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:42:12 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:42:12 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:42:12 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:42:12 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:42:12 user nova-compute[75391]:       <nova:owner>
Nov 15 02:42:12 user nova-compute[75391]:         <nova:user uuid="f67781b1c37f4b7dbabdfa16d7b891d0">tempest-VolumesAdminNegativeTest-1405215089-project-member</nova:user>
Nov 15 02:42:12 user nova-compute[75391]:         <nova:project uuid="9265d1e4bccb467fbf0c738844d8735b">tempest-VolumesAdminNegativeTest-1405215089</nova:project>
Nov 15 02:42:12 user nova-compute[75391]:       </nova:owner>
Nov 15 02:42:12 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:42:12 user nova-compute[75391]:       <nova:ports>
Nov 15 02:42:12 user nova-compute[75391]:         <nova:port uuid="4ff5dedb-acb1-489b-a2dc-18a0f53f2933">
Nov 15 02:42:12 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 02:42:12 user nova-compute[75391]:         </nova:port>
Nov 15 02:42:12 user nova-compute[75391]:       </nova:ports>
Nov 15 02:42:12 user nova-compute[75391]:     </nova:instance>
Nov 15 02:42:12 user nova-compute[75391]:   </metadata>
Nov 15 02:42:12 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:42:12 user nova-compute[75391]:     <system>
Nov 15 02:42:12 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:42:12 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:42:12 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:42:12 user nova-compute[75391]:       <entry name="serial">1ee84f40-ff95-41d2-97f6-2ef320cdf9f2</entry>
Nov 15 02:42:12 user nova-compute[75391]:       <entry name="uuid">1ee84f40-ff95-41d2-97f6-2ef320cdf9f2</entry>
Nov 15 02:42:12 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:42:12 user nova-compute[75391]:     </system>
Nov 15 02:42:12 user nova-compute[75391]:   </sysinfo>
Nov 15 02:42:12 user nova-compute[75391]:   <os>
Nov 15 02:42:12 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:42:12 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:42:12 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:42:12 user nova-compute[75391]:   </os>
Nov 15 02:42:12 user nova-compute[75391]:   <features>
Nov 15 02:42:12 user nova-compute[75391]:     <acpi/>
Nov 15 02:42:12 user nova-compute[75391]:     <apic/>
Nov 15 02:42:12 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:42:12 user nova-compute[75391]:   </features>
Nov 15 02:42:12 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:42:12 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:42:12 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:42:12 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:42:12 user nova-compute[75391]:   </clock>
Nov 15 02:42:12 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:42:12 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:42:12 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:42:12 user nova-compute[75391]:   </cpu>
Nov 15 02:42:12 user nova-compute[75391]:   <devices>
Nov 15 02:42:12 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:42:12 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:42:12 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk"/>
Nov 15 02:42:12 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:42:12 user nova-compute[75391]:     </disk>
Nov 15 02:42:12 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:42:12 user nova-compute[75391]:       <mac address="fa:16:3e:2e:13:88"/>
Nov 15 02:42:12 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:42:12 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:42:12 user nova-compute[75391]:       <target dev="tap4ff5dedb-ac"/>
Nov 15 02:42:12 user nova-compute[75391]:     </interface>
Nov 15 02:42:12 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:42:12 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/console.log" append="off"/>
Nov 15 02:42:12 user nova-compute[75391]:     </serial>
Nov 15 02:42:12 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:42:12 user nova-compute[75391]:     <video>
Nov 15 02:42:12 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:42:12 user nova-compute[75391]:     </video>
Nov 15 02:42:12 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:42:12 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:42:12 user nova-compute[75391]:     </rng>
Nov 15 02:42:12 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:42:12 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:42:12 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:42:12 user nova-compute[75391]:     </memballoon>
Nov 15 02:42:12 user nova-compute[75391]:   </devices>
Nov 15 02:42:12 user nova-compute[75391]: </domain>
Nov 15 02:42:12 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:42:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-439567025',display_name='tempest-VolumesAdminNegativeTest-server-439567025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-439567025',id=4,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMg5eEtMXdKfc7PFWzAV+AIelSB6Q9qOzaUk8uWrd3TtoLu7xrWJCMx+fxwoiekH4SGPErp3QN4SBcAbpps9eEHbjuimftpBd1SGDvpueZq3zEuNmogj4lbaz3907rsJsQ==',key_name='tempest-keypair-1446273857',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9265d1e4bccb467fbf0c738844d8735b',ramdisk_id='',reservation_id='r-9d4577kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1405215089',owner_user_name='tempest-VolumesAdminNegativeTest-1405215089-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f67781b1c37f4b7dbabdfa16d7b891d0',uuid=1ee84f40-ff95-41d2-97f6-2ef320cdf9f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ff5dedb-acb1-489b-a2dc-18a0f53f2933", "address": "fa:16:3e:2e:13:88", "network": {"id": "cb1a9e37-451d-43be-ab84-a0ebe7ab264b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500424491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9265d1e4bccb467fbf0c738844d8735b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff5dedb-ac", "ovs_interfaceid": "4ff5dedb-acb1-489b-a2dc-18a0f53f2933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Converting VIF {"id": "4ff5dedb-acb1-489b-a2dc-18a0f53f2933", "address": "fa:16:3e:2e:13:88", "network": {"id": "cb1a9e37-451d-43be-ab84-a0ebe7ab264b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500424491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9265d1e4bccb467fbf0c738844d8735b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff5dedb-ac", "ovs_interfaceid": "4ff5dedb-acb1-489b-a2dc-18a0f53f2933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:13:88,bridge_name='br-int',has_traffic_filtering=True,id=4ff5dedb-acb1-489b-a2dc-18a0f53f2933,network=Network(cb1a9e37-451d-43be-ab84-a0ebe7ab264b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff5dedb-ac') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG os_vif [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:13:88,bridge_name='br-int',has_traffic_filtering=True,id=4ff5dedb-acb1-489b-a2dc-18a0f53f2933,network=Network(cb1a9e37-451d-43be-ab84-a0ebe7ab264b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff5dedb-ac') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "492432f921f89469381625e9482c741ebcd1a5f8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.376s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61667956-9c33-55cd-90d3-e37a1d18182e', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/492432f921f89469381625e9482c741ebcd1a5f8 --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:12 user sudo[85204]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmparpeqa3o/privsep.sock
Nov 15 02:42:12 user sudo[85204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 02:42:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ff5dedb-ac, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ff5dedb-ac, col_values=(('qos', UUID('00b15d7b-98b7-429d-85c6-d73a6a82e4b1')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ff5dedb-ac, col_values=(('external_ids', {'iface-id': '4ff5dedb-acb1-489b-a2dc-18a0f53f2933', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:13:88', 'vm-uuid': '1ee84f40-ff95-41d2-97f6-2ef320cdf9f2'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:12 user nova-compute[75391]: INFO os_vif [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:13:88,bridge_name='br-int',has_traffic_filtering=True,id=4ff5dedb-acb1-489b-a2dc-18a0f53f2933,network=Network(cb1a9e37-451d-43be-ab84-a0ebe7ab264b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff5dedb-ac')
Nov 15 02:42:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG nova.network.neutron [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Successfully created port: 13f9f606-3317-4760-b79b-39199222f706 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/492432f921f89469381625e9482c741ebcd1a5f8 --force-share --output=json" returned: 0 in 0.309s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Acquiring lock "492432f921f89469381625e9482c741ebcd1a5f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "492432f921f89469381625e9482c741ebcd1a5f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/492432f921f89469381625e9482c741ebcd1a5f8 --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] No VIF found with MAC fa:16:3e:2e:13:88, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/492432f921f89469381625e9482c741ebcd1a5f8 --force-share --output=json" returned: 0 in 0.246s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/492432f921f89469381625e9482c741ebcd1a5f8,backing_fmt=raw /opt/stack/data/nova/instances/f5586645-063f-463f-b03a-16e783b1c2d5/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/492432f921f89469381625e9482c741ebcd1a5f8,backing_fmt=raw /opt/stack/data/nova/instances/f5586645-063f-463f-b03a-16e783b1c2d5/disk 1073741824" returned: 0 in 0.103s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "492432f921f89469381625e9482c741ebcd1a5f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.353s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/492432f921f89469381625e9482c741ebcd1a5f8 --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.272s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG nova.compute.manager [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.140s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:42:13 user nova-compute[75391]: INFO nova.compute.claims [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Claim successful on node user
Nov 15 02:42:13 user nova-compute[75391]: DEBUG nova.network.neutron [req-bcc07046-46b5-4b40-b96a-4b92beb8a763 req-b7fbcd4b-5bb7-41d7-9ad9-0adbf08e5fa6 service nova] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Updated VIF entry in instance network info cache for port 4ff5dedb-acb1-489b-a2dc-18a0f53f2933. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG nova.network.neutron [req-bcc07046-46b5-4b40-b96a-4b92beb8a763 req-b7fbcd4b-5bb7-41d7-9ad9-0adbf08e5fa6 service nova] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Updating instance_info_cache with network_info: [{"id": "4ff5dedb-acb1-489b-a2dc-18a0f53f2933", "address": "fa:16:3e:2e:13:88", "network": {"id": "cb1a9e37-451d-43be-ab84-a0ebe7ab264b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500424491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9265d1e4bccb467fbf0c738844d8735b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff5dedb-ac", "ovs_interfaceid": "4ff5dedb-acb1-489b-a2dc-18a0f53f2933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bcc07046-46b5-4b40-b96a-4b92beb8a763 req-b7fbcd4b-5bb7-41d7-9ad9-0adbf08e5fa6 service nova] Releasing lock "refresh_cache-1ee84f40-ff95-41d2-97f6-2ef320cdf9f2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/492432f921f89469381625e9482c741ebcd1a5f8 --force-share --output=json" returned: 0 in 0.254s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5586645-063f-463f-b03a-16e783b1c2d5/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5586645-063f-463f-b03a-16e783b1c2d5/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Successfully created port: 5f28911d-785a-4eee-aa6a-5de54d6836e5 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG nova.compute.manager [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG nova.network.neutron [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:42:13 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:42:13 user nova-compute[75391]: DEBUG nova.compute.manager [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5586645-063f-463f-b03a-16e783b1c2d5/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Cannot resize image /opt/stack/data/nova/instances/f5586645-063f-463f-b03a-16e783b1c2d5/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Ensure instance console log exists: /opt/stack/data/nova/instances/f5586645-063f-463f-b03a-16e783b1c2d5/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG nova.policy [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f040e06581748f49c31157797514edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed52241ecd1247e988041262db5831d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG nova.compute.manager [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:42:13 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Creating image(s)
Nov 15 02:42:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Acquiring lock "/opt/stack/data/nova/instances/1fc39b27-762e-4bc8-90ba-0215d65710ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lock "/opt/stack/data/nova/instances/1fc39b27-762e-4bc8-90ba-0215d65710ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lock "/opt/stack/data/nova/instances/1fc39b27-762e-4bc8-90ba-0215d65710ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.071s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:13 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.191s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.959s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG nova.compute.manager [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:42:14 user sudo[85204]: pam_unix(sudo:session): session closed for user root
Nov 15 02:42:14 user nova-compute[75391]: INFO oslo.privsep.daemon [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Spawned new privsep daemon via rootwrap
Nov 15 02:42:14 user nova-compute[75391]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 02:42:14 user nova-compute[75391]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 02:42:14 user nova-compute[75391]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 15 02:42:14 user nova-compute[75391]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85237
Nov 15 02:42:14 user nova-compute[75391]: DEBUG nova.compute.manager [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG nova.network.neutron [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:42:14 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[570b8d6c-5d2b-4de9-9197-c891cce13809]: (2,) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG nova.compute.manager [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.239s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/1fc39b27-762e-4bc8-90ba-0215d65710ec/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/1fc39b27-762e-4bc8-90ba-0215d65710ec/disk 1073741824" returned: 0 in 0.111s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.355s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG nova.policy [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1727eae8986646508dbb022ae69ab573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68070c12bf9f4c45a8c12165d571fa41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG nova.compute.manager [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:42:14 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Creating image(s)
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "/opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "/opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f23aead-28c2-4512-8c71-bdd654d33781]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:14 user nova-compute[75391]: WARNING os_brick.initiator.connectors.nvmeof [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7d3e3a-2303-4aaa-87c3-b7f180a47b05]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG nova.network.neutron [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Successfully updated port: 13f9f606-3317-4760-b79b-39199222f706 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[800fd6e3-7c77-4d44-bcf1-10777cbc4423]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.369s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1fc39b27-762e-4bc8-90ba-0215d65710ec/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc39b27-762e-4bc8-90ba-0215d65710ec/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83dafa8-63a6-43ff-9393-7a3d7b421e6f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Acquiring lock "refresh_cache-f5586645-063f-463f-b03a-16e783b1c2d5" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Acquired lock "refresh_cache-f5586645-063f-463f-b03a-16e783b1c2d5" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG nova.network.neutron [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG nova.compute.manager [req-efaf729d-7d47-483e-82be-cdb3cfe2fb3c req-106726ae-4df9-4eb9-a251-97907ef52fc0 service nova] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Received event network-changed-13f9f606-3317-4760-b79b-39199222f706 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG nova.compute.manager [req-efaf729d-7d47-483e-82be-cdb3cfe2fb3c req-106726ae-4df9-4eb9-a251-97907ef52fc0 service nova] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Refreshing instance network info cache due to event network-changed-13f9f606-3317-4760-b79b-39199222f706. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-efaf729d-7d47-483e-82be-cdb3cfe2fb3c req-106726ae-4df9-4eb9-a251-97907ef52fc0 service nova] Acquiring lock "refresh_cache-f5586645-063f-463f-b03a-16e783b1c2d5" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.335s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:42:15 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:42:15 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f892c4e-614f-4a3d-b264-3e2dbabbeab6]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG os_brick.utils [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] <== get_connector_properties: return (2730ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Updating existing volume attachment record: 239ee4cc-24f4-43ed-a2d0-38173f0b56db {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc39b27-762e-4bc8-90ba-0215d65710ec/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Cannot resize image /opt/stack/data/nova/instances/1fc39b27-762e-4bc8-90ba-0215d65710ec/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Ensure instance console log exists: /opt/stack/data/nova/instances/1fc39b27-762e-4bc8-90ba-0215d65710ec/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG nova.network.neutron [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.258s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Successfully updated port: 5f28911d-785a-4eee-aa6a-5de54d6836e5 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Acquiring lock "refresh_cache-60093cdf-015e-4c39-a514-1818a6e55385" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Acquired lock "refresh_cache-60093cdf-015e-4c39-a514-1818a6e55385" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk 1073741824" returned: 0 in 0.109s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.370s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG nova.compute.manager [req-35875b56-415f-4476-8906-8de4ccf5a015 req-c8a82977-bd4c-45ed-84bf-ba0eb21977f1 service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Received event network-changed-5f28911d-785a-4eee-aa6a-5de54d6836e5 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG nova.compute.manager [req-35875b56-415f-4476-8906-8de4ccf5a015 req-c8a82977-bd4c-45ed-84bf-ba0eb21977f1 service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Refreshing instance network info cache due to event network-changed-5f28911d-785a-4eee-aa6a-5de54d6836e5. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-35875b56-415f-4476-8906-8de4ccf5a015 req-c8a82977-bd4c-45ed-84bf-ba0eb21977f1 service nova] Acquiring lock "refresh_cache-60093cdf-015e-4c39-a514-1818a6e55385" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG nova.network.neutron [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Successfully created port: 8bff8066-85b6-4359-88db-9d717d9a04f9 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.270s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Cannot resize image /opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Ensure instance console log exists: /opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Updating instance_info_cache with network_info: [{"id": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "address": "fa:16:3e:39:41:1f", "network": {"id": "8904261f-fabd-4932-b540-dcc6be4fe56e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-180821931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e357f7331b8042adbc7e74190412daa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f28911d-78", "ovs_interfaceid": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Releasing lock "refresh_cache-60093cdf-015e-4c39-a514-1818a6e55385" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Instance network_info: |[{"id": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "address": "fa:16:3e:39:41:1f", "network": {"id": "8904261f-fabd-4932-b540-dcc6be4fe56e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-180821931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e357f7331b8042adbc7e74190412daa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f28911d-78", "ovs_interfaceid": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-35875b56-415f-4476-8906-8de4ccf5a015 req-c8a82977-bd4c-45ed-84bf-ba0eb21977f1 service nova] Acquired lock "refresh_cache-60093cdf-015e-4c39-a514-1818a6e55385" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:42:15 user nova-compute[75391]: DEBUG nova.network.neutron [req-35875b56-415f-4476-8906-8de4ccf5a015 req-c8a82977-bd4c-45ed-84bf-ba0eb21977f1 service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Refreshing network info cache for port 5f28911d-785a-4eee-aa6a-5de54d6836e5 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.network.neutron [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Updating instance_info_cache with network_info: [{"id": "13f9f606-3317-4760-b79b-39199222f706", "address": "fa:16:3e:8e:ba:2a", "network": {"id": "df52f039-d434-4640-8224-5bb1d10a7ad6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2084034119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5682e8d440c343039dc2baf1d2687863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f9f606-33", "ovs_interfaceid": "13f9f606-3317-4760-b79b-39199222f706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Releasing lock "refresh_cache-f5586645-063f-463f-b03a-16e783b1c2d5" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.compute.manager [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Instance network_info: |[{"id": "13f9f606-3317-4760-b79b-39199222f706", "address": "fa:16:3e:8e:ba:2a", "network": {"id": "df52f039-d434-4640-8224-5bb1d10a7ad6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2084034119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5682e8d440c343039dc2baf1d2687863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f9f606-33", "ovs_interfaceid": "13f9f606-3317-4760-b79b-39199222f706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-efaf729d-7d47-483e-82be-cdb3cfe2fb3c req-106726ae-4df9-4eb9-a251-97907ef52fc0 service nova] Acquired lock "refresh_cache-f5586645-063f-463f-b03a-16e783b1c2d5" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.network.neutron [req-efaf729d-7d47-483e-82be-cdb3cfe2fb3c req-106726ae-4df9-4eb9-a251-97907ef52fc0 service nova] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Refreshing network info cache for port 13f9f606-3317-4760-b79b-39199222f706 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Start _get_guest_xml network_info=[{"id": "13f9f606-3317-4760-b79b-39199222f706", "address": "fa:16:3e:8e:ba:2a", "network": {"id": "df52f039-d434-4640-8224-5bb1d10a7ad6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2084034119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5682e8d440c343039dc2baf1d2687863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f9f606-33", "ovs_interfaceid": "13f9f606-3317-4760-b79b-39199222f706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:42:00Z,direct_url=<?>,disk_format='qcow2',id=eefcf20c-f561-43b7-8801-e4dd7714fa4f,min_disk=0,min_ram=0,name='',owner='6cd480fbcd6547d892f8e26a438713a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:42:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'disk_bus': 'scsi', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'eefcf20c-f561-43b7-8801-e4dd7714fa4f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:42:16 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:42:16 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:42:00Z,direct_url=<?>,disk_format='qcow2',id=eefcf20c-f561-43b7-8801-e4dd7714fa4f,min_disk=0,min_ram=0,name='',owner='6cd480fbcd6547d892f8e26a438713a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:42:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1066264907',display_name='tempest-AttachSCSIVolumeTestJSON-server-1066264907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1066264907',id=5,image_ref='eefcf20c-f561-43b7-8801-e4dd7714fa4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOhNZgiA1XHgDO7hWI4cLLrmTuKsoqnrTcfPgOLG8ZdNu47cUifRr+V7QQR5SgUpMPLJyep+lsHUkg8euSYNV5oK/4UuazRUGrFpTrbLftJHZUMwi1RA7k6OFr8L3CN/w==',key_name='tempest-keypair-795349839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5682e8d440c343039dc2baf1d2687863',ramdisk_id='',reservation_id='r-doqjqwi8',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eefcf20c-f561-43b7-8801-e4dd7714fa4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1522481192',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1522481192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9243da3ef1d4dfa898d30615f838aa1',uuid=f5586645-063f-463f-b03a-16e783b1c2d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13f9f606-3317-4760-b79b-39199222f706", "address": "fa:16:3e:8e:ba:2a", "network": {"id": "df52f039-d434-4640-8224-5bb1d10a7ad6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2084034119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5682e8d440c343039dc2baf1d2687863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f9f606-33", "ovs_interfaceid": "13f9f606-3317-4760-b79b-39199222f706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Converting VIF {"id": "13f9f606-3317-4760-b79b-39199222f706", "address": "fa:16:3e:8e:ba:2a", "network": {"id": "df52f039-d434-4640-8224-5bb1d10a7ad6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2084034119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5682e8d440c343039dc2baf1d2687863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f9f606-33", "ovs_interfaceid": "13f9f606-3317-4760-b79b-39199222f706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ba:2a,bridge_name='br-int',has_traffic_filtering=True,id=13f9f606-3317-4760-b79b-39199222f706,network=Network(df52f039-d434-4640-8224-5bb1d10a7ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13f9f606-33') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.objects.instance [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lazy-loading 'pci_devices' on Instance uuid f5586645-063f-463f-b03a-16e783b1c2d5 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:42:16 user nova-compute[75391]:   <uuid>f5586645-063f-463f-b03a-16e783b1c2d5</uuid>
Nov 15 02:42:16 user nova-compute[75391]:   <name>instance-00000005</name>
Nov 15 02:42:16 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:42:16 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:42:16 user nova-compute[75391]:   <metadata>
Nov 15 02:42:16 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:42:16 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:42:16 user nova-compute[75391]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1066264907</nova:name>
Nov 15 02:42:16 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:42:16</nova:creationTime>
Nov 15 02:42:16 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:42:16 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:42:16 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:42:16 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:42:16 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:42:16 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:42:16 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:42:16 user nova-compute[75391]:       <nova:owner>
Nov 15 02:42:16 user nova-compute[75391]:         <nova:user uuid="a9243da3ef1d4dfa898d30615f838aa1">tempest-AttachSCSIVolumeTestJSON-1522481192-project-member</nova:user>
Nov 15 02:42:16 user nova-compute[75391]:         <nova:project uuid="5682e8d440c343039dc2baf1d2687863">tempest-AttachSCSIVolumeTestJSON-1522481192</nova:project>
Nov 15 02:42:16 user nova-compute[75391]:       </nova:owner>
Nov 15 02:42:16 user nova-compute[75391]:       <nova:root type="image" uuid="eefcf20c-f561-43b7-8801-e4dd7714fa4f"/>
Nov 15 02:42:16 user nova-compute[75391]:       <nova:ports>
Nov 15 02:42:16 user nova-compute[75391]:         <nova:port uuid="13f9f606-3317-4760-b79b-39199222f706">
Nov 15 02:42:16 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 02:42:16 user nova-compute[75391]:         </nova:port>
Nov 15 02:42:16 user nova-compute[75391]:       </nova:ports>
Nov 15 02:42:16 user nova-compute[75391]:     </nova:instance>
Nov 15 02:42:16 user nova-compute[75391]:   </metadata>
Nov 15 02:42:16 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:42:16 user nova-compute[75391]:     <system>
Nov 15 02:42:16 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:42:16 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:42:16 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:42:16 user nova-compute[75391]:       <entry name="serial">f5586645-063f-463f-b03a-16e783b1c2d5</entry>
Nov 15 02:42:16 user nova-compute[75391]:       <entry name="uuid">f5586645-063f-463f-b03a-16e783b1c2d5</entry>
Nov 15 02:42:16 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:42:16 user nova-compute[75391]:     </system>
Nov 15 02:42:16 user nova-compute[75391]:   </sysinfo>
Nov 15 02:42:16 user nova-compute[75391]:   <os>
Nov 15 02:42:16 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:42:16 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:42:16 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:42:16 user nova-compute[75391]:   </os>
Nov 15 02:42:16 user nova-compute[75391]:   <features>
Nov 15 02:42:16 user nova-compute[75391]:     <acpi/>
Nov 15 02:42:16 user nova-compute[75391]:     <apic/>
Nov 15 02:42:16 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:42:16 user nova-compute[75391]:   </features>
Nov 15 02:42:16 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:42:16 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:42:16 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:42:16 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:42:16 user nova-compute[75391]:   </clock>
Nov 15 02:42:16 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:42:16 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:42:16 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:42:16 user nova-compute[75391]:   </cpu>
Nov 15 02:42:16 user nova-compute[75391]:   <devices>
Nov 15 02:42:16 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:42:16 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:42:16 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/f5586645-063f-463f-b03a-16e783b1c2d5/disk"/>
Nov 15 02:42:16 user nova-compute[75391]:       <target dev="sda" bus="scsi"/>
Nov 15 02:42:16 user nova-compute[75391]:       <address type="drive" controller="0" unit="0"/>
Nov 15 02:42:16 user nova-compute[75391]:     </disk>
Nov 15 02:42:16 user nova-compute[75391]:     <disk type="file" device="cdrom">
Nov 15 02:42:16 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 02:42:16 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/f5586645-063f-463f-b03a-16e783b1c2d5/disk.config"/>
Nov 15 02:42:16 user nova-compute[75391]:       <target dev="sdb" bus="scsi"/>
Nov 15 02:42:16 user nova-compute[75391]:       <address type="drive" controller="0" unit="1"/>
Nov 15 02:42:16 user nova-compute[75391]:     </disk>
Nov 15 02:42:16 user nova-compute[75391]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 15 02:42:16 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:42:16 user nova-compute[75391]:       <mac address="fa:16:3e:8e:ba:2a"/>
Nov 15 02:42:16 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:42:16 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:42:16 user nova-compute[75391]:       <target dev="tap13f9f606-33"/>
Nov 15 02:42:16 user nova-compute[75391]:     </interface>
Nov 15 02:42:16 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:42:16 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/f5586645-063f-463f-b03a-16e783b1c2d5/console.log" append="off"/>
Nov 15 02:42:16 user nova-compute[75391]:     </serial>
Nov 15 02:42:16 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:42:16 user nova-compute[75391]:     <video>
Nov 15 02:42:16 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:42:16 user nova-compute[75391]:     </video>
Nov 15 02:42:16 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:42:16 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:42:16 user nova-compute[75391]:     </rng>
Nov 15 02:42:16 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:42:16 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:42:16 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:42:16 user nova-compute[75391]:     </memballoon>
Nov 15 02:42:16 user nova-compute[75391]:   </devices>
Nov 15 02:42:16 user nova-compute[75391]: </domain>
Nov 15 02:42:16 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1066264907',display_name='tempest-AttachSCSIVolumeTestJSON-server-1066264907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1066264907',id=5,image_ref='eefcf20c-f561-43b7-8801-e4dd7714fa4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOhNZgiA1XHgDO7hWI4cLLrmTuKsoqnrTcfPgOLG8ZdNu47cUifRr+V7QQR5SgUpMPLJyep+lsHUkg8euSYNV5oK/4UuazRUGrFpTrbLftJHZUMwi1RA7k6OFr8L3CN/w==',key_name='tempest-keypair-795349839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5682e8d440c343039dc2baf1d2687863',ramdisk_id='',reservation_id='r-doqjqwi8',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eefcf20c-f561-43b7-8801-e4dd7714fa4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1522481192',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1522481192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9243da3ef1d4dfa898d30615f838aa1',uuid=f5586645-063f-463f-b03a-16e783b1c2d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13f9f606-3317-4760-b79b-39199222f706", "address": "fa:16:3e:8e:ba:2a", "network": {"id": "df52f039-d434-4640-8224-5bb1d10a7ad6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2084034119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5682e8d440c343039dc2baf1d2687863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f9f606-33", "ovs_interfaceid": "13f9f606-3317-4760-b79b-39199222f706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Converting VIF {"id": "13f9f606-3317-4760-b79b-39199222f706", "address": "fa:16:3e:8e:ba:2a", "network": {"id": "df52f039-d434-4640-8224-5bb1d10a7ad6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2084034119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5682e8d440c343039dc2baf1d2687863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f9f606-33", "ovs_interfaceid": "13f9f606-3317-4760-b79b-39199222f706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ba:2a,bridge_name='br-int',has_traffic_filtering=True,id=13f9f606-3317-4760-b79b-39199222f706,network=Network(df52f039-d434-4640-8224-5bb1d10a7ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13f9f606-33') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG os_vif [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ba:2a,bridge_name='br-int',has_traffic_filtering=True,id=13f9f606-3317-4760-b79b-39199222f706,network=Network(df52f039-d434-4640-8224-5bb1d10a7ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13f9f606-33') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc592801-d826-5718-9539-a8db8f7cf571', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13f9f606-33, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap13f9f606-33, col_values=(('qos', UUID('c03f5c3c-4ef3-4134-bdd3-073dec96a35b')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap13f9f606-33, col_values=(('external_ids', {'iface-id': '13f9f606-3317-4760-b79b-39199222f706', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:ba:2a', 'vm-uuid': 'f5586645-063f-463f-b03a-16e783b1c2d5'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:16 user nova-compute[75391]: INFO os_vif [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ba:2a,bridge_name='br-int',has_traffic_filtering=True,id=13f9f606-3317-4760-b79b-39199222f706,network=Network(df52f039-d434-4640-8224-5bb1d10a7ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13f9f606-33')
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] No BDM found with device name sda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] No VIF found with MAC fa:16:3e:8e:ba:2a, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:42:16 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Using config drive
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.network.neutron [req-35875b56-415f-4476-8906-8de4ccf5a015 req-c8a82977-bd4c-45ed-84bf-ba0eb21977f1 service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Updated VIF entry in instance network info cache for port 5f28911d-785a-4eee-aa6a-5de54d6836e5. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.network.neutron [req-35875b56-415f-4476-8906-8de4ccf5a015 req-c8a82977-bd4c-45ed-84bf-ba0eb21977f1 service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Updating instance_info_cache with network_info: [{"id": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "address": "fa:16:3e:39:41:1f", "network": {"id": "8904261f-fabd-4932-b540-dcc6be4fe56e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-180821931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e357f7331b8042adbc7e74190412daa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f28911d-78", "ovs_interfaceid": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-35875b56-415f-4476-8906-8de4ccf5a015 req-c8a82977-bd4c-45ed-84bf-ba0eb21977f1 service nova] Releasing lock "refresh_cache-60093cdf-015e-4c39-a514-1818a6e55385" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:42:16 user nova-compute[75391]: DEBUG nova.network.neutron [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Successfully created port: 86eacc9d-8245-4fa1-9a0a-a0a9f396872b {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:42:17 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Creating config drive at /opt/stack/data/nova/instances/f5586645-063f-463f-b03a-16e783b1c2d5/disk.config
Nov 15 02:42:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f5586645-063f-463f-b03a-16e783b1c2d5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp82eqhmvo {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f5586645-063f-463f-b03a-16e783b1c2d5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp82eqhmvo" returned: 0 in 0.058s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:17 user nova-compute[75391]: DEBUG nova.compute.manager [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:42:17 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:42:17 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Instance spawned successfully.
Nov 15 02:42:17 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:42:17 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:17 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:17 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:17 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:17 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:17 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:17 user nova-compute[75391]: INFO nova.compute.manager [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Took 11.87 seconds to spawn the instance on the hypervisor.
Nov 15 02:42:17 user nova-compute[75391]: DEBUG nova.compute.manager [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:42:17 user nova-compute[75391]: DEBUG nova.network.neutron [req-efaf729d-7d47-483e-82be-cdb3cfe2fb3c req-106726ae-4df9-4eb9-a251-97907ef52fc0 service nova] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Updated VIF entry in instance network info cache for port 13f9f606-3317-4760-b79b-39199222f706. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:42:17 user nova-compute[75391]: DEBUG nova.network.neutron [req-efaf729d-7d47-483e-82be-cdb3cfe2fb3c req-106726ae-4df9-4eb9-a251-97907ef52fc0 service nova] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Updating instance_info_cache with network_info: [{"id": "13f9f606-3317-4760-b79b-39199222f706", "address": "fa:16:3e:8e:ba:2a", "network": {"id": "df52f039-d434-4640-8224-5bb1d10a7ad6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2084034119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5682e8d440c343039dc2baf1d2687863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f9f606-33", "ovs_interfaceid": "13f9f606-3317-4760-b79b-39199222f706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:42:17 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:17 user nova-compute[75391]: INFO nova.compute.manager [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Took 13.22 seconds to build instance.
Nov 15 02:42:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-efaf729d-7d47-483e-82be-cdb3cfe2fb3c req-106726ae-4df9-4eb9-a251-97907ef52fc0 service nova] Releasing lock "refresh_cache-f5586645-063f-463f-b03a-16e783b1c2d5" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:42:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Acquiring lock "bc5c2514-d819-4792-afde-dfedc85e8e88" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Lock "bc5c2514-d819-4792-afde-dfedc85e8e88" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-461f3350-55da-4335-b2cf-96f84b36c23d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.373s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:17 user nova-compute[75391]: DEBUG nova.compute.manager [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:42:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:17 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:42:17 user nova-compute[75391]: INFO nova.compute.claims [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Claim successful on node user
Nov 15 02:42:18 user nova-compute[75391]: DEBUG nova.network.neutron [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Successfully updated port: 8bff8066-85b6-4359-88db-9d717d9a04f9 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:42:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Acquiring lock "refresh_cache-1fc39b27-762e-4bc8-90ba-0215d65710ec" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:42:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Acquired lock "refresh_cache-1fc39b27-762e-4bc8-90ba-0215d65710ec" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:42:18 user nova-compute[75391]: DEBUG nova.network.neutron [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:42:18 user nova-compute[75391]: DEBUG nova.compute.manager [req-0a3e5e22-5d5c-4ab0-b7c9-e13688996d74 req-3483f873-e5c4-47d0-9fd7-b16fcaa5f70b service nova] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Received event network-changed-8bff8066-85b6-4359-88db-9d717d9a04f9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:18 user nova-compute[75391]: DEBUG nova.compute.manager [req-0a3e5e22-5d5c-4ab0-b7c9-e13688996d74 req-3483f873-e5c4-47d0-9fd7-b16fcaa5f70b service nova] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Refreshing instance network info cache due to event network-changed-8bff8066-85b6-4359-88db-9d717d9a04f9. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:42:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0a3e5e22-5d5c-4ab0-b7c9-e13688996d74 req-3483f873-e5c4-47d0-9fd7-b16fcaa5f70b service nova] Acquiring lock "refresh_cache-1fc39b27-762e-4bc8-90ba-0215d65710ec" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:42:18 user nova-compute[75391]: DEBUG nova.network.neutron [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:42:18 user nova-compute[75391]: DEBUG nova.compute.manager [req-5287d214-c26d-4bae-9d52-e1886f600d4d req-a5dfecda-7c4b-47a4-993f-4c562db9dac1 service nova] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Received event network-vif-plugged-dc4f904f-dd76-4f25-b9e6-41cc42493911 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5287d214-c26d-4bae-9d52-e1886f600d4d req-a5dfecda-7c4b-47a4-993f-4c562db9dac1 service nova] Acquiring lock "9744c8a1-046e-4a00-92e0-92ebb3275ea9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5287d214-c26d-4bae-9d52-e1886f600d4d req-a5dfecda-7c4b-47a4-993f-4c562db9dac1 service nova] Lock "9744c8a1-046e-4a00-92e0-92ebb3275ea9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5287d214-c26d-4bae-9d52-e1886f600d4d req-a5dfecda-7c4b-47a4-993f-4c562db9dac1 service nova] Lock "9744c8a1-046e-4a00-92e0-92ebb3275ea9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:18 user nova-compute[75391]: DEBUG nova.compute.manager [req-5287d214-c26d-4bae-9d52-e1886f600d4d req-a5dfecda-7c4b-47a4-993f-4c562db9dac1 service nova] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] No waiting events found dispatching network-vif-plugged-dc4f904f-dd76-4f25-b9e6-41cc42493911 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:42:18 user nova-compute[75391]: WARNING nova.compute.manager [req-5287d214-c26d-4bae-9d52-e1886f600d4d req-a5dfecda-7c4b-47a4-993f-4c562db9dac1 service nova] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Received unexpected event network-vif-plugged-dc4f904f-dd76-4f25-b9e6-41cc42493911 for instance with vm_state active and task_state None.
Nov 15 02:42:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:18 user nova-compute[75391]: DEBUG nova.network.neutron [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Successfully updated port: 86eacc9d-8245-4fa1-9a0a-a0a9f396872b {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:42:18 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:42:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Acquiring lock "refresh_cache-bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:42:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Acquired lock "refresh_cache-bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:42:18 user nova-compute[75391]: DEBUG nova.network.neutron [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:42:18 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:42:18 user nova-compute[75391]: DEBUG nova.network.neutron [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Updating instance_info_cache with network_info: [{"id": "8bff8066-85b6-4359-88db-9d717d9a04f9", "address": "fa:16:3e:97:51:45", "network": {"id": "092f8c09-7149-4498-909e-88abbcd706c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-926291745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed52241ecd1247e988041262db5831d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bff8066-85", "ovs_interfaceid": "8bff8066-85b6-4359-88db-9d717d9a04f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:42:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Releasing lock "refresh_cache-1fc39b27-762e-4bc8-90ba-0215d65710ec" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:42:18 user nova-compute[75391]: DEBUG nova.compute.manager [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Instance network_info: |[{"id": "8bff8066-85b6-4359-88db-9d717d9a04f9", "address": "fa:16:3e:97:51:45", "network": {"id": "092f8c09-7149-4498-909e-88abbcd706c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-926291745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed52241ecd1247e988041262db5831d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bff8066-85", "ovs_interfaceid": "8bff8066-85b6-4359-88db-9d717d9a04f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:42:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0a3e5e22-5d5c-4ab0-b7c9-e13688996d74 req-3483f873-e5c4-47d0-9fd7-b16fcaa5f70b service nova] Acquired lock "refresh_cache-1fc39b27-762e-4bc8-90ba-0215d65710ec" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:42:18 user nova-compute[75391]: DEBUG nova.network.neutron [req-0a3e5e22-5d5c-4ab0-b7c9-e13688996d74 req-3483f873-e5c4-47d0-9fd7-b16fcaa5f70b service nova] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Refreshing network info cache for port 8bff8066-85b6-4359-88db-9d717d9a04f9 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:42:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Start _get_guest_xml network_info=[{"id": "8bff8066-85b6-4359-88db-9d717d9a04f9", "address": "fa:16:3e:97:51:45", "network": {"id": "092f8c09-7149-4498-909e-88abbcd706c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-926291745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed52241ecd1247e988041262db5831d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bff8066-85", "ovs_interfaceid": "8bff8066-85b6-4359-88db-9d717d9a04f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:42:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.125s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:18 user nova-compute[75391]: DEBUG nova.compute.manager [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:42:18 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:42:18 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:42:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1818367107',display_name='tempest-TestVolumeSwap-server-1818367107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1818367107',id=8,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+1fld5RMq2vr/o5W+WlE9SaD04HzO69tfF9wsLsrNKbEFDCtJ3j4dPXhHiiZPeEbNzVGKrC9tPeaaVk1ukwfyJtz3qBt3ujZk6GTQA545wRDCgOfqs5gji9YE8diMoIw==',key_name='tempest-keypair-468908295',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed52241ecd1247e988041262db5831d8',ramdisk_id='',reservation_id='r-vtbaozql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1960139601',owner_user_name='tempest-TestVolumeSwap-1960139601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f040e06581748f49c31157797514edd',uuid=1fc39b27-762e-4bc8-90ba-0215d65710ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bff8066-85b6-4359-88db-9d717d9a04f9", "address": "fa:16:3e:97:51:45", "network": {"id": "092f8c09-7149-4498-909e-88abbcd706c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-926291745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed52241ecd1247e988041262db5831d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bff8066-85", "ovs_interfaceid": "8bff8066-85b6-4359-88db-9d717d9a04f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Converting VIF {"id": "8bff8066-85b6-4359-88db-9d717d9a04f9", "address": "fa:16:3e:97:51:45", "network": {"id": "092f8c09-7149-4498-909e-88abbcd706c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-926291745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed52241ecd1247e988041262db5831d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bff8066-85", "ovs_interfaceid": "8bff8066-85b6-4359-88db-9d717d9a04f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:51:45,bridge_name='br-int',has_traffic_filtering=True,id=8bff8066-85b6-4359-88db-9d717d9a04f9,network=Network(092f8c09-7149-4498-909e-88abbcd706c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bff8066-85') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.objects.instance [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fc39b27-762e-4bc8-90ba-0215d65710ec {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.network.neutron [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:42:19 user nova-compute[75391]:   <uuid>1fc39b27-762e-4bc8-90ba-0215d65710ec</uuid>
Nov 15 02:42:19 user nova-compute[75391]:   <name>instance-00000008</name>
Nov 15 02:42:19 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:42:19 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:42:19 user nova-compute[75391]:   <metadata>
Nov 15 02:42:19 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:42:19 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:42:19 user nova-compute[75391]:       <nova:name>tempest-TestVolumeSwap-server-1818367107</nova:name>
Nov 15 02:42:19 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:42:18</nova:creationTime>
Nov 15 02:42:19 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:42:19 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:42:19 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:42:19 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:42:19 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:42:19 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:42:19 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:42:19 user nova-compute[75391]:       <nova:owner>
Nov 15 02:42:19 user nova-compute[75391]:         <nova:user uuid="8f040e06581748f49c31157797514edd">tempest-TestVolumeSwap-1960139601-project-member</nova:user>
Nov 15 02:42:19 user nova-compute[75391]:         <nova:project uuid="ed52241ecd1247e988041262db5831d8">tempest-TestVolumeSwap-1960139601</nova:project>
Nov 15 02:42:19 user nova-compute[75391]:       </nova:owner>
Nov 15 02:42:19 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:42:19 user nova-compute[75391]:       <nova:ports>
Nov 15 02:42:19 user nova-compute[75391]:         <nova:port uuid="8bff8066-85b6-4359-88db-9d717d9a04f9">
Nov 15 02:42:19 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 02:42:19 user nova-compute[75391]:         </nova:port>
Nov 15 02:42:19 user nova-compute[75391]:       </nova:ports>
Nov 15 02:42:19 user nova-compute[75391]:     </nova:instance>
Nov 15 02:42:19 user nova-compute[75391]:   </metadata>
Nov 15 02:42:19 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:42:19 user nova-compute[75391]:     <system>
Nov 15 02:42:19 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:42:19 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:42:19 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:42:19 user nova-compute[75391]:       <entry name="serial">1fc39b27-762e-4bc8-90ba-0215d65710ec</entry>
Nov 15 02:42:19 user nova-compute[75391]:       <entry name="uuid">1fc39b27-762e-4bc8-90ba-0215d65710ec</entry>
Nov 15 02:42:19 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:42:19 user nova-compute[75391]:     </system>
Nov 15 02:42:19 user nova-compute[75391]:   </sysinfo>
Nov 15 02:42:19 user nova-compute[75391]:   <os>
Nov 15 02:42:19 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:42:19 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:42:19 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:42:19 user nova-compute[75391]:   </os>
Nov 15 02:42:19 user nova-compute[75391]:   <features>
Nov 15 02:42:19 user nova-compute[75391]:     <acpi/>
Nov 15 02:42:19 user nova-compute[75391]:     <apic/>
Nov 15 02:42:19 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:42:19 user nova-compute[75391]:   </features>
Nov 15 02:42:19 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:42:19 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:42:19 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:42:19 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:42:19 user nova-compute[75391]:   </clock>
Nov 15 02:42:19 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:42:19 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:42:19 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:42:19 user nova-compute[75391]:   </cpu>
Nov 15 02:42:19 user nova-compute[75391]:   <devices>
Nov 15 02:42:19 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:42:19 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:42:19 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/1fc39b27-762e-4bc8-90ba-0215d65710ec/disk"/>
Nov 15 02:42:19 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:42:19 user nova-compute[75391]:     </disk>
Nov 15 02:42:19 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:42:19 user nova-compute[75391]:       <mac address="fa:16:3e:97:51:45"/>
Nov 15 02:42:19 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:42:19 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:42:19 user nova-compute[75391]:       <target dev="tap8bff8066-85"/>
Nov 15 02:42:19 user nova-compute[75391]:     </interface>
Nov 15 02:42:19 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:42:19 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/1fc39b27-762e-4bc8-90ba-0215d65710ec/console.log" append="off"/>
Nov 15 02:42:19 user nova-compute[75391]:     </serial>
Nov 15 02:42:19 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:42:19 user nova-compute[75391]:     <video>
Nov 15 02:42:19 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:42:19 user nova-compute[75391]:     </video>
Nov 15 02:42:19 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:42:19 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:42:19 user nova-compute[75391]:     </rng>
Nov 15 02:42:19 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:42:19 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:42:19 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:42:19 user nova-compute[75391]:     </memballoon>
Nov 15 02:42:19 user nova-compute[75391]:   </devices>
Nov 15 02:42:19 user nova-compute[75391]: </domain>
Nov 15 02:42:19 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:42:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1818367107',display_name='tempest-TestVolumeSwap-server-1818367107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1818367107',id=8,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+1fld5RMq2vr/o5W+WlE9SaD04HzO69tfF9wsLsrNKbEFDCtJ3j4dPXhHiiZPeEbNzVGKrC9tPeaaVk1ukwfyJtz3qBt3ujZk6GTQA545wRDCgOfqs5gji9YE8diMoIw==',key_name='tempest-keypair-468908295',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed52241ecd1247e988041262db5831d8',ramdisk_id='',reservation_id='r-vtbaozql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1960139601',owner_user_name='tempest-TestVolumeSwap-1960139601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f040e06581748f49c31157797514edd',uuid=1fc39b27-762e-4bc8-90ba-0215d65710ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bff8066-85b6-4359-88db-9d717d9a04f9", "address": "fa:16:3e:97:51:45", "network": {"id": "092f8c09-7149-4498-909e-88abbcd706c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-926291745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed52241ecd1247e988041262db5831d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bff8066-85", "ovs_interfaceid": "8bff8066-85b6-4359-88db-9d717d9a04f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Converting VIF {"id": "8bff8066-85b6-4359-88db-9d717d9a04f9", "address": "fa:16:3e:97:51:45", "network": {"id": "092f8c09-7149-4498-909e-88abbcd706c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-926291745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed52241ecd1247e988041262db5831d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bff8066-85", "ovs_interfaceid": "8bff8066-85b6-4359-88db-9d717d9a04f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:51:45,bridge_name='br-int',has_traffic_filtering=True,id=8bff8066-85b6-4359-88db-9d717d9a04f9,network=Network(092f8c09-7149-4498-909e-88abbcd706c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bff8066-85') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG os_vif [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:51:45,bridge_name='br-int',has_traffic_filtering=True,id=8bff8066-85b6-4359-88db-9d717d9a04f9,network=Network(092f8c09-7149-4498-909e-88abbcd706c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bff8066-85') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.compute.manager [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.network.neutron [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ded752ad-776d-5a52-aee6-7496c9cf9b86', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8bff8066-85, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8bff8066-85, col_values=(('qos', UUID('7fe6c12f-dff2-4ff2-8c51-ba27e11a82cc')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8bff8066-85, col_values=(('external_ids', {'iface-id': '8bff8066-85b6-4359-88db-9d717d9a04f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:51:45', 'vm-uuid': '1fc39b27-762e-4bc8-90ba-0215d65710ec'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:19 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:42:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:19 user nova-compute[75391]: INFO os_vif [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:51:45,bridge_name='br-int',has_traffic_filtering=True,id=8bff8066-85b6-4359-88db-9d717d9a04f9,network=Network(092f8c09-7149-4498-909e-88abbcd706c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bff8066-85')
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.compute.manager [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] No VIF found with MAC fa:16:3e:97:51:45, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.policy [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd752791054974d108ceabe28f5db090b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09abd2ac842143d59109cf7bcccb9dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.compute.manager [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:42:19 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Creating image(s)
Nov 15 02:42:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc5c2514-d819-4792-afde-dfedc85e8e88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Lock "/opt/stack/data/nova/instances/bc5c2514-d819-4792-afde-dfedc85e8e88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Lock "/opt/stack/data/nova/instances/bc5c2514-d819-4792-afde-dfedc85e8e88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.420s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.network.neutron [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Updating instance_info_cache with network_info: [{"id": "86eacc9d-8245-4fa1-9a0a-a0a9f396872b", "address": "fa:16:3e:08:66:14", "network": {"id": "c36f20d0-0398-4c34-b593-d9610a7b5fc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-689770940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68070c12bf9f4c45a8c12165d571fa41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eacc9d-82", "ovs_interfaceid": "86eacc9d-8245-4fa1-9a0a-a0a9f396872b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Releasing lock "refresh_cache-bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.compute.manager [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Instance network_info: |[{"id": "86eacc9d-8245-4fa1-9a0a-a0a9f396872b", "address": "fa:16:3e:08:66:14", "network": {"id": "c36f20d0-0398-4c34-b593-d9610a7b5fc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-689770940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68070c12bf9f4c45a8c12165d571fa41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eacc9d-82", "ovs_interfaceid": "86eacc9d-8245-4fa1-9a0a-a0a9f396872b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Start _get_guest_xml network_info=[{"id": "86eacc9d-8245-4fa1-9a0a-a0a9f396872b", "address": "fa:16:3e:08:66:14", "network": {"id": "c36f20d0-0398-4c34-b593-d9610a7b5fc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-689770940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68070c12bf9f4c45a8c12165d571fa41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eacc9d-82", "ovs_interfaceid": "86eacc9d-8245-4fa1-9a0a-a0a9f396872b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.244s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/bc5c2514-d819-4792-afde-dfedc85e8e88/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/bc5c2514-d819-4792-afde-dfedc85e8e88/disk 1073741824" returned: 0 in 0.065s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:20 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:42:20 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-84898992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-84898992',id=7,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjGjAlXtIFwyK48Tn0rWDvwO+CMiqK5nwES7Ozr0xqfWpvP+GLtsNTghKrGqtv5RFJtUL1Xov3deHDY6XnlkjWriT5bcxPdE96duFESi6cETl7FauYVa7ChUe8ZPLW7IQ==',key_name='tempest-keypair-1251809303',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68070c12bf9f4c45a8c12165d571fa41',ramdisk_id='',reservation_id='r-j0qi94j3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-382223691',owner_user_name='tempest-TaggedAttachmentsTest-382223691-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1727eae8986646508dbb022ae69ab573',uuid=bb472aa5-47dd-48d6-8e9f-e179afd1d8ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86eacc9d-8245-4fa1-9a0a-a0a9f396872b", "address": "fa:16:3e:08:66:14", "network": {"id": "c36f20d0-0398-4c34-b593-d9610a7b5fc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-689770940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68070c12bf9f4c45a8c12165d571fa41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eacc9d-82", "ovs_interfaceid": "86eacc9d-8245-4fa1-9a0a-a0a9f396872b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Converting VIF {"id": "86eacc9d-8245-4fa1-9a0a-a0a9f396872b", "address": "fa:16:3e:08:66:14", "network": {"id": "c36f20d0-0398-4c34-b593-d9610a7b5fc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-689770940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68070c12bf9f4c45a8c12165d571fa41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eacc9d-82", "ovs_interfaceid": "86eacc9d-8245-4fa1-9a0a-a0a9f396872b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:66:14,bridge_name='br-int',has_traffic_filtering=True,id=86eacc9d-8245-4fa1-9a0a-a0a9f396872b,network=Network(c36f20d0-0398-4c34-b593-d9610a7b5fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86eacc9d-82') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.objects.instance [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lazy-loading 'pci_devices' on Instance uuid bb472aa5-47dd-48d6-8e9f-e179afd1d8ec {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.network.neutron [req-0a3e5e22-5d5c-4ab0-b7c9-e13688996d74 req-3483f873-e5c4-47d0-9fd7-b16fcaa5f70b service nova] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Updated VIF entry in instance network info cache for port 8bff8066-85b6-4359-88db-9d717d9a04f9. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.network.neutron [req-0a3e5e22-5d5c-4ab0-b7c9-e13688996d74 req-3483f873-e5c4-47d0-9fd7-b16fcaa5f70b service nova] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Updating instance_info_cache with network_info: [{"id": "8bff8066-85b6-4359-88db-9d717d9a04f9", "address": "fa:16:3e:97:51:45", "network": {"id": "092f8c09-7149-4498-909e-88abbcd706c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-926291745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed52241ecd1247e988041262db5831d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bff8066-85", "ovs_interfaceid": "8bff8066-85b6-4359-88db-9d717d9a04f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.compute.manager [req-30662b02-eb77-40cd-bc3b-da1d4c9b5aee req-797efb59-86b3-403a-b7ca-947886d6e9bf service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Received event network-changed-86eacc9d-8245-4fa1-9a0a-a0a9f396872b {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.compute.manager [req-30662b02-eb77-40cd-bc3b-da1d4c9b5aee req-797efb59-86b3-403a-b7ca-947886d6e9bf service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Refreshing instance network info cache due to event network-changed-86eacc9d-8245-4fa1-9a0a-a0a9f396872b. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-30662b02-eb77-40cd-bc3b-da1d4c9b5aee req-797efb59-86b3-403a-b7ca-947886d6e9bf service nova] Acquiring lock "refresh_cache-bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-30662b02-eb77-40cd-bc3b-da1d4c9b5aee req-797efb59-86b3-403a-b7ca-947886d6e9bf service nova] Acquired lock "refresh_cache-bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.network.neutron [req-30662b02-eb77-40cd-bc3b-da1d4c9b5aee req-797efb59-86b3-403a-b7ca-947886d6e9bf service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Refreshing network info cache for port 86eacc9d-8245-4fa1-9a0a-a0a9f396872b {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0a3e5e22-5d5c-4ab0-b7c9-e13688996d74 req-3483f873-e5c4-47d0-9fd7-b16fcaa5f70b service nova] Releasing lock "refresh_cache-1fc39b27-762e-4bc8-90ba-0215d65710ec" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:42:20 user nova-compute[75391]:   <uuid>bb472aa5-47dd-48d6-8e9f-e179afd1d8ec</uuid>
Nov 15 02:42:20 user nova-compute[75391]:   <name>instance-00000007</name>
Nov 15 02:42:20 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:42:20 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:42:20 user nova-compute[75391]:   <metadata>
Nov 15 02:42:20 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:42:20 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:42:20 user nova-compute[75391]:       <nova:name>tempest-device-tagging-server-84898992</nova:name>
Nov 15 02:42:20 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:42:20</nova:creationTime>
Nov 15 02:42:20 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:42:20 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:42:20 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:42:20 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:42:20 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:42:20 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:42:20 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:42:20 user nova-compute[75391]:       <nova:owner>
Nov 15 02:42:20 user nova-compute[75391]:         <nova:user uuid="1727eae8986646508dbb022ae69ab573">tempest-TaggedAttachmentsTest-382223691-project-member</nova:user>
Nov 15 02:42:20 user nova-compute[75391]:         <nova:project uuid="68070c12bf9f4c45a8c12165d571fa41">tempest-TaggedAttachmentsTest-382223691</nova:project>
Nov 15 02:42:20 user nova-compute[75391]:       </nova:owner>
Nov 15 02:42:20 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:42:20 user nova-compute[75391]:       <nova:ports>
Nov 15 02:42:20 user nova-compute[75391]:         <nova:port uuid="86eacc9d-8245-4fa1-9a0a-a0a9f396872b">
Nov 15 02:42:20 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 02:42:20 user nova-compute[75391]:         </nova:port>
Nov 15 02:42:20 user nova-compute[75391]:       </nova:ports>
Nov 15 02:42:20 user nova-compute[75391]:     </nova:instance>
Nov 15 02:42:20 user nova-compute[75391]:   </metadata>
Nov 15 02:42:20 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:42:20 user nova-compute[75391]:     <system>
Nov 15 02:42:20 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:42:20 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:42:20 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:42:20 user nova-compute[75391]:       <entry name="serial">bb472aa5-47dd-48d6-8e9f-e179afd1d8ec</entry>
Nov 15 02:42:20 user nova-compute[75391]:       <entry name="uuid">bb472aa5-47dd-48d6-8e9f-e179afd1d8ec</entry>
Nov 15 02:42:20 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:42:20 user nova-compute[75391]:     </system>
Nov 15 02:42:20 user nova-compute[75391]:   </sysinfo>
Nov 15 02:42:20 user nova-compute[75391]:   <os>
Nov 15 02:42:20 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:42:20 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:42:20 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:42:20 user nova-compute[75391]:   </os>
Nov 15 02:42:20 user nova-compute[75391]:   <features>
Nov 15 02:42:20 user nova-compute[75391]:     <acpi/>
Nov 15 02:42:20 user nova-compute[75391]:     <apic/>
Nov 15 02:42:20 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:42:20 user nova-compute[75391]:   </features>
Nov 15 02:42:20 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:42:20 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:42:20 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:42:20 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:42:20 user nova-compute[75391]:   </clock>
Nov 15 02:42:20 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:42:20 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:42:20 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:42:20 user nova-compute[75391]:   </cpu>
Nov 15 02:42:20 user nova-compute[75391]:   <devices>
Nov 15 02:42:20 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:42:20 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:42:20 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk"/>
Nov 15 02:42:20 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:42:20 user nova-compute[75391]:     </disk>
Nov 15 02:42:20 user nova-compute[75391]:     <disk type="file" device="cdrom">
Nov 15 02:42:20 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 02:42:20 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk.config"/>
Nov 15 02:42:20 user nova-compute[75391]:       <target dev="hda" bus="ide"/>
Nov 15 02:42:20 user nova-compute[75391]:     </disk>
Nov 15 02:42:20 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:42:20 user nova-compute[75391]:       <mac address="fa:16:3e:08:66:14"/>
Nov 15 02:42:20 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:42:20 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:42:20 user nova-compute[75391]:       <target dev="tap86eacc9d-82"/>
Nov 15 02:42:20 user nova-compute[75391]:     </interface>
Nov 15 02:42:20 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:42:20 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/console.log" append="off"/>
Nov 15 02:42:20 user nova-compute[75391]:     </serial>
Nov 15 02:42:20 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:42:20 user nova-compute[75391]:     <video>
Nov 15 02:42:20 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:42:20 user nova-compute[75391]:     </video>
Nov 15 02:42:20 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:42:20 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:42:20 user nova-compute[75391]:     </rng>
Nov 15 02:42:20 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:42:20 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:42:20 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:42:20 user nova-compute[75391]:     </memballoon>
Nov 15 02:42:20 user nova-compute[75391]:   </devices>
Nov 15 02:42:20 user nova-compute[75391]: </domain>
Nov 15 02:42:20 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-84898992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-84898992',id=7,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjGjAlXtIFwyK48Tn0rWDvwO+CMiqK5nwES7Ozr0xqfWpvP+GLtsNTghKrGqtv5RFJtUL1Xov3deHDY6XnlkjWriT5bcxPdE96duFESi6cETl7FauYVa7ChUe8ZPLW7IQ==',key_name='tempest-keypair-1251809303',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68070c12bf9f4c45a8c12165d571fa41',ramdisk_id='',reservation_id='r-j0qi94j3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-382223691',owner_user_name='tempest-TaggedAttachmentsTest-382223691-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1727eae8986646508dbb022ae69ab573',uuid=bb472aa5-47dd-48d6-8e9f-e179afd1d8ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86eacc9d-8245-4fa1-9a0a-a0a9f396872b", "address": "fa:16:3e:08:66:14", "network": {"id": "c36f20d0-0398-4c34-b593-d9610a7b5fc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-689770940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68070c12bf9f4c45a8c12165d571fa41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eacc9d-82", "ovs_interfaceid": "86eacc9d-8245-4fa1-9a0a-a0a9f396872b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Converting VIF {"id": "86eacc9d-8245-4fa1-9a0a-a0a9f396872b", "address": "fa:16:3e:08:66:14", "network": {"id": "c36f20d0-0398-4c34-b593-d9610a7b5fc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-689770940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68070c12bf9f4c45a8c12165d571fa41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eacc9d-82", "ovs_interfaceid": "86eacc9d-8245-4fa1-9a0a-a0a9f396872b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:66:14,bridge_name='br-int',has_traffic_filtering=True,id=86eacc9d-8245-4fa1-9a0a-a0a9f396872b,network=Network(c36f20d0-0398-4c34-b593-d9610a7b5fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86eacc9d-82') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG os_vif [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:66:14,bridge_name='br-int',has_traffic_filtering=True,id=86eacc9d-8245-4fa1-9a0a-a0a9f396872b,network=Network(c36f20d0-0398-4c34-b593-d9610a7b5fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86eacc9d-82') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46d9e562-4970-57bd-9c99-94ae3e2523ef', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.287s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc5c2514-d819-4792-afde-dfedc85e8e88/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5c2514-d819-4792-afde-dfedc85e8e88/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86eacc9d-82, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86eacc9d-82, col_values=(('qos', UUID('b13614a8-c36c-4de6-959c-e592eabcaf52')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86eacc9d-82, col_values=(('external_ids', {'iface-id': '86eacc9d-8245-4fa1-9a0a-a0a9f396872b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:66:14', 'vm-uuid': 'bb472aa5-47dd-48d6-8e9f-e179afd1d8ec'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.compute.manager [req-7868b0cb-9c22-43f5-8074-7ffa9be5f755 req-908f1790-96b3-4718-a2be-a9be9981a60b service nova] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Received event network-vif-plugged-dc4f904f-dd76-4f25-b9e6-41cc42493911 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7868b0cb-9c22-43f5-8074-7ffa9be5f755 req-908f1790-96b3-4718-a2be-a9be9981a60b service nova] Acquiring lock "9744c8a1-046e-4a00-92e0-92ebb3275ea9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7868b0cb-9c22-43f5-8074-7ffa9be5f755 req-908f1790-96b3-4718-a2be-a9be9981a60b service nova] Lock "9744c8a1-046e-4a00-92e0-92ebb3275ea9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7868b0cb-9c22-43f5-8074-7ffa9be5f755 req-908f1790-96b3-4718-a2be-a9be9981a60b service nova] Lock "9744c8a1-046e-4a00-92e0-92ebb3275ea9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.compute.manager [req-7868b0cb-9c22-43f5-8074-7ffa9be5f755 req-908f1790-96b3-4718-a2be-a9be9981a60b service nova] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] No waiting events found dispatching network-vif-plugged-dc4f904f-dd76-4f25-b9e6-41cc42493911 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:42:20 user nova-compute[75391]: WARNING nova.compute.manager [req-7868b0cb-9c22-43f5-8074-7ffa9be5f755 req-908f1790-96b3-4718-a2be-a9be9981a60b service nova] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Received unexpected event network-vif-plugged-dc4f904f-dd76-4f25-b9e6-41cc42493911 for instance with vm_state active and task_state None.
Nov 15 02:42:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:20 user nova-compute[75391]: INFO os_vif [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:66:14,bridge_name='br-int',has_traffic_filtering=True,id=86eacc9d-8245-4fa1-9a0a-a0a9f396872b,network=Network(c36f20d0-0398-4c34-b593-d9610a7b5fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86eacc9d-82')
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] No BDM found with device name hda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] No VIF found with MAC fa:16:3e:08:66:14, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:42:20 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Using config drive
Nov 15 02:42:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5c2514-d819-4792-afde-dfedc85e8e88/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Cannot resize image /opt/stack/data/nova/instances/bc5c2514-d819-4792-afde-dfedc85e8e88/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Ensure instance console log exists: /opt/stack/data/nova/instances/bc5c2514-d819-4792-afde-dfedc85e8e88/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:21 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Creating config drive at /opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk.config
Nov 15 02:42:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptfigfhr4 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:21 user nova-compute[75391]: DEBUG nova.network.neutron [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Successfully created port: 499cebaa-a6e6-4908-b5c5-1bc2b199b439 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:42:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptfigfhr4" returned: 0 in 0.089s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:21 user nova-compute[75391]: DEBUG nova.compute.manager [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:42:21 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:42:21 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Instance spawned successfully.
Nov 15 02:42:21 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:21 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:42:21 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:21 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:21 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:21 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:21 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:21 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:21 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:21 user nova-compute[75391]: INFO nova.compute.manager [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Took 10.90 seconds to spawn the instance on the hypervisor.
Nov 15 02:42:21 user nova-compute[75391]: DEBUG nova.compute.manager [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:42:21 user nova-compute[75391]: DEBUG nova.network.neutron [req-30662b02-eb77-40cd-bc3b-da1d4c9b5aee req-797efb59-86b3-403a-b7ca-947886d6e9bf service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Updated VIF entry in instance network info cache for port 86eacc9d-8245-4fa1-9a0a-a0a9f396872b. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:42:21 user nova-compute[75391]: DEBUG nova.network.neutron [req-30662b02-eb77-40cd-bc3b-da1d4c9b5aee req-797efb59-86b3-403a-b7ca-947886d6e9bf service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Updating instance_info_cache with network_info: [{"id": "86eacc9d-8245-4fa1-9a0a-a0a9f396872b", "address": "fa:16:3e:08:66:14", "network": {"id": "c36f20d0-0398-4c34-b593-d9610a7b5fc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-689770940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68070c12bf9f4c45a8c12165d571fa41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eacc9d-82", "ovs_interfaceid": "86eacc9d-8245-4fa1-9a0a-a0a9f396872b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-30662b02-eb77-40cd-bc3b-da1d4c9b5aee req-797efb59-86b3-403a-b7ca-947886d6e9bf service nova] Releasing lock "refresh_cache-bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:42:22 user nova-compute[75391]: INFO nova.compute.manager [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Took 12.48 seconds to build instance.
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-43d0dd3b-44b7-4e5a-b428-f0c0358b1297 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "f5586645-063f-463f-b03a-16e783b1c2d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.643s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:42:22 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Creating image(s)
Nov 15 02:42:22 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Did not create local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Ensure instance console log exists: /opt/stack/data/nova/instances/60093cdf-015e-4c39-a514-1818a6e55385/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Start _get_guest_xml network_info=[{"id": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "address": "fa:16:3e:39:41:1f", "network": {"id": "8904261f-fabd-4932-b540-dcc6be4fe56e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-180821931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e357f7331b8042adbc7e74190412daa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f28911d-78", "ovs_interfaceid": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '239ee4cc-24f4-43ed-a2d0-38173f0b56db', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQIuJiSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '60093cdf-015e-4c39-a514-1818a6e55385', 'attached_at': '', 'detached_at': '', 'volume_id': '7c9e2931-9e6c-42a6-9b3c-b1854f32cb40', 'serial': '7c9e2931-9e6c-42a6-9b3c-b1854f32cb40'}, 'volume_type': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:42:22 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:42:22 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:42:22 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG os_brick.initiator.connector [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Factory for ISCSI on None {{(pid=75391) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.009s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQIuJiSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:42:22 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:42:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:42:22 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:42:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:42:22 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[432e6fca-eb54-4b2d-b7c6-74aa8588e3e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:42:22 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e43e796-50d0-4d60-875d-4c7efd1b7918]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40] added
Nov 15 02:42:22 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[304b07a7-3883-4d98-b4a8-1cc7a6a4459f]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5ca09d-6462-46d8-9f4e-c06c4e3ac77a]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tQIuJiSX {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tQIuJiSX" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cff4d0-8681-48fc-8f3f-86ada4e40707]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tQIuJiSX'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG nova.network.neutron [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Successfully updated port: 499cebaa-a6e6-4908-b5c5-1bc2b199b439 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84729c4-4b57-4ac1-9b42-20b8fb1d3274]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Acquiring lock "refresh_cache-bc5c2514-d819-4792-afde-dfedc85e8e88" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Acquired lock "refresh_cache-bc5c2514-d819-4792-afde-dfedc85e8e88" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG nova.network.neutron [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[277c2083-009e-4406-8f96-19e47a42a593]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 02:42:22 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 02:42:22 user nova-compute[75391]:  {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:42:22 user nova-compute[75391]: WARNING os_brick.initiator.connectors.iscsi [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 02:42:22 user nova-compute[75391]: 
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG nova.compute.manager [req-3cde6944-ccb1-4586-8171-38b83b05fbfb req-3f9d51e2-cff4-4ffe-97d1-845a9110ab04 service nova] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Received event network-changed-499cebaa-a6e6-4908-b5c5-1bc2b199b439 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG nova.compute.manager [req-3cde6944-ccb1-4586-8171-38b83b05fbfb req-3f9d51e2-cff4-4ffe-97d1-845a9110ab04 service nova] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Refreshing instance network info cache due to event network-changed-499cebaa-a6e6-4908-b5c5-1bc2b199b439. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3cde6944-ccb1-4586-8171-38b83b05fbfb req-3f9d51e2-cff4-4ffe-97d1-845a9110ab04 service nova] Acquiring lock "refresh_cache-bc5c2514-d819-4792-afde-dfedc85e8e88" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c2e106-9340-43c9-9b84-c2939d05a838]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40, portal: 172.16.0.220,3260]
Nov 15 02:42:22 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40, portal: 172.16.0.220,3260] successful.
Nov 15 02:42:22 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.038s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2f8d34-ee76-4a5e-bfeb-db1bb483019a]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG nova.network.neutron [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[642c5701-9c09-4b1c-a474-52fbe6bba55c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:42:22 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:42:22 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d8a72c-e22f-4ca9-ae9e-6fbd43fbbc14]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:42:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQIuJiSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.network.neutron [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Updating instance_info_cache with network_info: [{"id": "499cebaa-a6e6-4908-b5c5-1bc2b199b439", "address": "fa:16:3e:57:1b:52", "network": {"id": "d15ab552-8cb5-4ee5-b029-f7149258b103", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-788844379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09abd2ac842143d59109cf7bcccb9dc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499cebaa-a6", "ovs_interfaceid": "499cebaa-a6e6-4908-b5c5-1bc2b199b439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Releasing lock "refresh_cache-bc5c2514-d819-4792-afde-dfedc85e8e88" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.compute.manager [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Instance network_info: |[{"id": "499cebaa-a6e6-4908-b5c5-1bc2b199b439", "address": "fa:16:3e:57:1b:52", "network": {"id": "d15ab552-8cb5-4ee5-b029-f7149258b103", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-788844379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09abd2ac842143d59109cf7bcccb9dc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499cebaa-a6", "ovs_interfaceid": "499cebaa-a6e6-4908-b5c5-1bc2b199b439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3cde6944-ccb1-4586-8171-38b83b05fbfb req-3f9d51e2-cff4-4ffe-97d1-845a9110ab04 service nova] Acquired lock "refresh_cache-bc5c2514-d819-4792-afde-dfedc85e8e88" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.network.neutron [req-3cde6944-ccb1-4586-8171-38b83b05fbfb req-3f9d51e2-cff4-4ffe-97d1-845a9110ab04 service nova] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Refreshing network info cache for port 499cebaa-a6e6-4908-b5c5-1bc2b199b439 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Start _get_guest_xml network_info=[{"id": "499cebaa-a6e6-4908-b5c5-1bc2b199b439", "address": "fa:16:3e:57:1b:52", "network": {"id": "d15ab552-8cb5-4ee5-b029-f7149258b103", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-788844379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09abd2ac842143d59109cf7bcccb9dc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499cebaa-a6", "ovs_interfaceid": "499cebaa-a6e6-4908-b5c5-1bc2b199b439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:42:23 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:42:23 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:42:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1703782390',display_name='tempest-VolumesAssistedSnapshotsTest-server-1703782390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1703782390',id=9,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL43LfUGl6vbc4UW7yXYL9EaIAOW1TrytVHY0WnlQcK0XSjkNsjLpCvv3kPBkYYxfQ3UirJhkOuwc+KcXtO/claGU1k1Lc4jXxmmZhXjvWAVGKeiOti7vah5OCEeJkdI5g==',key_name='tempest-keypair-560516658',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09abd2ac842143d59109cf7bcccb9dc5',ramdisk_id='',reservation_id='r-zl4p4p5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1119885311',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1119885311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d752791054974d108ceabe28f5db090b',uuid=bc5c2514-d819-4792-afde-dfedc85e8e88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "499cebaa-a6e6-4908-b5c5-1bc2b199b439", "address": "fa:16:3e:57:1b:52", "network": {"id": "d15ab552-8cb5-4ee5-b029-f7149258b103", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-788844379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09abd2ac842143d59109cf7bcccb9dc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499cebaa-a6", "ovs_interfaceid": "499cebaa-a6e6-4908-b5c5-1bc2b199b439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Converting VIF {"id": "499cebaa-a6e6-4908-b5c5-1bc2b199b439", "address": "fa:16:3e:57:1b:52", "network": {"id": "d15ab552-8cb5-4ee5-b029-f7149258b103", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-788844379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09abd2ac842143d59109cf7bcccb9dc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499cebaa-a6", "ovs_interfaceid": "499cebaa-a6e6-4908-b5c5-1bc2b199b439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:1b:52,bridge_name='br-int',has_traffic_filtering=True,id=499cebaa-a6e6-4908-b5c5-1bc2b199b439,network=Network(d15ab552-8cb5-4ee5-b029-f7149258b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap499cebaa-a6') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.objects.instance [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Lazy-loading 'pci_devices' on Instance uuid bc5c2514-d819-4792-afde-dfedc85e8e88 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:42:23 user nova-compute[75391]:   <uuid>bc5c2514-d819-4792-afde-dfedc85e8e88</uuid>
Nov 15 02:42:23 user nova-compute[75391]:   <name>instance-00000009</name>
Nov 15 02:42:23 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:42:23 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:42:23 user nova-compute[75391]:   <metadata>
Nov 15 02:42:23 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:42:23 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:42:23 user nova-compute[75391]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1703782390</nova:name>
Nov 15 02:42:23 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:42:23</nova:creationTime>
Nov 15 02:42:23 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:42:23 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:42:23 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:42:23 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:42:23 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:42:23 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:42:23 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:42:23 user nova-compute[75391]:       <nova:owner>
Nov 15 02:42:23 user nova-compute[75391]:         <nova:user uuid="d752791054974d108ceabe28f5db090b">tempest-VolumesAssistedSnapshotsTest-1119885311-project-member</nova:user>
Nov 15 02:42:23 user nova-compute[75391]:         <nova:project uuid="09abd2ac842143d59109cf7bcccb9dc5">tempest-VolumesAssistedSnapshotsTest-1119885311</nova:project>
Nov 15 02:42:23 user nova-compute[75391]:       </nova:owner>
Nov 15 02:42:23 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:42:23 user nova-compute[75391]:       <nova:ports>
Nov 15 02:42:23 user nova-compute[75391]:         <nova:port uuid="499cebaa-a6e6-4908-b5c5-1bc2b199b439">
Nov 15 02:42:23 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 02:42:23 user nova-compute[75391]:         </nova:port>
Nov 15 02:42:23 user nova-compute[75391]:       </nova:ports>
Nov 15 02:42:23 user nova-compute[75391]:     </nova:instance>
Nov 15 02:42:23 user nova-compute[75391]:   </metadata>
Nov 15 02:42:23 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:42:23 user nova-compute[75391]:     <system>
Nov 15 02:42:23 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:42:23 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:42:23 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:42:23 user nova-compute[75391]:       <entry name="serial">bc5c2514-d819-4792-afde-dfedc85e8e88</entry>
Nov 15 02:42:23 user nova-compute[75391]:       <entry name="uuid">bc5c2514-d819-4792-afde-dfedc85e8e88</entry>
Nov 15 02:42:23 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:42:23 user nova-compute[75391]:     </system>
Nov 15 02:42:23 user nova-compute[75391]:   </sysinfo>
Nov 15 02:42:23 user nova-compute[75391]:   <os>
Nov 15 02:42:23 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:42:23 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:42:23 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:42:23 user nova-compute[75391]:   </os>
Nov 15 02:42:23 user nova-compute[75391]:   <features>
Nov 15 02:42:23 user nova-compute[75391]:     <acpi/>
Nov 15 02:42:23 user nova-compute[75391]:     <apic/>
Nov 15 02:42:23 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:42:23 user nova-compute[75391]:   </features>
Nov 15 02:42:23 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:42:23 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:42:23 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:42:23 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:42:23 user nova-compute[75391]:   </clock>
Nov 15 02:42:23 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:42:23 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:42:23 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:42:23 user nova-compute[75391]:   </cpu>
Nov 15 02:42:23 user nova-compute[75391]:   <devices>
Nov 15 02:42:23 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:42:23 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:42:23 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/bc5c2514-d819-4792-afde-dfedc85e8e88/disk"/>
Nov 15 02:42:23 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:42:23 user nova-compute[75391]:     </disk>
Nov 15 02:42:23 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:42:23 user nova-compute[75391]:       <mac address="fa:16:3e:57:1b:52"/>
Nov 15 02:42:23 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:42:23 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:42:23 user nova-compute[75391]:       <target dev="tap499cebaa-a6"/>
Nov 15 02:42:23 user nova-compute[75391]:     </interface>
Nov 15 02:42:23 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:42:23 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/bc5c2514-d819-4792-afde-dfedc85e8e88/console.log" append="off"/>
Nov 15 02:42:23 user nova-compute[75391]:     </serial>
Nov 15 02:42:23 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:42:23 user nova-compute[75391]:     <video>
Nov 15 02:42:23 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:42:23 user nova-compute[75391]:     </video>
Nov 15 02:42:23 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:42:23 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:42:23 user nova-compute[75391]:     </rng>
Nov 15 02:42:23 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:42:23 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:42:23 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:42:23 user nova-compute[75391]:     </memballoon>
Nov 15 02:42:23 user nova-compute[75391]:   </devices>
Nov 15 02:42:23 user nova-compute[75391]: </domain>
Nov 15 02:42:23 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:42:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1703782390',display_name='tempest-VolumesAssistedSnapshotsTest-server-1703782390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1703782390',id=9,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL43LfUGl6vbc4UW7yXYL9EaIAOW1TrytVHY0WnlQcK0XSjkNsjLpCvv3kPBkYYxfQ3UirJhkOuwc+KcXtO/claGU1k1Lc4jXxmmZhXjvWAVGKeiOti7vah5OCEeJkdI5g==',key_name='tempest-keypair-560516658',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09abd2ac842143d59109cf7bcccb9dc5',ramdisk_id='',reservation_id='r-zl4p4p5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1119885311',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1119885311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d752791054974d108ceabe28f5db090b',uuid=bc5c2514-d819-4792-afde-dfedc85e8e88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "499cebaa-a6e6-4908-b5c5-1bc2b199b439", "address": "fa:16:3e:57:1b:52", "network": {"id": "d15ab552-8cb5-4ee5-b029-f7149258b103", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-788844379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09abd2ac842143d59109cf7bcccb9dc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499cebaa-a6", "ovs_interfaceid": "499cebaa-a6e6-4908-b5c5-1bc2b199b439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Converting VIF {"id": "499cebaa-a6e6-4908-b5c5-1bc2b199b439", "address": "fa:16:3e:57:1b:52", "network": {"id": "d15ab552-8cb5-4ee5-b029-f7149258b103", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-788844379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09abd2ac842143d59109cf7bcccb9dc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499cebaa-a6", "ovs_interfaceid": "499cebaa-a6e6-4908-b5c5-1bc2b199b439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:1b:52,bridge_name='br-int',has_traffic_filtering=True,id=499cebaa-a6e6-4908-b5c5-1bc2b199b439,network=Network(d15ab552-8cb5-4ee5-b029-f7149258b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap499cebaa-a6') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG os_vif [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:1b:52,bridge_name='br-int',has_traffic_filtering=True,id=499cebaa-a6e6-4908-b5c5-1bc2b199b439,network=Network(d15ab552-8cb5-4ee5-b029-f7149258b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap499cebaa-a6') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '16bf1d25-eb43-5ca4-81f3-a5f57051d709', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap499cebaa-a6, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap499cebaa-a6, col_values=(('qos', UUID('18eb9f06-6177-4b09-8a9c-2baa6264896c')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap499cebaa-a6, col_values=(('external_ids', {'iface-id': '499cebaa-a6e6-4908-b5c5-1bc2b199b439', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:1b:52', 'vm-uuid': 'bc5c2514-d819-4792-afde-dfedc85e8e88'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:23 user nova-compute[75391]: INFO os_vif [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:1b:52,bridge_name='br-int',has_traffic_filtering=True,id=499cebaa-a6e6-4908-b5c5-1bc2b199b439,network=Network(d15ab552-8cb5-4ee5-b029-f7149258b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap499cebaa-a6')
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] No VIF found with MAC fa:16:3e:57:1b:52, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.compute.manager [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:42:23 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Instance spawned successfully.
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.435s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '23637383936663634', 'path': '/dev/sdb'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637383936663634', 'path': '/dev/sdb'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1071606514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1071606514',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJpUqLBG9MXTa4b8ttJcUyIaQWwwfKw3oQQHLLLE6hRohPvI+iHNv7PsUg7WlW0Rk9dnTSBu2zUo7T1ApUjCFWDWZfBwkbNbFZxmqfiLBpDMCEOaVy2Lcdga2I1GHUEGQ==',key_name='tempest-keypair-1458525323',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e357f7331b8042adbc7e74190412daa2',ramdisk_id='',reservation_id='r-2jmtqabu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1642963392',owner_user_name='tempest-ServerActionsV293TestJSON-1642963392-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='541a74f4f1004769b64f8086feae6255',uuid=60093cdf-015e-4c39-a514-1818a6e55385,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "address": "fa:16:3e:39:41:1f", "network": {"id": "8904261f-fabd-4932-b540-dcc6be4fe56e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-180821931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e357f7331b8042adbc7e74190412daa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f28911d-78", "ovs_interfaceid": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Converting VIF {"id": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "address": "fa:16:3e:39:41:1f", "network": {"id": "8904261f-fabd-4932-b540-dcc6be4fe56e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-180821931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e357f7331b8042adbc7e74190412daa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f28911d-78", "ovs_interfaceid": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:41:1f,bridge_name='br-int',has_traffic_filtering=True,id=5f28911d-785a-4eee-aa6a-5de54d6836e5,network=Network(8904261f-fabd-4932-b540-dcc6be4fe56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f28911d-78') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:23 user nova-compute[75391]: DEBUG nova.objects.instance [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lazy-loading 'pci_devices' on Instance uuid 60093cdf-015e-4c39-a514-1818a6e55385 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:42:24 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:42:24 user nova-compute[75391]:   <uuid>60093cdf-015e-4c39-a514-1818a6e55385</uuid>
Nov 15 02:42:24 user nova-compute[75391]:   <name>instance-00000006</name>
Nov 15 02:42:24 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:42:24 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:42:24 user nova-compute[75391]:   <metadata>
Nov 15 02:42:24 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:42:24 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:42:24 user nova-compute[75391]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1071606514</nova:name>
Nov 15 02:42:24 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:42:22</nova:creationTime>
Nov 15 02:42:24 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:42:24 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:42:24 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:42:24 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:42:24 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:42:24 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:42:24 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:42:24 user nova-compute[75391]:       <nova:owner>
Nov 15 02:42:24 user nova-compute[75391]:         <nova:user uuid="541a74f4f1004769b64f8086feae6255">tempest-ServerActionsV293TestJSON-1642963392-project-member</nova:user>
Nov 15 02:42:24 user nova-compute[75391]:         <nova:project uuid="e357f7331b8042adbc7e74190412daa2">tempest-ServerActionsV293TestJSON-1642963392</nova:project>
Nov 15 02:42:24 user nova-compute[75391]:       </nova:owner>
Nov 15 02:42:24 user nova-compute[75391]:       <nova:ports>
Nov 15 02:42:24 user nova-compute[75391]:         <nova:port uuid="5f28911d-785a-4eee-aa6a-5de54d6836e5">
Nov 15 02:42:24 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 02:42:24 user nova-compute[75391]:         </nova:port>
Nov 15 02:42:24 user nova-compute[75391]:       </nova:ports>
Nov 15 02:42:24 user nova-compute[75391]:     </nova:instance>
Nov 15 02:42:24 user nova-compute[75391]:   </metadata>
Nov 15 02:42:24 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:42:24 user nova-compute[75391]:     <system>
Nov 15 02:42:24 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:42:24 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:42:24 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:42:24 user nova-compute[75391]:       <entry name="serial">60093cdf-015e-4c39-a514-1818a6e55385</entry>
Nov 15 02:42:24 user nova-compute[75391]:       <entry name="uuid">60093cdf-015e-4c39-a514-1818a6e55385</entry>
Nov 15 02:42:24 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:42:24 user nova-compute[75391]:     </system>
Nov 15 02:42:24 user nova-compute[75391]:   </sysinfo>
Nov 15 02:42:24 user nova-compute[75391]:   <os>
Nov 15 02:42:24 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:42:24 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:42:24 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:42:24 user nova-compute[75391]:   </os>
Nov 15 02:42:24 user nova-compute[75391]:   <features>
Nov 15 02:42:24 user nova-compute[75391]:     <acpi/>
Nov 15 02:42:24 user nova-compute[75391]:     <apic/>
Nov 15 02:42:24 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:42:24 user nova-compute[75391]:   </features>
Nov 15 02:42:24 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:42:24 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:42:24 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:42:24 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:42:24 user nova-compute[75391]:   </clock>
Nov 15 02:42:24 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:42:24 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:42:24 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:42:24 user nova-compute[75391]:   </cpu>
Nov 15 02:42:24 user nova-compute[75391]:   <devices>
Nov 15 02:42:24 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 02:42:24 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:42:24 user nova-compute[75391]:       <source dev="/dev/sdb"/>
Nov 15 02:42:24 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:42:24 user nova-compute[75391]:       <serial>7c9e2931-9e6c-42a6-9b3c-b1854f32cb40</serial>
Nov 15 02:42:24 user nova-compute[75391]:     </disk>
Nov 15 02:42:24 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:42:24 user nova-compute[75391]:       <mac address="fa:16:3e:39:41:1f"/>
Nov 15 02:42:24 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:42:24 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:42:24 user nova-compute[75391]:       <target dev="tap5f28911d-78"/>
Nov 15 02:42:24 user nova-compute[75391]:     </interface>
Nov 15 02:42:24 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:42:24 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/60093cdf-015e-4c39-a514-1818a6e55385/console.log" append="off"/>
Nov 15 02:42:24 user nova-compute[75391]:     </serial>
Nov 15 02:42:24 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:42:24 user nova-compute[75391]:     <video>
Nov 15 02:42:24 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:42:24 user nova-compute[75391]:     </video>
Nov 15 02:42:24 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:42:24 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:42:24 user nova-compute[75391]:     </rng>
Nov 15 02:42:24 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:42:24 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:42:24 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:42:24 user nova-compute[75391]:     </memballoon>
Nov 15 02:42:24 user nova-compute[75391]:   </devices>
Nov 15 02:42:24 user nova-compute[75391]: </domain>
Nov 15 02:42:24 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:42:24 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1071606514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1071606514',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJpUqLBG9MXTa4b8ttJcUyIaQWwwfKw3oQQHLLLE6hRohPvI+iHNv7PsUg7WlW0Rk9dnTSBu2zUo7T1ApUjCFWDWZfBwkbNbFZxmqfiLBpDMCEOaVy2Lcdga2I1GHUEGQ==',key_name='tempest-keypair-1458525323',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e357f7331b8042adbc7e74190412daa2',ramdisk_id='',reservation_id='r-2jmtqabu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1642963392',owner_user_name='tempest-ServerActionsV293TestJSON-1642963392-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='541a74f4f1004769b64f8086feae6255',uuid=60093cdf-015e-4c39-a514-1818a6e55385,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "address": "fa:16:3e:39:41:1f", "network": {"id": "8904261f-fabd-4932-b540-dcc6be4fe56e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-180821931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e357f7331b8042adbc7e74190412daa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f28911d-78", "ovs_interfaceid": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:42:24 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Converting VIF {"id": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "address": "fa:16:3e:39:41:1f", "network": {"id": "8904261f-fabd-4932-b540-dcc6be4fe56e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-180821931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e357f7331b8042adbc7e74190412daa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f28911d-78", "ovs_interfaceid": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:24 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:41:1f,bridge_name='br-int',has_traffic_filtering=True,id=5f28911d-785a-4eee-aa6a-5de54d6836e5,network=Network(8904261f-fabd-4932-b540-dcc6be4fe56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f28911d-78') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:24 user nova-compute[75391]: DEBUG os_vif [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:41:1f,bridge_name='br-int',has_traffic_filtering=True,id=5f28911d-785a-4eee-aa6a-5de54d6836e5,network=Network(8904261f-fabd-4932-b540-dcc6be4fe56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f28911d-78') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:42:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:42:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b23523e3-cb28-5586-8267-8f24592d0dcc', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f28911d-78, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f28911d-78, col_values=(('qos', UUID('929df5be-3e13-465c-bd68-8b47e062262c')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f28911d-78, col_values=(('external_ids', {'iface-id': '5f28911d-785a-4eee-aa6a-5de54d6836e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:41:1f', 'vm-uuid': '60093cdf-015e-4c39-a514-1818a6e55385'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:24 user nova-compute[75391]: INFO nova.compute.manager [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Took 10.27 seconds to spawn the instance on the hypervisor.
Nov 15 02:42:24 user nova-compute[75391]: DEBUG nova.compute.manager [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:42:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:24 user nova-compute[75391]: INFO os_vif [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:41:1f,bridge_name='br-int',has_traffic_filtering=True,id=5f28911d-785a-4eee-aa6a-5de54d6836e5,network=Network(8904261f-fabd-4932-b540-dcc6be4fe56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f28911d-78')
Nov 15 02:42:24 user nova-compute[75391]: INFO nova.compute.manager [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Took 12.39 seconds to build instance.
Nov 15 02:42:24 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:42:24 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] No VIF found with MAC fa:16:3e:39:41:1f, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:42:24 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-86b01089-4725-4b28-b71e-3c625bb63a19 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lock "1fc39b27-762e-4bc8-90ba-0215d65710ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.542s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:24 user nova-compute[75391]: DEBUG nova.network.neutron [req-3cde6944-ccb1-4586-8171-38b83b05fbfb req-3f9d51e2-cff4-4ffe-97d1-845a9110ab04 service nova] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Updated VIF entry in instance network info cache for port 499cebaa-a6e6-4908-b5c5-1bc2b199b439. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:42:24 user nova-compute[75391]: DEBUG nova.network.neutron [req-3cde6944-ccb1-4586-8171-38b83b05fbfb req-3f9d51e2-cff4-4ffe-97d1-845a9110ab04 service nova] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Updating instance_info_cache with network_info: [{"id": "499cebaa-a6e6-4908-b5c5-1bc2b199b439", "address": "fa:16:3e:57:1b:52", "network": {"id": "d15ab552-8cb5-4ee5-b029-f7149258b103", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-788844379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09abd2ac842143d59109cf7bcccb9dc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499cebaa-a6", "ovs_interfaceid": "499cebaa-a6e6-4908-b5c5-1bc2b199b439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:42:24 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3cde6944-ccb1-4586-8171-38b83b05fbfb req-3f9d51e2-cff4-4ffe-97d1-845a9110ab04 service nova] Releasing lock "refresh_cache-bc5c2514-d819-4792-afde-dfedc85e8e88" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:42:24 user nova-compute[75391]: DEBUG nova.compute.manager [req-94778d31-3d08-419f-9885-0a24314baf39 req-f26e8ba4-7665-4fa2-a369-eeecc6bd7d17 service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Received event network-vif-plugged-d8f34e4c-5c99-45eb-a282-a721a2019209 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:24 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-94778d31-3d08-419f-9885-0a24314baf39 req-f26e8ba4-7665-4fa2-a369-eeecc6bd7d17 service nova] Acquiring lock "fc9484c0-9083-4797-8ab1-2ad392822ce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:24 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-94778d31-3d08-419f-9885-0a24314baf39 req-f26e8ba4-7665-4fa2-a369-eeecc6bd7d17 service nova] Lock "fc9484c0-9083-4797-8ab1-2ad392822ce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:24 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-94778d31-3d08-419f-9885-0a24314baf39 req-f26e8ba4-7665-4fa2-a369-eeecc6bd7d17 service nova] Lock "fc9484c0-9083-4797-8ab1-2ad392822ce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:24 user nova-compute[75391]: DEBUG nova.compute.manager [req-94778d31-3d08-419f-9885-0a24314baf39 req-f26e8ba4-7665-4fa2-a369-eeecc6bd7d17 service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] No waiting events found dispatching network-vif-plugged-d8f34e4c-5c99-45eb-a282-a721a2019209 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:42:24 user nova-compute[75391]: WARNING nova.compute.manager [req-94778d31-3d08-419f-9885-0a24314baf39 req-f26e8ba4-7665-4fa2-a369-eeecc6bd7d17 service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Received unexpected event network-vif-plugged-d8f34e4c-5c99-45eb-a282-a721a2019209 for instance with vm_state active and task_state None.
Nov 15 02:42:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:26 user nova-compute[75391]: DEBUG nova.compute.manager [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:42:26 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:42:26 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Instance spawned successfully.
Nov 15 02:42:26 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:42:26 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:26 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:26 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:26 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:26 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:26 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:26 user nova-compute[75391]: INFO nova.compute.manager [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Took 12.01 seconds to spawn the instance on the hypervisor.
Nov 15 02:42:26 user nova-compute[75391]: DEBUG nova.compute.manager [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:42:26 user nova-compute[75391]: INFO nova.compute.manager [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Took 14.91 seconds to build instance.
Nov 15 02:42:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-25113ed4-65db-4732-ae9a-e4da3f3a01dd tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.209s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Received event network-vif-plugged-d8f34e4c-5c99-45eb-a282-a721a2019209 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] Acquiring lock "fc9484c0-9083-4797-8ab1-2ad392822ce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] Lock "fc9484c0-9083-4797-8ab1-2ad392822ce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] Lock "fc9484c0-9083-4797-8ab1-2ad392822ce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] No waiting events found dispatching network-vif-plugged-d8f34e4c-5c99-45eb-a282-a721a2019209 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:42:27 user nova-compute[75391]: WARNING nova.compute.manager [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Received unexpected event network-vif-plugged-d8f34e4c-5c99-45eb-a282-a721a2019209 for instance with vm_state active and task_state None.
Nov 15 02:42:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Received event network-vif-plugged-4ff5dedb-acb1-489b-a2dc-18a0f53f2933 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] Acquiring lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] Lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] Lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] No waiting events found dispatching network-vif-plugged-4ff5dedb-acb1-489b-a2dc-18a0f53f2933 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:42:27 user nova-compute[75391]: WARNING nova.compute.manager [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Received unexpected event network-vif-plugged-4ff5dedb-acb1-489b-a2dc-18a0f53f2933 for instance with vm_state active and task_state None.
Nov 15 02:42:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Received event network-vif-plugged-4ff5dedb-acb1-489b-a2dc-18a0f53f2933 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] Acquiring lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] Lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] Lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] No waiting events found dispatching network-vif-plugged-4ff5dedb-acb1-489b-a2dc-18a0f53f2933 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:42:27 user nova-compute[75391]: WARNING nova.compute.manager [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Received unexpected event network-vif-plugged-4ff5dedb-acb1-489b-a2dc-18a0f53f2933 for instance with vm_state active and task_state None.
Nov 15 02:42:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Received event network-vif-plugged-13f9f606-3317-4760-b79b-39199222f706 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] Acquiring lock "f5586645-063f-463f-b03a-16e783b1c2d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] Lock "f5586645-063f-463f-b03a-16e783b1c2d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] Lock "f5586645-063f-463f-b03a-16e783b1c2d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] No waiting events found dispatching network-vif-plugged-13f9f606-3317-4760-b79b-39199222f706 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:42:27 user nova-compute[75391]: WARNING nova.compute.manager [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Received unexpected event network-vif-plugged-13f9f606-3317-4760-b79b-39199222f706 for instance with vm_state active and task_state None.
Nov 15 02:42:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Received event network-vif-plugged-13f9f606-3317-4760-b79b-39199222f706 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] Acquiring lock "f5586645-063f-463f-b03a-16e783b1c2d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] Lock "f5586645-063f-463f-b03a-16e783b1c2d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] Lock "f5586645-063f-463f-b03a-16e783b1c2d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] No waiting events found dispatching network-vif-plugged-13f9f606-3317-4760-b79b-39199222f706 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:42:27 user nova-compute[75391]: WARNING nova.compute.manager [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Received unexpected event network-vif-plugged-13f9f606-3317-4760-b79b-39199222f706 for instance with vm_state active and task_state None.
Nov 15 02:42:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Received event network-vif-plugged-8bff8066-85b6-4359-88db-9d717d9a04f9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] Acquiring lock "1fc39b27-762e-4bc8-90ba-0215d65710ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] Lock "1fc39b27-762e-4bc8-90ba-0215d65710ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] Lock "1fc39b27-762e-4bc8-90ba-0215d65710ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] No waiting events found dispatching network-vif-plugged-8bff8066-85b6-4359-88db-9d717d9a04f9 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:42:27 user nova-compute[75391]: WARNING nova.compute.manager [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Received unexpected event network-vif-plugged-8bff8066-85b6-4359-88db-9d717d9a04f9 for instance with vm_state active and task_state None.
Nov 15 02:42:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Received event network-vif-plugged-8bff8066-85b6-4359-88db-9d717d9a04f9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] Acquiring lock "1fc39b27-762e-4bc8-90ba-0215d65710ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] Lock "1fc39b27-762e-4bc8-90ba-0215d65710ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] Lock "1fc39b27-762e-4bc8-90ba-0215d65710ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] No waiting events found dispatching network-vif-plugged-8bff8066-85b6-4359-88db-9d717d9a04f9 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:42:27 user nova-compute[75391]: WARNING nova.compute.manager [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Received unexpected event network-vif-plugged-8bff8066-85b6-4359-88db-9d717d9a04f9 for instance with vm_state active and task_state None.
Nov 15 02:42:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Received event network-vif-plugged-86eacc9d-8245-4fa1-9a0a-a0a9f396872b {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] Acquiring lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] Lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] Lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] No waiting events found dispatching network-vif-plugged-86eacc9d-8245-4fa1-9a0a-a0a9f396872b {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:42:27 user nova-compute[75391]: WARNING nova.compute.manager [req-e692b49b-1271-4a67-a8c4-21a2270c580a req-e9426fe5-956e-499f-b8c6-a7beda58b97d service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Received unexpected event network-vif-plugged-86eacc9d-8245-4fa1-9a0a-a0a9f396872b for instance with vm_state active and task_state None.
Nov 15 02:42:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:29 user nova-compute[75391]: DEBUG nova.compute.manager [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Received event network-vif-plugged-86eacc9d-8245-4fa1-9a0a-a0a9f396872b {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] Acquiring lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] Lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] Lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:29 user nova-compute[75391]: DEBUG nova.compute.manager [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] No waiting events found dispatching network-vif-plugged-86eacc9d-8245-4fa1-9a0a-a0a9f396872b {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:42:29 user nova-compute[75391]: WARNING nova.compute.manager [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Received unexpected event network-vif-plugged-86eacc9d-8245-4fa1-9a0a-a0a9f396872b for instance with vm_state active and task_state None.
Nov 15 02:42:29 user nova-compute[75391]: DEBUG nova.compute.manager [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Received event network-vif-plugged-499cebaa-a6e6-4908-b5c5-1bc2b199b439 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] Acquiring lock "bc5c2514-d819-4792-afde-dfedc85e8e88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] Lock "bc5c2514-d819-4792-afde-dfedc85e8e88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] Lock "bc5c2514-d819-4792-afde-dfedc85e8e88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:29 user nova-compute[75391]: DEBUG nova.compute.manager [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] No waiting events found dispatching network-vif-plugged-499cebaa-a6e6-4908-b5c5-1bc2b199b439 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:42:29 user nova-compute[75391]: WARNING nova.compute.manager [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Received unexpected event network-vif-plugged-499cebaa-a6e6-4908-b5c5-1bc2b199b439 for instance with vm_state building and task_state spawning.
Nov 15 02:42:29 user nova-compute[75391]: DEBUG nova.compute.manager [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Received event network-vif-plugged-499cebaa-a6e6-4908-b5c5-1bc2b199b439 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] Acquiring lock "bc5c2514-d819-4792-afde-dfedc85e8e88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] Lock "bc5c2514-d819-4792-afde-dfedc85e8e88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] Lock "bc5c2514-d819-4792-afde-dfedc85e8e88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:29 user nova-compute[75391]: DEBUG nova.compute.manager [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] No waiting events found dispatching network-vif-plugged-499cebaa-a6e6-4908-b5c5-1bc2b199b439 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:42:29 user nova-compute[75391]: WARNING nova.compute.manager [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Received unexpected event network-vif-plugged-499cebaa-a6e6-4908-b5c5-1bc2b199b439 for instance with vm_state building and task_state spawning.
Nov 15 02:42:29 user nova-compute[75391]: DEBUG nova.compute.manager [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Received event network-vif-plugged-5f28911d-785a-4eee-aa6a-5de54d6836e5 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] Acquiring lock "60093cdf-015e-4c39-a514-1818a6e55385-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] Lock "60093cdf-015e-4c39-a514-1818a6e55385-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] Lock "60093cdf-015e-4c39-a514-1818a6e55385-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:29 user nova-compute[75391]: DEBUG nova.compute.manager [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] No waiting events found dispatching network-vif-plugged-5f28911d-785a-4eee-aa6a-5de54d6836e5 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:42:29 user nova-compute[75391]: WARNING nova.compute.manager [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Received unexpected event network-vif-plugged-5f28911d-785a-4eee-aa6a-5de54d6836e5 for instance with vm_state building and task_state spawning.
Nov 15 02:42:29 user nova-compute[75391]: DEBUG nova.compute.manager [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Received event network-vif-plugged-5f28911d-785a-4eee-aa6a-5de54d6836e5 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] Acquiring lock "60093cdf-015e-4c39-a514-1818a6e55385-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] Lock "60093cdf-015e-4c39-a514-1818a6e55385-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] Lock "60093cdf-015e-4c39-a514-1818a6e55385-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:29 user nova-compute[75391]: DEBUG nova.compute.manager [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] No waiting events found dispatching network-vif-plugged-5f28911d-785a-4eee-aa6a-5de54d6836e5 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:42:29 user nova-compute[75391]: WARNING nova.compute.manager [req-27acdbc7-7bf5-4514-96a9-a6a0c3257190 req-73054dc8-bbb7-45d1-9e14-90671d70a685 service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Received unexpected event network-vif-plugged-5f28911d-785a-4eee-aa6a-5de54d6836e5 for instance with vm_state building and task_state spawning.
Nov 15 02:42:29 user nova-compute[75391]: DEBUG nova.compute.manager [req-0f98c1bc-e3ee-4114-8338-8c8f606b4f57 req-269652e4-516c-4f21-b3b2-07609544230f service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Received event network-vif-plugged-c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0f98c1bc-e3ee-4114-8338-8c8f606b4f57 req-269652e4-516c-4f21-b3b2-07609544230f service nova] Acquiring lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0f98c1bc-e3ee-4114-8338-8c8f606b4f57 req-269652e4-516c-4f21-b3b2-07609544230f service nova] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0f98c1bc-e3ee-4114-8338-8c8f606b4f57 req-269652e4-516c-4f21-b3b2-07609544230f service nova] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:29 user nova-compute[75391]: DEBUG nova.compute.manager [req-0f98c1bc-e3ee-4114-8338-8c8f606b4f57 req-269652e4-516c-4f21-b3b2-07609544230f service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] No waiting events found dispatching network-vif-plugged-c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:42:29 user nova-compute[75391]: WARNING nova.compute.manager [req-0f98c1bc-e3ee-4114-8338-8c8f606b4f57 req-269652e4-516c-4f21-b3b2-07609544230f service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Received unexpected event network-vif-plugged-c9643afc-4454-4d29-b8a2-5422753857b0 for instance with vm_state active and task_state None.
Nov 15 02:42:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:30 user nova-compute[75391]: DEBUG nova.compute.manager [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:42:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:30 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:42:30 user nova-compute[75391]: INFO nova.compute.claims [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Claim successful on node user
Nov 15 02:42:30 user nova-compute[75391]: DEBUG nova.compute.manager [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:42:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:42:30 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Instance spawned successfully.
Nov 15 02:42:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:42:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:30 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:42:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:42:31 user nova-compute[75391]: INFO nova.compute.manager [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Took 11.50 seconds to spawn the instance on the hypervisor.
Nov 15 02:42:31 user nova-compute[75391]: DEBUG nova.compute.manager [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:42:31 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Instance spawned successfully.
Nov 15 02:42:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.933s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG nova.compute.manager [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:42:31 user nova-compute[75391]: INFO nova.compute.manager [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Took 8.76 seconds to spawn the instance on the hypervisor.
Nov 15 02:42:31 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:42:31 user nova-compute[75391]: INFO nova.compute.manager [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Took 13.43 seconds to build instance.
Nov 15 02:42:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b464dc5e-9278-409b-a393-e7f05bd127e8 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Lock "bc5c2514-d819-4792-afde-dfedc85e8e88" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.571s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:31 user nova-compute[75391]: INFO nova.compute.manager [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Took 21.02 seconds to build instance.
Nov 15 02:42:31 user nova-compute[75391]: DEBUG nova.compute.manager [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG nova.network.neutron [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f2d890c9-dc44-42fd-b8e7-cacb29efcb90 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "60093cdf-015e-4c39-a514-1818a6e55385" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.214s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:31 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:42:31 user nova-compute[75391]: DEBUG nova.compute.manager [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:42:31 user nova-compute[75391]: INFO nova.virt.block_device [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Booting with volume 6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 at /dev/vda
Nov 15 02:42:31 user nova-compute[75391]: DEBUG os_brick.utils [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.037s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba8fc41-b1a5-48e9-8b7b-61b99cafa606]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG nova.policy [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bada9568d8784e109d917376e03afeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1286381f6f484f8ca35024e8386f5c03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.032s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62a7134-f4b5-4e61-9ce3-860963f54a73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc9a1f3-5006-4d35-848a-cac208faceb4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee19787-6c10-40d5-bf49-493e241c1926]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:42:31 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:42:31 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[388f262a-4257-4c5e-8728-5d4ca7049d28]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG os_brick.utils [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] <== get_connector_properties: return (210ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:42:31 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Updating existing volume attachment record: 6f8f997b-b25a-497c-9e71-878f0a97607f {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:42:32 user nova-compute[75391]: DEBUG nova.compute.manager [req-6a9418f9-19a6-4b7d-8a62-04913e5584d0 req-7bb08c58-1558-4c36-8df5-0191c965c0c6 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Received event network-vif-plugged-c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6a9418f9-19a6-4b7d-8a62-04913e5584d0 req-7bb08c58-1558-4c36-8df5-0191c965c0c6 service nova] Acquiring lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6a9418f9-19a6-4b7d-8a62-04913e5584d0 req-7bb08c58-1558-4c36-8df5-0191c965c0c6 service nova] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6a9418f9-19a6-4b7d-8a62-04913e5584d0 req-7bb08c58-1558-4c36-8df5-0191c965c0c6 service nova] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:32 user nova-compute[75391]: DEBUG nova.compute.manager [req-6a9418f9-19a6-4b7d-8a62-04913e5584d0 req-7bb08c58-1558-4c36-8df5-0191c965c0c6 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] No waiting events found dispatching network-vif-plugged-c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:42:32 user nova-compute[75391]: WARNING nova.compute.manager [req-6a9418f9-19a6-4b7d-8a62-04913e5584d0 req-7bb08c58-1558-4c36-8df5-0191c965c0c6 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Received unexpected event network-vif-plugged-c9643afc-4454-4d29-b8a2-5422753857b0 for instance with vm_state active and task_state None.
Nov 15 02:42:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:32 user nova-compute[75391]: DEBUG nova.network.neutron [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Successfully created port: dea6d9d9-b176-440e-9589-d8d8def6471d {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:42:33 user nova-compute[75391]: DEBUG nova.network.neutron [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Successfully created port: 2100ab6d-db20-43a9-ba96-d9630430c14f {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:42:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:34 user nova-compute[75391]: DEBUG nova.network.neutron [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Successfully created port: a60510f0-b568-4276-914e-3c8cd49eafe5 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:42:35 user nova-compute[75391]: DEBUG nova.network.neutron [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Successfully created port: 9425c66c-2e1e-43e3-b611-70477c102b95 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:42:37 user nova-compute[75391]: DEBUG nova.network.neutron [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Successfully created port: c2725a77-bc15-423e-9795-49c2647a2d82 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:42:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:37 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:42:37 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:42:37 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 02:42:37 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Skipping network cache update for instance because it is Building. {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 02:42:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-9744c8a1-046e-4a00-92e0-92ebb3275ea9" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:42:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-9744c8a1-046e-4a00-92e0-92ebb3275ea9" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:42:37 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 02:42:37 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lazy-loading 'info_cache' on Instance uuid 9744c8a1-046e-4a00-92e0-92ebb3275ea9 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:42:37 user nova-compute[75391]: DEBUG nova.network.neutron [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Successfully updated port: dea6d9d9-b176-440e-9589-d8d8def6471d {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:42:37 user nova-compute[75391]: DEBUG nova.compute.manager [req-97b68eb1-7efa-45aa-ad06-afbbfc4a1e7e req-aa318fe1-c2fe-4199-910c-56637195c8c7 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-changed-dea6d9d9-b176-440e-9589-d8d8def6471d {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:37 user nova-compute[75391]: DEBUG nova.compute.manager [req-97b68eb1-7efa-45aa-ad06-afbbfc4a1e7e req-aa318fe1-c2fe-4199-910c-56637195c8c7 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Refreshing instance network info cache due to event network-changed-dea6d9d9-b176-440e-9589-d8d8def6471d. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:42:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-97b68eb1-7efa-45aa-ad06-afbbfc4a1e7e req-aa318fe1-c2fe-4199-910c-56637195c8c7 service nova] Acquiring lock "refresh_cache-2fb1dc69-6781-4a4f-a43f-9165d6dae447" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:42:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-97b68eb1-7efa-45aa-ad06-afbbfc4a1e7e req-aa318fe1-c2fe-4199-910c-56637195c8c7 service nova] Acquired lock "refresh_cache-2fb1dc69-6781-4a4f-a43f-9165d6dae447" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:42:37 user nova-compute[75391]: DEBUG nova.network.neutron [req-97b68eb1-7efa-45aa-ad06-afbbfc4a1e7e req-aa318fe1-c2fe-4199-910c-56637195c8c7 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Refreshing network info cache for port dea6d9d9-b176-440e-9589-d8d8def6471d {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:42:38 user nova-compute[75391]: DEBUG nova.network.neutron [req-97b68eb1-7efa-45aa-ad06-afbbfc4a1e7e req-aa318fe1-c2fe-4199-910c-56637195c8c7 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:42:38 user nova-compute[75391]: DEBUG nova.network.neutron [req-97b68eb1-7efa-45aa-ad06-afbbfc4a1e7e req-aa318fe1-c2fe-4199-910c-56637195c8c7 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:42:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-97b68eb1-7efa-45aa-ad06-afbbfc4a1e7e req-aa318fe1-c2fe-4199-910c-56637195c8c7 service nova] Releasing lock "refresh_cache-2fb1dc69-6781-4a4f-a43f-9165d6dae447" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:42:38 user nova-compute[75391]: INFO nova.virt.block_device [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Booting with volume 3b426366-42eb-45d8-bcd4-0613db72180d at /dev/vdb
Nov 15 02:42:38 user nova-compute[75391]: DEBUG os_brick.utils [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:42:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3de27a2-3063-4242-9398-3f952a40d053]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84a751d-d21c-4113-aa87-1e51997886c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80c8379-cfc5-4b31-86e4-0c8ffae40f2c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e77bc9-7a14-4560-a43c-87f975fac5c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:42:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:42:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:39 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Updating instance_info_cache with network_info: [{"id": "dc4f904f-dd76-4f25-b9e6-41cc42493911", "address": "fa:16:3e:e6:ec:c3", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4f904f-dd", "ovs_interfaceid": "dc4f904f-dd76-4f25-b9e6-41cc42493911", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:42:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:42:39 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:42:39 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7e30f1-0089-47ee-b928-8ccfd3b32df0]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:42:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:42:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:42:39 user nova-compute[75391]: DEBUG os_brick.utils [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:42:39 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Updating existing volume attachment record: 1f6451ae-7bf3-42a6-90ab-819e8db2d668 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:42:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-9744c8a1-046e-4a00-92e0-92ebb3275ea9" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:42:39 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 02:42:39 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:42:39 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Cleaning up deleted instances {{(pid=75391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 02:42:39 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] There are 0 instances to clean {{(pid=75391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 02:42:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:39 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:42:39 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 02:42:39 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:42:39 user nova-compute[75391]: DEBUG nova.network.neutron [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Successfully updated port: 7f659917-6ad3-4ccc-ac49-622470b330aa {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:42:39 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:42:40 user nova-compute[75391]: DEBUG nova.compute.manager [req-2a4cb729-c01b-4088-bf04-5a918bfac71d req-e97ae59e-89b8-4a30-8335-e4d087826d50 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-changed-7f659917-6ad3-4ccc-ac49-622470b330aa {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:40 user nova-compute[75391]: DEBUG nova.compute.manager [req-2a4cb729-c01b-4088-bf04-5a918bfac71d req-e97ae59e-89b8-4a30-8335-e4d087826d50 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Refreshing instance network info cache due to event network-changed-7f659917-6ad3-4ccc-ac49-622470b330aa. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:42:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2a4cb729-c01b-4088-bf04-5a918bfac71d req-e97ae59e-89b8-4a30-8335-e4d087826d50 service nova] Acquiring lock "refresh_cache-2fb1dc69-6781-4a4f-a43f-9165d6dae447" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:42:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2a4cb729-c01b-4088-bf04-5a918bfac71d req-e97ae59e-89b8-4a30-8335-e4d087826d50 service nova] Acquired lock "refresh_cache-2fb1dc69-6781-4a4f-a43f-9165d6dae447" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:42:40 user nova-compute[75391]: DEBUG nova.network.neutron [req-2a4cb729-c01b-4088-bf04-5a918bfac71d req-e97ae59e-89b8-4a30-8335-e4d087826d50 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Refreshing network info cache for port 7f659917-6ad3-4ccc-ac49-622470b330aa {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:42:40 user nova-compute[75391]: DEBUG nova.network.neutron [req-2a4cb729-c01b-4088-bf04-5a918bfac71d req-e97ae59e-89b8-4a30-8335-e4d087826d50 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:42:40 user nova-compute[75391]: DEBUG nova.network.neutron [req-2a4cb729-c01b-4088-bf04-5a918bfac71d req-e97ae59e-89b8-4a30-8335-e4d087826d50 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:42:40 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:42:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2a4cb729-c01b-4088-bf04-5a918bfac71d req-e97ae59e-89b8-4a30-8335-e4d087826d50 service nova] Releasing lock "refresh_cache-2fb1dc69-6781-4a4f-a43f-9165d6dae447" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:42:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:41 user nova-compute[75391]: DEBUG nova.network.neutron [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Successfully updated port: 51356594-af31-476d-a34b-697c80f519c8 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:42:41 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:42:41 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:42:42 user nova-compute[75391]: DEBUG nova.compute.manager [req-faefda34-06a3-4036-8d8c-850550444f7f req-fd1f8396-960d-4f26-a445-5d0a535db011 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-changed-51356594-af31-476d-a34b-697c80f519c8 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:42 user nova-compute[75391]: DEBUG nova.compute.manager [req-faefda34-06a3-4036-8d8c-850550444f7f req-fd1f8396-960d-4f26-a445-5d0a535db011 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Refreshing instance network info cache due to event network-changed-51356594-af31-476d-a34b-697c80f519c8. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:42:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-faefda34-06a3-4036-8d8c-850550444f7f req-fd1f8396-960d-4f26-a445-5d0a535db011 service nova] Acquiring lock "refresh_cache-2fb1dc69-6781-4a4f-a43f-9165d6dae447" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:42:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-faefda34-06a3-4036-8d8c-850550444f7f req-fd1f8396-960d-4f26-a445-5d0a535db011 service nova] Acquired lock "refresh_cache-2fb1dc69-6781-4a4f-a43f-9165d6dae447" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:42:42 user nova-compute[75391]: DEBUG nova.network.neutron [req-faefda34-06a3-4036-8d8c-850550444f7f req-fd1f8396-960d-4f26-a445-5d0a535db011 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Refreshing network info cache for port 51356594-af31-476d-a34b-697c80f519c8 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:42:42 user nova-compute[75391]: DEBUG nova.network.neutron [req-faefda34-06a3-4036-8d8c-850550444f7f req-fd1f8396-960d-4f26-a445-5d0a535db011 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:42:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:42 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:42:42 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:42:42 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:42:42 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:42:43 user nova-compute[75391]: DEBUG nova.network.neutron [req-faefda34-06a3-4036-8d8c-850550444f7f req-fd1f8396-960d-4f26-a445-5d0a535db011 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:42:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-faefda34-06a3-4036-8d8c-850550444f7f req-fd1f8396-960d-4f26-a445-5d0a535db011 service nova] Releasing lock "refresh_cache-2fb1dc69-6781-4a4f-a43f-9165d6dae447" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:42:43 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:42:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:43 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:42:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:44 user nova-compute[75391]: DEBUG nova.network.neutron [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Successfully updated port: 2100ab6d-db20-43a9-ba96-d9630430c14f {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:42:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-9c0ac138-97d6-40b1-b80b-e9c6e5ea80c3 req-08ebd2f5-a108-46b7-b3ac-07a26aa012b0 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-changed-2100ab6d-db20-43a9-ba96-d9630430c14f {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-9c0ac138-97d6-40b1-b80b-e9c6e5ea80c3 req-08ebd2f5-a108-46b7-b3ac-07a26aa012b0 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Refreshing instance network info cache due to event network-changed-2100ab6d-db20-43a9-ba96-d9630430c14f. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:42:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9c0ac138-97d6-40b1-b80b-e9c6e5ea80c3 req-08ebd2f5-a108-46b7-b3ac-07a26aa012b0 service nova] Acquiring lock "refresh_cache-2fb1dc69-6781-4a4f-a43f-9165d6dae447" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:42:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9c0ac138-97d6-40b1-b80b-e9c6e5ea80c3 req-08ebd2f5-a108-46b7-b3ac-07a26aa012b0 service nova] Acquired lock "refresh_cache-2fb1dc69-6781-4a4f-a43f-9165d6dae447" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:42:44 user nova-compute[75391]: DEBUG nova.network.neutron [req-9c0ac138-97d6-40b1-b80b-e9c6e5ea80c3 req-08ebd2f5-a108-46b7-b3ac-07a26aa012b0 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Refreshing network info cache for port 2100ab6d-db20-43a9-ba96-d9630430c14f {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:42:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:44 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:42:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5c2514-d819-4792-afde-dfedc85e8e88/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:44 user nova-compute[75391]: DEBUG nova.network.neutron [req-9c0ac138-97d6-40b1-b80b-e9c6e5ea80c3 req-08ebd2f5-a108-46b7-b3ac-07a26aa012b0 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:42:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5c2514-d819-4792-afde-dfedc85e8e88/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5c2514-d819-4792-afde-dfedc85e8e88/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:44 user nova-compute[75391]: DEBUG nova.network.neutron [req-9c0ac138-97d6-40b1-b80b-e9c6e5ea80c3 req-08ebd2f5-a108-46b7-b3ac-07a26aa012b0 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:42:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9c0ac138-97d6-40b1-b80b-e9c6e5ea80c3 req-08ebd2f5-a108-46b7-b3ac-07a26aa012b0 service nova] Releasing lock "refresh_cache-2fb1dc69-6781-4a4f-a43f-9165d6dae447" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:42:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5c2514-d819-4792-afde-dfedc85e8e88/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5586645-063f-463f-b03a-16e783b1c2d5/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:44 user nova-compute[75391]: DEBUG nova.network.neutron [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Successfully updated port: a60510f0-b568-4276-914e-3c8cd49eafe5 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:42:44 user nova-compute[75391]: INFO nova.virt.block_device [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Booting with volume c3897400-2d4d-48c5-b3ba-357e6ea42f9c at /dev/vdc
Nov 15 02:42:44 user nova-compute[75391]: DEBUG os_brick.utils [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5586645-063f-463f-b03a-16e783b1c2d5/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5586645-063f-463f-b03a-16e783b1c2d5/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[624056cd-e932-4eae-a2e6-c54258427c8f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d085b474-ed67-492e-92b9-20efe54fcb09]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbb0ecf-e79c-4030-b5e7-8792df98859f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc97620e-dcd8-4bc7-bea8-d2ad51ab6bc9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:42:45 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:42:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62041dd-2732-49dc-ac82-736ed6e135f6]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG os_brick.utils [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Updating existing volume attachment record: 56034a30-5549-4a4c-bfa3-606c0d725194 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5586645-063f-463f-b03a-16e783b1c2d5/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc39b27-762e-4bc8-90ba-0215d65710ec/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc39b27-762e-4bc8-90ba-0215d65710ec/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc39b27-762e-4bc8-90ba-0215d65710ec/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc39b27-762e-4bc8-90ba-0215d65710ec/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:45 user nova-compute[75391]: DEBUG nova.network.neutron [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Successfully updated port: 9425c66c-2e1e-43e3-b611-70477c102b95 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:42:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-e7ce4741-824a-444b-9ae5-7f6a4e000ae9 req-c49b3a01-c05b-4fc4-a8cd-f946b1f3b1b9 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-changed-a60510f0-b568-4276-914e-3c8cd49eafe5 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-e7ce4741-824a-444b-9ae5-7f6a4e000ae9 req-c49b3a01-c05b-4fc4-a8cd-f946b1f3b1b9 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Refreshing instance network info cache due to event network-changed-a60510f0-b568-4276-914e-3c8cd49eafe5. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:42:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e7ce4741-824a-444b-9ae5-7f6a4e000ae9 req-c49b3a01-c05b-4fc4-a8cd-f946b1f3b1b9 service nova] Acquiring lock "refresh_cache-2fb1dc69-6781-4a4f-a43f-9165d6dae447" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:42:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e7ce4741-824a-444b-9ae5-7f6a4e000ae9 req-c49b3a01-c05b-4fc4-a8cd-f946b1f3b1b9 service nova] Acquired lock "refresh_cache-2fb1dc69-6781-4a4f-a43f-9165d6dae447" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:42:46 user nova-compute[75391]: DEBUG nova.network.neutron [req-e7ce4741-824a-444b-9ae5-7f6a4e000ae9 req-c49b3a01-c05b-4fc4-a8cd-f946b1f3b1b9 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Refreshing network info cache for port a60510f0-b568-4276-914e-3c8cd49eafe5 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:42:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:46 user nova-compute[75391]: DEBUG nova.network.neutron [req-e7ce4741-824a-444b-9ae5-7f6a4e000ae9 req-c49b3a01-c05b-4fc4-a8cd-f946b1f3b1b9 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:42:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:46 user nova-compute[75391]: DEBUG nova.network.neutron [req-e7ce4741-824a-444b-9ae5-7f6a4e000ae9 req-c49b3a01-c05b-4fc4-a8cd-f946b1f3b1b9 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:42:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e7ce4741-824a-444b-9ae5-7f6a4e000ae9 req-c49b3a01-c05b-4fc4-a8cd-f946b1f3b1b9 service nova] Releasing lock "refresh_cache-2fb1dc69-6781-4a4f-a43f-9165d6dae447" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:42:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-e7ce4741-824a-444b-9ae5-7f6a4e000ae9 req-c49b3a01-c05b-4fc4-a8cd-f946b1f3b1b9 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-changed-9425c66c-2e1e-43e3-b611-70477c102b95 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-e7ce4741-824a-444b-9ae5-7f6a4e000ae9 req-c49b3a01-c05b-4fc4-a8cd-f946b1f3b1b9 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Refreshing instance network info cache due to event network-changed-9425c66c-2e1e-43e3-b611-70477c102b95. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:42:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e7ce4741-824a-444b-9ae5-7f6a4e000ae9 req-c49b3a01-c05b-4fc4-a8cd-f946b1f3b1b9 service nova] Acquiring lock "refresh_cache-2fb1dc69-6781-4a4f-a43f-9165d6dae447" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:42:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e7ce4741-824a-444b-9ae5-7f6a4e000ae9 req-c49b3a01-c05b-4fc4-a8cd-f946b1f3b1b9 service nova] Acquired lock "refresh_cache-2fb1dc69-6781-4a4f-a43f-9165d6dae447" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:42:46 user nova-compute[75391]: DEBUG nova.network.neutron [req-e7ce4741-824a-444b-9ae5-7f6a4e000ae9 req-c49b3a01-c05b-4fc4-a8cd-f946b1f3b1b9 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Refreshing network info cache for port 9425c66c-2e1e-43e3-b611-70477c102b95 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:42:47 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:47 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:47 user nova-compute[75391]: DEBUG nova.network.neutron [req-e7ce4741-824a-444b-9ae5-7f6a4e000ae9 req-c49b3a01-c05b-4fc4-a8cd-f946b1f3b1b9 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:42:47 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG nova.network.neutron [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Successfully updated port: c2725a77-bc15-423e-9795-49c2647a2d82 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG nova.network.neutron [req-e7ce4741-824a-444b-9ae5-7f6a4e000ae9 req-c49b3a01-c05b-4fc4-a8cd-f946b1f3b1b9 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Acquiring lock "refresh_cache-2fb1dc69-6781-4a4f-a43f-9165d6dae447" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e7ce4741-824a-444b-9ae5-7f6a4e000ae9 req-c49b3a01-c05b-4fc4-a8cd-f946b1f3b1b9 service nova] Releasing lock "refresh_cache-2fb1dc69-6781-4a4f-a43f-9165d6dae447" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Acquired lock "refresh_cache-2fb1dc69-6781-4a4f-a43f-9165d6dae447" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG nova.network.neutron [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:42:48 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:42:48 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:42:48 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=7241MB free_disk=25.496383666992188GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG nova.network.neutron [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9744c8a1-046e-4a00-92e0-92ebb3275ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance ebb7e616-3c05-4d99-a0b3-76dc1723e82d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance fc9484c0-9083-4797-8ab1-2ad392822ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance f5586645-063f-463f-b03a-16e783b1c2d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 60093cdf-015e-4c39-a514-1818a6e55385 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance bb472aa5-47dd-48d6-8e9f-e179afd1d8ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 1fc39b27-762e-4bc8-90ba-0215d65710ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance bc5c2514-d819-4792-afde-dfedc85e8e88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 2fb1dc69-6781-4a4f-a43f-9165d6dae447 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Refreshing inventories for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Updating ProviderTree inventory for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Updating inventory in ProviderTree for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Refreshing aggregate associations for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e, aggregates: None {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Refreshing trait associations for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG nova.compute.manager [req-bcae75a5-8112-41ba-9cef-75ecda02d27b req-d565e4e5-fed5-4c0e-8676-99e4fbcf1436 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-changed-c2725a77-bc15-423e-9795-49c2647a2d82 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG nova.compute.manager [req-bcae75a5-8112-41ba-9cef-75ecda02d27b req-d565e4e5-fed5-4c0e-8676-99e4fbcf1436 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Refreshing instance network info cache due to event network-changed-c2725a77-bc15-423e-9795-49c2647a2d82. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bcae75a5-8112-41ba-9cef-75ecda02d27b req-d565e4e5-fed5-4c0e-8676-99e4fbcf1436 service nova] Acquiring lock "refresh_cache-2fb1dc69-6781-4a4f-a43f-9165d6dae447" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:42:48 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:42:49 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:42:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.853s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:50 user nova-compute[75391]: DEBUG nova.compute.manager [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:42:50 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:42:50 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Creating image(s)
Nov 15 02:42:50 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Did not create local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 02:42:50 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Ensure instance console log exists: /opt/stack/data/nova/instances/2fb1dc69-6781-4a4f-a43f-9165d6dae447/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:42:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG nova.network.neutron [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Updating instance_info_cache with network_info: [{"id": "dea6d9d9-b176-440e-9589-d8d8def6471d", "address": "fa:16:3e:9f:29:46", "network": {"id": "e1a8c17d-9960-4500-9f24-e3a447dba928", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-521564942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea6d9d9-b1", "ovs_interfaceid": "dea6d9d9-b176-440e-9589-d8d8def6471d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f659917-6ad3-4ccc-ac49-622470b330aa", "address": "fa:16:3e:16:a3:74", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f659917-6a", "ovs_interfaceid": "7f659917-6ad3-4ccc-ac49-622470b330aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51356594-af31-476d-a34b-697c80f519c8", "address": "fa:16:3e:45:1b:c0", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51356594-af", "ovs_interfaceid": "51356594-af31-476d-a34b-697c80f519c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2100ab6d-db20-43a9-ba96-d9630430c14f", "address": "fa:16:3e:3e:62:83", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2100ab6d-db", "ovs_interfaceid": "2100ab6d-db20-43a9-ba96-d9630430c14f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a60510f0-b568-4276-914e-3c8cd49eafe5", "address": "fa:16:3e:5d:21:af", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa60510f0-b5", "ovs_interfaceid": "a60510f0-b568-4276-914e-3c8cd49eafe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9425c66c-2e1e-43e3-b611-70477c102b95", "address": "fa:16:3e:fb:32:26", "network": {"id": "594b2a44-0933-4ecd-ae26-5fd6f9582d15", "bridge": "br-int", "label": "tempest-device-tagging-net2-996422155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9425c66c-2e", "ovs_interfaceid": "9425c66c-2e1e-43e3-b611-70477c102b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2725a77-bc15-423e-9795-49c2647a2d82", "address": "fa:16:3e:ca:82:17", "network": {"id": "594b2a44-0933-4ecd-ae26-5fd6f9582d15", "bridge": "br-int", "label": "tempest-device-tagging-net2-996422155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2725a77-bc", "ovs_interfaceid": "c2725a77-bc15-423e-9795-49c2647a2d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Releasing lock "refresh_cache-2fb1dc69-6781-4a4f-a43f-9165d6dae447" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG nova.compute.manager [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Instance network_info: |[{"id": "dea6d9d9-b176-440e-9589-d8d8def6471d", "address": "fa:16:3e:9f:29:46", "network": {"id": "e1a8c17d-9960-4500-9f24-e3a447dba928", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-521564942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea6d9d9-b1", "ovs_interfaceid": "dea6d9d9-b176-440e-9589-d8d8def6471d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f659917-6ad3-4ccc-ac49-622470b330aa", "address": "fa:16:3e:16:a3:74", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f659917-6a", "ovs_interfaceid": "7f659917-6ad3-4ccc-ac49-622470b330aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51356594-af31-476d-a34b-697c80f519c8", "address": "fa:16:3e:45:1b:c0", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51356594-af", "ovs_interfaceid": "51356594-af31-476d-a34b-697c80f519c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2100ab6d-db20-43a9-ba96-d9630430c14f", "address": "fa:16:3e:3e:62:83", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2100ab6d-db", "ovs_interfaceid": "2100ab6d-db20-43a9-ba96-d9630430c14f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a60510f0-b568-4276-914e-3c8cd49eafe5", "address": "fa:16:3e:5d:21:af", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa60510f0-b5", "ovs_interfaceid": "a60510f0-b568-4276-914e-3c8cd49eafe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9425c66c-2e1e-43e3-b611-70477c102b95", "address": "fa:16:3e:fb:32:26", "network": {"id": "594b2a44-0933-4ecd-ae26-5fd6f9582d15", "bridge": "br-int", "label": "tempest-device-tagging-net2-996422155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9425c66c-2e", "ovs_interfaceid": "9425c66c-2e1e-43e3-b611-70477c102b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2725a77-bc15-423e-9795-49c2647a2d82", "address": "fa:16:3e:ca:82:17", "network": {"id": "594b2a44-0933-4ecd-ae26-5fd6f9582d15", "bridge": "br-int", "label": "tempest-device-tagging-net2-996422155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2725a77-bc", "ovs_interfaceid": "c2725a77-bc15-423e-9795-49c2647a2d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bcae75a5-8112-41ba-9cef-75ecda02d27b req-d565e4e5-fed5-4c0e-8676-99e4fbcf1436 service nova] Acquired lock "refresh_cache-2fb1dc69-6781-4a4f-a43f-9165d6dae447" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG nova.network.neutron [req-bcae75a5-8112-41ba-9cef-75ecda02d27b req-d565e4e5-fed5-4c0e-8676-99e4fbcf1436 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Refreshing network info cache for port c2725a77-bc15-423e-9795-49c2647a2d82 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Start _get_guest_xml network_info=[{"id": "dea6d9d9-b176-440e-9589-d8d8def6471d", "address": "fa:16:3e:9f:29:46", "network": {"id": "e1a8c17d-9960-4500-9f24-e3a447dba928", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-521564942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea6d9d9-b1", "ovs_interfaceid": "dea6d9d9-b176-440e-9589-d8d8def6471d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f659917-6ad3-4ccc-ac49-622470b330aa", "address": "fa:16:3e:16:a3:74", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f659917-6a", "ovs_interfaceid": "7f659917-6ad3-4ccc-ac49-622470b330aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51356594-af31-476d-a34b-697c80f519c8", "address": "fa:16:3e:45:1b:c0", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51356594-af", "ovs_interfaceid": "51356594-af31-476d-a34b-697c80f519c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2100ab6d-db20-43a9-ba96-d9630430c14f", "address": "fa:16:3e:3e:62:83", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2100ab6d-db", "ovs_interfaceid": "2100ab6d-db20-43a9-ba96-d9630430c14f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a60510f0-b568-4276-914e-3c8cd49eafe5", "address": "fa:16:3e:5d:21:af", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa60510f0-b5", "ovs_interfaceid": "a60510f0-b568-4276-914e-3c8cd49eafe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9425c66c-2e1e-43e3-b611-70477c102b95", "address": "fa:16:3e:fb:32:26", "network": {"id": "594b2a44-0933-4ecd-ae26-5fd6f9582d15", "bridge": "br-int", "label": "tempest-device-tagging-net2-996422155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9425c66c-2e", "ovs_interfaceid": "9425c66c-2e1e-43e3-b611-70477c102b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2725a77-bc15-423e-9795-49c2647a2d82", "address": "fa:16:3e:ca:82:17", "network": {"id": "594b2a44-0933-4ecd-ae26-5fd6f9582d15", "bridge": "br-int", "label": "tempest-device-tagging-net2-996422155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2725a77-bc", "ovs_interfaceid": "c2725a77-bc15-423e-9795-49c2647a2d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '6f8f997b-b25a-497c-9e71-878f0a97607f', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tYhvpsGw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2fb1dc69-6781-4a4f-a43f-9165d6dae447', 'attached_at': '', 'detached_at': '', 'volume_id': '6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6', 'serial': '6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6'}, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '1f6451ae-7bf3-42a6-90ab-819e8db2d668', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIMPVjRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2fb1dc69-6781-4a4f-a43f-9165d6dae447', 'attached_at': '', 'detached_at': '', 'volume_id': '3b426366-42eb-45d8-bcd4-0613db72180d', 'serial': '3b426366-42eb-45d8-bcd4-0613db72180d'}, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '56034a30-5549-4a4c-bfa3-606c0d725194', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCwjuLiA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2fb1dc69-6781-4a4f-a43f-9165d6dae447', 'attached_at': '', 'detached_at': '', 'volume_id': 'c3897400-2d4d-48c5-b3ba-357e6ea42f9c', 'serial': 'c3897400-2d4d-48c5-b3ba-357e6ea42f9c'}, 'volume_type': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:42:51 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:42:51 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:42:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tYhvpsGw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:42:51 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:42:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:42:51 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:42:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:42:51 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e89e5b5-3e7b-477a-8fe5-17c7b81de449]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:42:51 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be49b79-b579-4ca9-affd-e5448c2a6361]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6] added
Nov 15 02:42:51 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4345c166-de87-4e6e-a177-94d3f5b505fc]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[121cdee0-660c-4481-b6ce-c221cb28c485]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tYhvpsGw {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tYhvpsGw" returned: 0 in 0.035s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5434135-3465-408b-b163-ba6c9d3a914b]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tYhvpsGw'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef87a3c5-1d61-4979-8d99-cf8d936e3400]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c49aa4-b3b9-4dda-914b-5c18d31bce36]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:42:51 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:42:51 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2957d31b-bd79-43da-9fbd-879883766007]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6, portal: 172.16.0.220,3260]
Nov 15 02:42:51 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6, portal: 172.16.0.220,3260] successful.
Nov 15 02:42:51 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d357de0-eda7-4634-93b8-e52569e46b1b]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45a7380-0c4f-4c00-8b0f-f0f755429a55]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:42:51 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:42:51 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:42:51 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:42:51 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG nova.network.neutron [req-bcae75a5-8112-41ba-9cef-75ecda02d27b req-d565e4e5-fed5-4c0e-8676-99e4fbcf1436 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Updated VIF entry in instance network info cache for port c2725a77-bc15-423e-9795-49c2647a2d82. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG nova.network.neutron [req-bcae75a5-8112-41ba-9cef-75ecda02d27b req-d565e4e5-fed5-4c0e-8676-99e4fbcf1436 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Updating instance_info_cache with network_info: [{"id": "dea6d9d9-b176-440e-9589-d8d8def6471d", "address": "fa:16:3e:9f:29:46", "network": {"id": "e1a8c17d-9960-4500-9f24-e3a447dba928", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-521564942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea6d9d9-b1", "ovs_interfaceid": "dea6d9d9-b176-440e-9589-d8d8def6471d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f659917-6ad3-4ccc-ac49-622470b330aa", "address": "fa:16:3e:16:a3:74", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f659917-6a", "ovs_interfaceid": "7f659917-6ad3-4ccc-ac49-622470b330aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51356594-af31-476d-a34b-697c80f519c8", "address": "fa:16:3e:45:1b:c0", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51356594-af", "ovs_interfaceid": "51356594-af31-476d-a34b-697c80f519c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2100ab6d-db20-43a9-ba96-d9630430c14f", "address": "fa:16:3e:3e:62:83", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2100ab6d-db", "ovs_interfaceid": "2100ab6d-db20-43a9-ba96-d9630430c14f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a60510f0-b568-4276-914e-3c8cd49eafe5", "address": "fa:16:3e:5d:21:af", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa60510f0-b5", "ovs_interfaceid": "a60510f0-b568-4276-914e-3c8cd49eafe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9425c66c-2e1e-43e3-b611-70477c102b95", "address": "fa:16:3e:fb:32:26", "network": {"id": "594b2a44-0933-4ecd-ae26-5fd6f9582d15", "bridge": "br-int", "label": "tempest-device-tagging-net2-996422155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9425c66c-2e", "ovs_interfaceid": "9425c66c-2e1e-43e3-b611-70477c102b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2725a77-bc15-423e-9795-49c2647a2d82", "address": "fa:16:3e:ca:82:17", "network": {"id": "594b2a44-0933-4ecd-ae26-5fd6f9582d15", "bridge": "br-int", "label": "tempest-device-tagging-net2-996422155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2725a77-bc", "ovs_interfaceid": "c2725a77-bc15-423e-9795-49c2647a2d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1de89f-2a94-4590-bb36-ac24a9dc86f1]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tYhvpsGw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:42:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bcae75a5-8112-41ba-9cef-75ecda02d27b req-d565e4e5-fed5-4c0e-8676-99e4fbcf1436 service nova] Releasing lock "refresh_cache-2fb1dc69-6781-4a4f-a43f-9165d6dae447" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26532303263323934', 'path': '/dev/sdc'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532303263323934', 'path': '/dev/sdc'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIMPVjRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:42:52 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:42:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:42:52 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:42:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:42:52 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:42:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3374f04e-2c6b-4fd9-90b2-c56760503060]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:42:52 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc571ad9-ddab-4898-8cf5-72cab55fe23e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d] added
Nov 15 02:42:52 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1351349c-1f42-4a5f-9b5c-dc700ec88bce]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b298dd64-440a-4f61-a6eb-80c26ab6aecd]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rIMPVjRZ {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rIMPVjRZ" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc7a022-9f2f-467a-b540-d80ba0c0a43f]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rIMPVjRZ'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c0111b-93d7-4d14-95f6-3580904741c5]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc56a38-9377-4f0c-a30a-338f1f21ad69]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:42:52 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:42:52 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:42:52 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:42:52 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:42:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:53 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd93ee1-8de2-46e2-bfd4-3c1de4239a29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:53 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d, portal: 172.16.0.220,3260]
Nov 15 02:42:53 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d, portal: 172.16.0.220,3260] successful.
Nov 15 02:42:53 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:53 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[10682d05-3577-4e0f-a10f-03fbbf74ec99]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:53 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:53 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cd9197-dbfb-47c0-8f0d-ac84e21f212a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:53 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:42:53 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:42:53 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:42:53 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:42:53 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:42:53 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:42:53 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:42:53 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:42:53 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:42:53 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:42:53 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:42:53 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:42:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:53 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec721835-7735-4df6-b0cb-6ba3c86f794b]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:53 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:42:53 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIMPVjRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:42:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:53 user nova-compute[75391]: DEBUG nova.compute.manager [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:42:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:53 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:42:53 user nova-compute[75391]: INFO nova.compute.claims [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Claim successful on node user
Nov 15 02:42:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23838373365396533', 'path': '/dev/sdd'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838373365396533', 'path': '/dev/sdd'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCwjuLiA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:42:54 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:42:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:42:54 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:42:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:42:54 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d51167c-c0eb-411e-9d76-41ed1d61cb56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:42:54 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae83f3b-984b-4a24-a769-2b653f7adeac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c] added
Nov 15 02:42:54 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e624ff6f-cce0-4813-90a0-ab155a5114c3]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02bb0f5-b2bf-44a3-aa5c-1049f05a548b]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sCwjuLiA {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.505s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG nova.compute.manager [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sCwjuLiA" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb11a5fd-70ab-4c68-875d-9c3d536d8012]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sCwjuLiA'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1128a016-8c5b-4955-ad2e-816e025ea1b4]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[81de04c1-4dc2-4d1a-8e86-913cc64c1a8f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:42:54 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:42:54 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:42:54 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:42:54 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:42:54 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:42:54 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG nova.compute.manager [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG nova.network.neutron [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:42:54 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:42:54 user nova-compute[75391]: DEBUG nova.compute.manager [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[67138fa7-764d-4d7f-a0a3-fd7c1957711f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c, portal: 172.16.0.220,3260]
Nov 15 02:42:54 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c, portal: 172.16.0.220,3260] successful.
Nov 15 02:42:54 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG nova.policy [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80bf1a1698dc420799dbaf2e254e5d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0ca1f6ce542a482164410c5e67e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ed785a-92a6-49a2-b589-dbc2d65ca4fc]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0694e64-44ea-4b24-b0e5-7cf5d4adcd79]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:42:54 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:42:54 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:42:54 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:42:54 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:42:54 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:42:54 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:42:54 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:42:54 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba6eda8-f3d8-40a6-8506-c1aa283788ff]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCwjuLiA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG nova.compute.manager [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:42:54 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Creating image(s)
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "/opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "/opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "/opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.061s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.172s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.174s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk 1073741824" returned: 0 in 0.057s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.network.neutron [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Successfully created port: b89e475f-2d05-4427-81aa-64a19c9664ee {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.233s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Checking if we can resize image /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Cannot resize image /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Ensure instance console log exists: /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23235666237616533', 'path': '/dev/sde'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235666237616533', 'path': '/dev/sde'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1018077259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1018077259',id=10,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFxBIJtMc6rdEEE5PmtCZZuasEZKTJPyJbYNRf7xKiToeZC5XJLYc37PvHDM4IIDRTo34kL9xnqrJnk7+ChGOAisKWVRibv9MKp3KSbdcqN5xajEODL2a30tQyo5fQiug==',key_name='tempest-keypair-58485789',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1286381f6f484f8ca35024e8386f5c03',ramdisk_id='',reservation_id='r-iiwbby7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1936342241',owner_user_name='tempest-TaggedBootDevicesTest-1936342241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bada9568d8784e109d917376e03afeb9',uuid=2fb1dc69-6781-4a4f-a43f-9165d6dae447,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dea6d9d9-b176-440e-9589-d8d8def6471d", "address": "fa:16:3e:9f:29:46", "network": {"id": "e1a8c17d-9960-4500-9f24-e3a447dba928", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-521564942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea6d9d9-b1", "ovs_interfaceid": "dea6d9d9-b176-440e-9589-d8d8def6471d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converting VIF {"id": "dea6d9d9-b176-440e-9589-d8d8def6471d", "address": "fa:16:3e:9f:29:46", "network": {"id": "e1a8c17d-9960-4500-9f24-e3a447dba928", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-521564942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea6d9d9-b1", "ovs_interfaceid": "dea6d9d9-b176-440e-9589-d8d8def6471d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:29:46,bridge_name='br-int',has_traffic_filtering=True,id=dea6d9d9-b176-440e-9589-d8d8def6471d,network=Network(e1a8c17d-9960-4500-9f24-e3a447dba928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdea6d9d9-b1') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1018077259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1018077259',id=10,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFxBIJtMc6rdEEE5PmtCZZuasEZKTJPyJbYNRf7xKiToeZC5XJLYc37PvHDM4IIDRTo34kL9xnqrJnk7+ChGOAisKWVRibv9MKp3KSbdcqN5xajEODL2a30tQyo5fQiug==',key_name='tempest-keypair-58485789',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1286381f6f484f8ca35024e8386f5c03',ramdisk_id='',reservation_id='r-iiwbby7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1936342241',owner_user_name='tempest-TaggedBootDevicesTest-1936342241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bada9568d8784e109d917376e03afeb9',uuid=2fb1dc69-6781-4a4f-a43f-9165d6dae447,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f659917-6ad3-4ccc-ac49-622470b330aa", "address": "fa:16:3e:16:a3:74", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f659917-6a", "ovs_interfaceid": "7f659917-6ad3-4ccc-ac49-622470b330aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converting VIF {"id": "7f659917-6ad3-4ccc-ac49-622470b330aa", "address": "fa:16:3e:16:a3:74", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f659917-6a", "ovs_interfaceid": "7f659917-6ad3-4ccc-ac49-622470b330aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:a3:74,bridge_name='br-int',has_traffic_filtering=True,id=7f659917-6ad3-4ccc-ac49-622470b330aa,network=Network(477acc99-8e84-4441-96c4-fddf8a5b5a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f659917-6a') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1018077259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1018077259',id=10,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFxBIJtMc6rdEEE5PmtCZZuasEZKTJPyJbYNRf7xKiToeZC5XJLYc37PvHDM4IIDRTo34kL9xnqrJnk7+ChGOAisKWVRibv9MKp3KSbdcqN5xajEODL2a30tQyo5fQiug==',key_name='tempest-keypair-58485789',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1286381f6f484f8ca35024e8386f5c03',ramdisk_id='',reservation_id='r-iiwbby7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1936342241',owner_user_name='tempest-TaggedBootDevicesTest-1936342241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bada9568d8784e109d917376e03afeb9',uuid=2fb1dc69-6781-4a4f-a43f-9165d6dae447,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51356594-af31-476d-a34b-697c80f519c8", "address": "fa:16:3e:45:1b:c0", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51356594-af", "ovs_interfaceid": "51356594-af31-476d-a34b-697c80f519c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converting VIF {"id": "51356594-af31-476d-a34b-697c80f519c8", "address": "fa:16:3e:45:1b:c0", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51356594-af", "ovs_interfaceid": "51356594-af31-476d-a34b-697c80f519c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:1b:c0,bridge_name='br-int',has_traffic_filtering=True,id=51356594-af31-476d-a34b-697c80f519c8,network=Network(477acc99-8e84-4441-96c4-fddf8a5b5a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51356594-af') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1018077259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1018077259',id=10,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFxBIJtMc6rdEEE5PmtCZZuasEZKTJPyJbYNRf7xKiToeZC5XJLYc37PvHDM4IIDRTo34kL9xnqrJnk7+ChGOAisKWVRibv9MKp3KSbdcqN5xajEODL2a30tQyo5fQiug==',key_name='tempest-keypair-58485789',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1286381f6f484f8ca35024e8386f5c03',ramdisk_id='',reservation_id='r-iiwbby7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1936342241',owner_user_name='tempest-TaggedBootDevicesTest-1936342241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bada9568d8784e109d917376e03afeb9',uuid=2fb1dc69-6781-4a4f-a43f-9165d6dae447,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2100ab6d-db20-43a9-ba96-d9630430c14f", "address": "fa:16:3e:3e:62:83", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2100ab6d-db", "ovs_interfaceid": "2100ab6d-db20-43a9-ba96-d9630430c14f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converting VIF {"id": "2100ab6d-db20-43a9-ba96-d9630430c14f", "address": "fa:16:3e:3e:62:83", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2100ab6d-db", "ovs_interfaceid": "2100ab6d-db20-43a9-ba96-d9630430c14f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:62:83,bridge_name='br-int',has_traffic_filtering=True,id=2100ab6d-db20-43a9-ba96-d9630430c14f,network=Network(477acc99-8e84-4441-96c4-fddf8a5b5a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2100ab6d-db') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1018077259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1018077259',id=10,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFxBIJtMc6rdEEE5PmtCZZuasEZKTJPyJbYNRf7xKiToeZC5XJLYc37PvHDM4IIDRTo34kL9xnqrJnk7+ChGOAisKWVRibv9MKp3KSbdcqN5xajEODL2a30tQyo5fQiug==',key_name='tempest-keypair-58485789',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1286381f6f484f8ca35024e8386f5c03',ramdisk_id='',reservation_id='r-iiwbby7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1936342241',owner_user_name='tempest-TaggedBootDevicesTest-1936342241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bada9568d8784e109d917376e03afeb9',uuid=2fb1dc69-6781-4a4f-a43f-9165d6dae447,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a60510f0-b568-4276-914e-3c8cd49eafe5", "address": "fa:16:3e:5d:21:af", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa60510f0-b5", "ovs_interfaceid": "a60510f0-b568-4276-914e-3c8cd49eafe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converting VIF {"id": "a60510f0-b568-4276-914e-3c8cd49eafe5", "address": "fa:16:3e:5d:21:af", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa60510f0-b5", "ovs_interfaceid": "a60510f0-b568-4276-914e-3c8cd49eafe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:21:af,bridge_name='br-int',has_traffic_filtering=True,id=a60510f0-b568-4276-914e-3c8cd49eafe5,network=Network(477acc99-8e84-4441-96c4-fddf8a5b5a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa60510f0-b5') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1018077259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1018077259',id=10,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFxBIJtMc6rdEEE5PmtCZZuasEZKTJPyJbYNRf7xKiToeZC5XJLYc37PvHDM4IIDRTo34kL9xnqrJnk7+ChGOAisKWVRibv9MKp3KSbdcqN5xajEODL2a30tQyo5fQiug==',key_name='tempest-keypair-58485789',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1286381f6f484f8ca35024e8386f5c03',ramdisk_id='',reservation_id='r-iiwbby7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1936342241',owner_user_name='tempest-TaggedBootDevicesTest-1936342241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bada9568d8784e109d917376e03afeb9',uuid=2fb1dc69-6781-4a4f-a43f-9165d6dae447,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9425c66c-2e1e-43e3-b611-70477c102b95", "address": "fa:16:3e:fb:32:26", "network": {"id": "594b2a44-0933-4ecd-ae26-5fd6f9582d15", "bridge": "br-int", "label": "tempest-device-tagging-net2-996422155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9425c66c-2e", "ovs_interfaceid": "9425c66c-2e1e-43e3-b611-70477c102b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converting VIF {"id": "9425c66c-2e1e-43e3-b611-70477c102b95", "address": "fa:16:3e:fb:32:26", "network": {"id": "594b2a44-0933-4ecd-ae26-5fd6f9582d15", "bridge": "br-int", "label": "tempest-device-tagging-net2-996422155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9425c66c-2e", "ovs_interfaceid": "9425c66c-2e1e-43e3-b611-70477c102b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:32:26,bridge_name='br-int',has_traffic_filtering=True,id=9425c66c-2e1e-43e3-b611-70477c102b95,network=Network(594b2a44-0933-4ecd-ae26-5fd6f9582d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9425c66c-2e') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1018077259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1018077259',id=10,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFxBIJtMc6rdEEE5PmtCZZuasEZKTJPyJbYNRf7xKiToeZC5XJLYc37PvHDM4IIDRTo34kL9xnqrJnk7+ChGOAisKWVRibv9MKp3KSbdcqN5xajEODL2a30tQyo5fQiug==',key_name='tempest-keypair-58485789',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1286381f6f484f8ca35024e8386f5c03',ramdisk_id='',reservation_id='r-iiwbby7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1936342241',owner_user_name='tempest-TaggedBootDevicesTest-1936342241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bada9568d8784e109d917376e03afeb9',uuid=2fb1dc69-6781-4a4f-a43f-9165d6dae447,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2725a77-bc15-423e-9795-49c2647a2d82", "address": "fa:16:3e:ca:82:17", "network": {"id": "594b2a44-0933-4ecd-ae26-5fd6f9582d15", "bridge": "br-int", "label": "tempest-device-tagging-net2-996422155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2725a77-bc", "ovs_interfaceid": "c2725a77-bc15-423e-9795-49c2647a2d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converting VIF {"id": "c2725a77-bc15-423e-9795-49c2647a2d82", "address": "fa:16:3e:ca:82:17", "network": {"id": "594b2a44-0933-4ecd-ae26-5fd6f9582d15", "bridge": "br-int", "label": "tempest-device-tagging-net2-996422155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2725a77-bc", "ovs_interfaceid": "c2725a77-bc15-423e-9795-49c2647a2d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:82:17,bridge_name='br-int',has_traffic_filtering=True,id=c2725a77-bc15-423e-9795-49c2647a2d82,network=Network(594b2a44-0933-4ecd-ae26-5fd6f9582d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2725a77-bc') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.objects.instance [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lazy-loading 'pci_devices' on Instance uuid 2fb1dc69-6781-4a4f-a43f-9165d6dae447 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:42:55 user nova-compute[75391]:   <uuid>2fb1dc69-6781-4a4f-a43f-9165d6dae447</uuid>
Nov 15 02:42:55 user nova-compute[75391]:   <name>instance-0000000a</name>
Nov 15 02:42:55 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:42:55 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:42:55 user nova-compute[75391]:   <metadata>
Nov 15 02:42:55 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:42:55 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:42:55 user nova-compute[75391]:       <nova:name>tempest-device-tagging-server-1018077259</nova:name>
Nov 15 02:42:55 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:42:51</nova:creationTime>
Nov 15 02:42:55 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:42:55 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:42:55 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:42:55 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:42:55 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:42:55 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:42:55 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:42:55 user nova-compute[75391]:       <nova:owner>
Nov 15 02:42:55 user nova-compute[75391]:         <nova:user uuid="bada9568d8784e109d917376e03afeb9">tempest-TaggedBootDevicesTest-1936342241-project-member</nova:user>
Nov 15 02:42:55 user nova-compute[75391]:         <nova:project uuid="1286381f6f484f8ca35024e8386f5c03">tempest-TaggedBootDevicesTest-1936342241</nova:project>
Nov 15 02:42:55 user nova-compute[75391]:       </nova:owner>
Nov 15 02:42:55 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:42:55 user nova-compute[75391]:       <nova:ports>
Nov 15 02:42:55 user nova-compute[75391]:         <nova:port uuid="dea6d9d9-b176-440e-9589-d8d8def6471d">
Nov 15 02:42:55 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 02:42:55 user nova-compute[75391]:         </nova:port>
Nov 15 02:42:55 user nova-compute[75391]:         <nova:port uuid="7f659917-6ad3-4ccc-ac49-622470b330aa">
Nov 15 02:42:55 user nova-compute[75391]:           <nova:ip type="fixed" address="10.1.1.12" ipVersion="4"/>
Nov 15 02:42:55 user nova-compute[75391]:         </nova:port>
Nov 15 02:42:55 user nova-compute[75391]:         <nova:port uuid="51356594-af31-476d-a34b-697c80f519c8">
Nov 15 02:42:55 user nova-compute[75391]:           <nova:ip type="fixed" address="10.1.1.23" ipVersion="4"/>
Nov 15 02:42:55 user nova-compute[75391]:         </nova:port>
Nov 15 02:42:55 user nova-compute[75391]:         <nova:port uuid="2100ab6d-db20-43a9-ba96-d9630430c14f">
Nov 15 02:42:55 user nova-compute[75391]:           <nova:ip type="fixed" address="10.1.1.10" ipVersion="4"/>
Nov 15 02:42:55 user nova-compute[75391]:         </nova:port>
Nov 15 02:42:55 user nova-compute[75391]:         <nova:port uuid="a60510f0-b568-4276-914e-3c8cd49eafe5">
Nov 15 02:42:55 user nova-compute[75391]:           <nova:ip type="fixed" address="10.1.1.39" ipVersion="4"/>
Nov 15 02:42:55 user nova-compute[75391]:         </nova:port>
Nov 15 02:42:55 user nova-compute[75391]:         <nova:port uuid="9425c66c-2e1e-43e3-b611-70477c102b95">
Nov 15 02:42:55 user nova-compute[75391]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 15 02:42:55 user nova-compute[75391]:         </nova:port>
Nov 15 02:42:55 user nova-compute[75391]:         <nova:port uuid="c2725a77-bc15-423e-9795-49c2647a2d82">
Nov 15 02:42:55 user nova-compute[75391]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 15 02:42:55 user nova-compute[75391]:         </nova:port>
Nov 15 02:42:55 user nova-compute[75391]:       </nova:ports>
Nov 15 02:42:55 user nova-compute[75391]:     </nova:instance>
Nov 15 02:42:55 user nova-compute[75391]:   </metadata>
Nov 15 02:42:55 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:42:55 user nova-compute[75391]:     <system>
Nov 15 02:42:55 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:42:55 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:42:55 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:42:55 user nova-compute[75391]:       <entry name="serial">2fb1dc69-6781-4a4f-a43f-9165d6dae447</entry>
Nov 15 02:42:55 user nova-compute[75391]:       <entry name="uuid">2fb1dc69-6781-4a4f-a43f-9165d6dae447</entry>
Nov 15 02:42:55 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:42:55 user nova-compute[75391]:     </system>
Nov 15 02:42:55 user nova-compute[75391]:   </sysinfo>
Nov 15 02:42:55 user nova-compute[75391]:   <os>
Nov 15 02:42:55 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:42:55 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:42:55 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:42:55 user nova-compute[75391]:   </os>
Nov 15 02:42:55 user nova-compute[75391]:   <features>
Nov 15 02:42:55 user nova-compute[75391]:     <acpi/>
Nov 15 02:42:55 user nova-compute[75391]:     <apic/>
Nov 15 02:42:55 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:42:55 user nova-compute[75391]:   </features>
Nov 15 02:42:55 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:42:55 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:42:55 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:42:55 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:42:55 user nova-compute[75391]:   </clock>
Nov 15 02:42:55 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:42:55 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:42:55 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:42:55 user nova-compute[75391]:   </cpu>
Nov 15 02:42:55 user nova-compute[75391]:   <devices>
Nov 15 02:42:55 user nova-compute[75391]:     <disk type="file" device="cdrom">
Nov 15 02:42:55 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 02:42:55 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/2fb1dc69-6781-4a4f-a43f-9165d6dae447/disk.config"/>
Nov 15 02:42:55 user nova-compute[75391]:       <target dev="hda" bus="ide"/>
Nov 15 02:42:55 user nova-compute[75391]:     </disk>
Nov 15 02:42:55 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 02:42:55 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:42:55 user nova-compute[75391]:       <source dev="/dev/sdc"/>
Nov 15 02:42:55 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:42:55 user nova-compute[75391]:       <serial>6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6</serial>
Nov 15 02:42:55 user nova-compute[75391]:     </disk>
Nov 15 02:42:55 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 02:42:55 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:42:55 user nova-compute[75391]:       <source dev="/dev/sdd"/>
Nov 15 02:42:55 user nova-compute[75391]:       <target dev="vdb" bus="virtio"/>
Nov 15 02:42:55 user nova-compute[75391]:       <serial>3b426366-42eb-45d8-bcd4-0613db72180d</serial>
Nov 15 02:42:55 user nova-compute[75391]:     </disk>
Nov 15 02:42:55 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 02:42:55 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:42:55 user nova-compute[75391]:       <source dev="/dev/sde"/>
Nov 15 02:42:55 user nova-compute[75391]:       <target dev="vdc" bus="virtio"/>
Nov 15 02:42:55 user nova-compute[75391]:       <serial>c3897400-2d4d-48c5-b3ba-357e6ea42f9c</serial>
Nov 15 02:42:55 user nova-compute[75391]:     </disk>
Nov 15 02:42:55 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:42:55 user nova-compute[75391]:       <mac address="fa:16:3e:9f:29:46"/>
Nov 15 02:42:55 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:42:55 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:42:55 user nova-compute[75391]:       <target dev="tapdea6d9d9-b1"/>
Nov 15 02:42:55 user nova-compute[75391]:     </interface>
Nov 15 02:42:55 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:42:55 user nova-compute[75391]:       <mac address="fa:16:3e:16:a3:74"/>
Nov 15 02:42:55 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:42:55 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:42:55 user nova-compute[75391]:       <target dev="tap7f659917-6a"/>
Nov 15 02:42:55 user nova-compute[75391]:     </interface>
Nov 15 02:42:55 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:42:55 user nova-compute[75391]:       <mac address="fa:16:3e:45:1b:c0"/>
Nov 15 02:42:55 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:42:55 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:42:55 user nova-compute[75391]:       <target dev="tap51356594-af"/>
Nov 15 02:42:55 user nova-compute[75391]:     </interface>
Nov 15 02:42:55 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:42:55 user nova-compute[75391]:       <mac address="fa:16:3e:3e:62:83"/>
Nov 15 02:42:55 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:42:55 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:42:55 user nova-compute[75391]:       <target dev="tap2100ab6d-db"/>
Nov 15 02:42:55 user nova-compute[75391]:     </interface>
Nov 15 02:42:55 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:42:55 user nova-compute[75391]:       <mac address="fa:16:3e:5d:21:af"/>
Nov 15 02:42:55 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:42:55 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:42:55 user nova-compute[75391]:       <target dev="tapa60510f0-b5"/>
Nov 15 02:42:55 user nova-compute[75391]:     </interface>
Nov 15 02:42:55 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:42:55 user nova-compute[75391]:       <mac address="fa:16:3e:fb:32:26"/>
Nov 15 02:42:55 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:42:55 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:42:55 user nova-compute[75391]:       <target dev="tap9425c66c-2e"/>
Nov 15 02:42:55 user nova-compute[75391]:     </interface>
Nov 15 02:42:55 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:42:55 user nova-compute[75391]:       <mac address="fa:16:3e:ca:82:17"/>
Nov 15 02:42:55 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:42:55 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:42:55 user nova-compute[75391]:       <target dev="tapc2725a77-bc"/>
Nov 15 02:42:55 user nova-compute[75391]:     </interface>
Nov 15 02:42:55 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:42:55 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/2fb1dc69-6781-4a4f-a43f-9165d6dae447/console.log" append="off"/>
Nov 15 02:42:55 user nova-compute[75391]:     </serial>
Nov 15 02:42:55 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:42:55 user nova-compute[75391]:     <video>
Nov 15 02:42:55 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:42:55 user nova-compute[75391]:     </video>
Nov 15 02:42:55 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:42:55 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:42:55 user nova-compute[75391]:     </rng>
Nov 15 02:42:55 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:42:55 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:42:55 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:42:55 user nova-compute[75391]:     </memballoon>
Nov 15 02:42:55 user nova-compute[75391]:   </devices>
Nov 15 02:42:55 user nova-compute[75391]: </domain>
Nov 15 02:42:55 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1018077259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1018077259',id=10,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFxBIJtMc6rdEEE5PmtCZZuasEZKTJPyJbYNRf7xKiToeZC5XJLYc37PvHDM4IIDRTo34kL9xnqrJnk7+ChGOAisKWVRibv9MKp3KSbdcqN5xajEODL2a30tQyo5fQiug==',key_name='tempest-keypair-58485789',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1286381f6f484f8ca35024e8386f5c03',ramdisk_id='',reservation_id='r-iiwbby7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1936342241',owner_user_name='tempest-TaggedBootDevicesTest-1936342241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bada9568d8784e109d917376e03afeb9',uuid=2fb1dc69-6781-4a4f-a43f-9165d6dae447,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dea6d9d9-b176-440e-9589-d8d8def6471d", "address": "fa:16:3e:9f:29:46", "network": {"id": "e1a8c17d-9960-4500-9f24-e3a447dba928", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-521564942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea6d9d9-b1", "ovs_interfaceid": "dea6d9d9-b176-440e-9589-d8d8def6471d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converting VIF {"id": "dea6d9d9-b176-440e-9589-d8d8def6471d", "address": "fa:16:3e:9f:29:46", "network": {"id": "e1a8c17d-9960-4500-9f24-e3a447dba928", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-521564942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea6d9d9-b1", "ovs_interfaceid": "dea6d9d9-b176-440e-9589-d8d8def6471d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:29:46,bridge_name='br-int',has_traffic_filtering=True,id=dea6d9d9-b176-440e-9589-d8d8def6471d,network=Network(e1a8c17d-9960-4500-9f24-e3a447dba928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdea6d9d9-b1') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG os_vif [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:29:46,bridge_name='br-int',has_traffic_filtering=True,id=dea6d9d9-b176-440e-9589-d8d8def6471d,network=Network(e1a8c17d-9960-4500-9f24-e3a447dba928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdea6d9d9-b1') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2556de9d-c129-5bdc-a11c-324837dad876', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdea6d9d9-b1, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdea6d9d9-b1, col_values=(('qos', UUID('6266386d-7875-46ad-8635-f3197879ecf0')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdea6d9d9-b1, col_values=(('external_ids', {'iface-id': 'dea6d9d9-b176-440e-9589-d8d8def6471d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:29:46', 'vm-uuid': '2fb1dc69-6781-4a4f-a43f-9165d6dae447'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: INFO os_vif [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:29:46,bridge_name='br-int',has_traffic_filtering=True,id=dea6d9d9-b176-440e-9589-d8d8def6471d,network=Network(e1a8c17d-9960-4500-9f24-e3a447dba928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdea6d9d9-b1')
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1018077259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1018077259',id=10,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFxBIJtMc6rdEEE5PmtCZZuasEZKTJPyJbYNRf7xKiToeZC5XJLYc37PvHDM4IIDRTo34kL9xnqrJnk7+ChGOAisKWVRibv9MKp3KSbdcqN5xajEODL2a30tQyo5fQiug==',key_name='tempest-keypair-58485789',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1286381f6f484f8ca35024e8386f5c03',ramdisk_id='',reservation_id='r-iiwbby7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1936342241',owner_user_name='tempest-TaggedBootDevicesTest-1936342241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bada9568d8784e109d917376e03afeb9',uuid=2fb1dc69-6781-4a4f-a43f-9165d6dae447,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f659917-6ad3-4ccc-ac49-622470b330aa", "address": "fa:16:3e:16:a3:74", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f659917-6a", "ovs_interfaceid": "7f659917-6ad3-4ccc-ac49-622470b330aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converting VIF {"id": "7f659917-6ad3-4ccc-ac49-622470b330aa", "address": "fa:16:3e:16:a3:74", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f659917-6a", "ovs_interfaceid": "7f659917-6ad3-4ccc-ac49-622470b330aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:a3:74,bridge_name='br-int',has_traffic_filtering=True,id=7f659917-6ad3-4ccc-ac49-622470b330aa,network=Network(477acc99-8e84-4441-96c4-fddf8a5b5a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f659917-6a') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG os_vif [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a3:74,bridge_name='br-int',has_traffic_filtering=True,id=7f659917-6ad3-4ccc-ac49-622470b330aa,network=Network(477acc99-8e84-4441-96c4-fddf8a5b5a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f659917-6a') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '17e0a090-2e2e-550b-8037-d95a7b4a3a73', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f659917-6a, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f659917-6a, col_values=(('qos', UUID('e974c703-41f6-4fa8-8e00-6c932a7d46a1')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f659917-6a, col_values=(('external_ids', {'iface-id': '7f659917-6ad3-4ccc-ac49-622470b330aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:a3:74', 'vm-uuid': '2fb1dc69-6781-4a4f-a43f-9165d6dae447'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: INFO os_vif [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a3:74,bridge_name='br-int',has_traffic_filtering=True,id=7f659917-6ad3-4ccc-ac49-622470b330aa,network=Network(477acc99-8e84-4441-96c4-fddf8a5b5a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f659917-6a')
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1018077259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1018077259',id=10,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFxBIJtMc6rdEEE5PmtCZZuasEZKTJPyJbYNRf7xKiToeZC5XJLYc37PvHDM4IIDRTo34kL9xnqrJnk7+ChGOAisKWVRibv9MKp3KSbdcqN5xajEODL2a30tQyo5fQiug==',key_name='tempest-keypair-58485789',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1286381f6f484f8ca35024e8386f5c03',ramdisk_id='',reservation_id='r-iiwbby7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1936342241',owner_user_name='tempest-TaggedBootDevicesTest-1936342241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bada9568d8784e109d917376e03afeb9',uuid=2fb1dc69-6781-4a4f-a43f-9165d6dae447,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51356594-af31-476d-a34b-697c80f519c8", "address": "fa:16:3e:45:1b:c0", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51356594-af", "ovs_interfaceid": "51356594-af31-476d-a34b-697c80f519c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converting VIF {"id": "51356594-af31-476d-a34b-697c80f519c8", "address": "fa:16:3e:45:1b:c0", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51356594-af", "ovs_interfaceid": "51356594-af31-476d-a34b-697c80f519c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:1b:c0,bridge_name='br-int',has_traffic_filtering=True,id=51356594-af31-476d-a34b-697c80f519c8,network=Network(477acc99-8e84-4441-96c4-fddf8a5b5a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51356594-af') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG os_vif [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:1b:c0,bridge_name='br-int',has_traffic_filtering=True,id=51356594-af31-476d-a34b-697c80f519c8,network=Network(477acc99-8e84-4441-96c4-fddf8a5b5a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51356594-af') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2470420a-727b-5739-be2c-179fdb0344c6', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51356594-af, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51356594-af, col_values=(('qos', UUID('e63a33d0-4f05-40d6-b38b-c33f13f94dc5')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51356594-af, col_values=(('external_ids', {'iface-id': '51356594-af31-476d-a34b-697c80f519c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:1b:c0', 'vm-uuid': '2fb1dc69-6781-4a4f-a43f-9165d6dae447'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: INFO os_vif [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:1b:c0,bridge_name='br-int',has_traffic_filtering=True,id=51356594-af31-476d-a34b-697c80f519c8,network=Network(477acc99-8e84-4441-96c4-fddf8a5b5a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51356594-af')
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1018077259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1018077259',id=10,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFxBIJtMc6rdEEE5PmtCZZuasEZKTJPyJbYNRf7xKiToeZC5XJLYc37PvHDM4IIDRTo34kL9xnqrJnk7+ChGOAisKWVRibv9MKp3KSbdcqN5xajEODL2a30tQyo5fQiug==',key_name='tempest-keypair-58485789',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1286381f6f484f8ca35024e8386f5c03',ramdisk_id='',reservation_id='r-iiwbby7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1936342241',owner_user_name='tempest-TaggedBootDevicesTest-1936342241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bada9568d8784e109d917376e03afeb9',uuid=2fb1dc69-6781-4a4f-a43f-9165d6dae447,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2100ab6d-db20-43a9-ba96-d9630430c14f", "address": "fa:16:3e:3e:62:83", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2100ab6d-db", "ovs_interfaceid": "2100ab6d-db20-43a9-ba96-d9630430c14f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converting VIF {"id": "2100ab6d-db20-43a9-ba96-d9630430c14f", "address": "fa:16:3e:3e:62:83", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2100ab6d-db", "ovs_interfaceid": "2100ab6d-db20-43a9-ba96-d9630430c14f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:62:83,bridge_name='br-int',has_traffic_filtering=True,id=2100ab6d-db20-43a9-ba96-d9630430c14f,network=Network(477acc99-8e84-4441-96c4-fddf8a5b5a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2100ab6d-db') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG os_vif [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:62:83,bridge_name='br-int',has_traffic_filtering=True,id=2100ab6d-db20-43a9-ba96-d9630430c14f,network=Network(477acc99-8e84-4441-96c4-fddf8a5b5a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2100ab6d-db') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '060829b6-fdbd-5b5e-86ea-08631cbf9b55', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2100ab6d-db, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2100ab6d-db, col_values=(('qos', UUID('aeb3f525-046e-4491-a6f9-a101368b0e85')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2100ab6d-db, col_values=(('external_ids', {'iface-id': '2100ab6d-db20-43a9-ba96-d9630430c14f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:62:83', 'vm-uuid': '2fb1dc69-6781-4a4f-a43f-9165d6dae447'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.network.neutron [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Successfully updated port: b89e475f-2d05-4427-81aa-64a19c9664ee {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "refresh_cache-38a63a30-a3bc-4556-9fb6-53522dbf2c68" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquired lock "refresh_cache-38a63a30-a3bc-4556-9fb6-53522dbf2c68" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.network.neutron [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:42:55 user nova-compute[75391]: INFO os_vif [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:62:83,bridge_name='br-int',has_traffic_filtering=True,id=2100ab6d-db20-43a9-ba96-d9630430c14f,network=Network(477acc99-8e84-4441-96c4-fddf8a5b5a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2100ab6d-db')
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1018077259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1018077259',id=10,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFxBIJtMc6rdEEE5PmtCZZuasEZKTJPyJbYNRf7xKiToeZC5XJLYc37PvHDM4IIDRTo34kL9xnqrJnk7+ChGOAisKWVRibv9MKp3KSbdcqN5xajEODL2a30tQyo5fQiug==',key_name='tempest-keypair-58485789',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1286381f6f484f8ca35024e8386f5c03',ramdisk_id='',reservation_id='r-iiwbby7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1936342241',owner_user_name='tempest-TaggedBootDevicesTest-1936342241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bada9568d8784e109d917376e03afeb9',uuid=2fb1dc69-6781-4a4f-a43f-9165d6dae447,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a60510f0-b568-4276-914e-3c8cd49eafe5", "address": "fa:16:3e:5d:21:af", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa60510f0-b5", "ovs_interfaceid": "a60510f0-b568-4276-914e-3c8cd49eafe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converting VIF {"id": "a60510f0-b568-4276-914e-3c8cd49eafe5", "address": "fa:16:3e:5d:21:af", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa60510f0-b5", "ovs_interfaceid": "a60510f0-b568-4276-914e-3c8cd49eafe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:21:af,bridge_name='br-int',has_traffic_filtering=True,id=a60510f0-b568-4276-914e-3c8cd49eafe5,network=Network(477acc99-8e84-4441-96c4-fddf8a5b5a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa60510f0-b5') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG os_vif [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:21:af,bridge_name='br-int',has_traffic_filtering=True,id=a60510f0-b568-4276-914e-3c8cd49eafe5,network=Network(477acc99-8e84-4441-96c4-fddf8a5b5a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa60510f0-b5') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a440b513-f36a-566b-96fa-d41b48a0c1df', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.compute.manager [req-70a2d73a-f3ce-47cb-b19f-73b4452d904b req-7b2318f4-766a-4db4-9ec0-319d9788105d service nova] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Received event network-changed-b89e475f-2d05-4427-81aa-64a19c9664ee {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.compute.manager [req-70a2d73a-f3ce-47cb-b19f-73b4452d904b req-7b2318f4-766a-4db4-9ec0-319d9788105d service nova] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Refreshing instance network info cache due to event network-changed-b89e475f-2d05-4427-81aa-64a19c9664ee. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-70a2d73a-f3ce-47cb-b19f-73b4452d904b req-7b2318f4-766a-4db4-9ec0-319d9788105d service nova] Acquiring lock "refresh_cache-38a63a30-a3bc-4556-9fb6-53522dbf2c68" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa60510f0-b5, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa60510f0-b5, col_values=(('qos', UUID('a1f0cc48-a838-4a18-b579-4db0c1872ead')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa60510f0-b5, col_values=(('external_ids', {'iface-id': 'a60510f0-b568-4276-914e-3c8cd49eafe5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:21:af', 'vm-uuid': '2fb1dc69-6781-4a4f-a43f-9165d6dae447'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:55 user nova-compute[75391]: DEBUG nova.network.neutron [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:56 user nova-compute[75391]: INFO os_vif [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:21:af,bridge_name='br-int',has_traffic_filtering=True,id=a60510f0-b568-4276-914e-3c8cd49eafe5,network=Network(477acc99-8e84-4441-96c4-fddf8a5b5a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa60510f0-b5')
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1018077259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1018077259',id=10,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFxBIJtMc6rdEEE5PmtCZZuasEZKTJPyJbYNRf7xKiToeZC5XJLYc37PvHDM4IIDRTo34kL9xnqrJnk7+ChGOAisKWVRibv9MKp3KSbdcqN5xajEODL2a30tQyo5fQiug==',key_name='tempest-keypair-58485789',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1286381f6f484f8ca35024e8386f5c03',ramdisk_id='',reservation_id='r-iiwbby7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1936342241',owner_user_name='tempest-TaggedBootDevicesTest-1936342241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bada9568d8784e109d917376e03afeb9',uuid=2fb1dc69-6781-4a4f-a43f-9165d6dae447,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9425c66c-2e1e-43e3-b611-70477c102b95", "address": "fa:16:3e:fb:32:26", "network": {"id": "594b2a44-0933-4ecd-ae26-5fd6f9582d15", "bridge": "br-int", "label": "tempest-device-tagging-net2-996422155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9425c66c-2e", "ovs_interfaceid": "9425c66c-2e1e-43e3-b611-70477c102b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converting VIF {"id": "9425c66c-2e1e-43e3-b611-70477c102b95", "address": "fa:16:3e:fb:32:26", "network": {"id": "594b2a44-0933-4ecd-ae26-5fd6f9582d15", "bridge": "br-int", "label": "tempest-device-tagging-net2-996422155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9425c66c-2e", "ovs_interfaceid": "9425c66c-2e1e-43e3-b611-70477c102b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:32:26,bridge_name='br-int',has_traffic_filtering=True,id=9425c66c-2e1e-43e3-b611-70477c102b95,network=Network(594b2a44-0933-4ecd-ae26-5fd6f9582d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9425c66c-2e') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG os_vif [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:32:26,bridge_name='br-int',has_traffic_filtering=True,id=9425c66c-2e1e-43e3-b611-70477c102b95,network=Network(594b2a44-0933-4ecd-ae26-5fd6f9582d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9425c66c-2e') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22431100-4ddb-55d0-acd7-85a2ab92530e', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9425c66c-2e, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9425c66c-2e, col_values=(('qos', UUID('078526d1-1083-41c6-86ee-56790c24dfd2')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9425c66c-2e, col_values=(('external_ids', {'iface-id': '9425c66c-2e1e-43e3-b611-70477c102b95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:32:26', 'vm-uuid': '2fb1dc69-6781-4a4f-a43f-9165d6dae447'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:56 user nova-compute[75391]: INFO os_vif [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:32:26,bridge_name='br-int',has_traffic_filtering=True,id=9425c66c-2e1e-43e3-b611-70477c102b95,network=Network(594b2a44-0933-4ecd-ae26-5fd6f9582d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9425c66c-2e')
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1018077259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1018077259',id=10,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFxBIJtMc6rdEEE5PmtCZZuasEZKTJPyJbYNRf7xKiToeZC5XJLYc37PvHDM4IIDRTo34kL9xnqrJnk7+ChGOAisKWVRibv9MKp3KSbdcqN5xajEODL2a30tQyo5fQiug==',key_name='tempest-keypair-58485789',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1286381f6f484f8ca35024e8386f5c03',ramdisk_id='',reservation_id='r-iiwbby7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1936342241',owner_user_name='tempest-TaggedBootDevicesTest-1936342241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bada9568d8784e109d917376e03afeb9',uuid=2fb1dc69-6781-4a4f-a43f-9165d6dae447,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2725a77-bc15-423e-9795-49c2647a2d82", "address": "fa:16:3e:ca:82:17", "network": {"id": "594b2a44-0933-4ecd-ae26-5fd6f9582d15", "bridge": "br-int", "label": "tempest-device-tagging-net2-996422155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2725a77-bc", "ovs_interfaceid": "c2725a77-bc15-423e-9795-49c2647a2d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converting VIF {"id": "c2725a77-bc15-423e-9795-49c2647a2d82", "address": "fa:16:3e:ca:82:17", "network": {"id": "594b2a44-0933-4ecd-ae26-5fd6f9582d15", "bridge": "br-int", "label": "tempest-device-tagging-net2-996422155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2725a77-bc", "ovs_interfaceid": "c2725a77-bc15-423e-9795-49c2647a2d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:82:17,bridge_name='br-int',has_traffic_filtering=True,id=c2725a77-bc15-423e-9795-49c2647a2d82,network=Network(594b2a44-0933-4ecd-ae26-5fd6f9582d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2725a77-bc') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG os_vif [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:82:17,bridge_name='br-int',has_traffic_filtering=True,id=c2725a77-bc15-423e-9795-49c2647a2d82,network=Network(594b2a44-0933-4ecd-ae26-5fd6f9582d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2725a77-bc') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '549d375d-5ec1-54c6-9992-08f3340092a8', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2725a77-bc, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2725a77-bc, col_values=(('qos', UUID('6d9ae80a-6e6c-43ca-95b5-7c1c78d6eb15')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2725a77-bc, col_values=(('external_ids', {'iface-id': 'c2725a77-bc15-423e-9795-49c2647a2d82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:82:17', 'vm-uuid': '2fb1dc69-6781-4a4f-a43f-9165d6dae447'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:56 user nova-compute[75391]: INFO os_vif [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:82:17,bridge_name='br-int',has_traffic_filtering=True,id=c2725a77-bc15-423e-9795-49c2647a2d82,network=Network(594b2a44-0933-4ecd-ae26-5fd6f9582d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2725a77-bc')
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] No BDM found with device name hda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] No VIF found with MAC fa:16:3e:9f:29:46, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] No VIF found with MAC fa:16:3e:5d:21:af, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:42:56 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Using config drive
Nov 15 02:42:56 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Creating config drive at /opt/stack/data/nova/instances/2fb1dc69-6781-4a4f-a43f-9165d6dae447/disk.config
Nov 15 02:42:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2fb1dc69-6781-4a4f-a43f-9165d6dae447/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp93_d3qi2 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.network.neutron [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Updating instance_info_cache with network_info: [{"id": "b89e475f-2d05-4427-81aa-64a19c9664ee", "address": "fa:16:3e:8f:aa:98", "network": {"id": "5567560c-b3c5-4802-b758-92d672458351", "bridge": "br-int", "label": "tempest-TestStampPattern-268456575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e0ca1f6ce542a482164410c5e67e13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89e475f-2d", "ovs_interfaceid": "b89e475f-2d05-4427-81aa-64a19c9664ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2fb1dc69-6781-4a4f-a43f-9165d6dae447/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp93_d3qi2" returned: 0 in 0.064s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Releasing lock "refresh_cache-38a63a30-a3bc-4556-9fb6-53522dbf2c68" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.compute.manager [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Instance network_info: |[{"id": "b89e475f-2d05-4427-81aa-64a19c9664ee", "address": "fa:16:3e:8f:aa:98", "network": {"id": "5567560c-b3c5-4802-b758-92d672458351", "bridge": "br-int", "label": "tempest-TestStampPattern-268456575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e0ca1f6ce542a482164410c5e67e13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89e475f-2d", "ovs_interfaceid": "b89e475f-2d05-4427-81aa-64a19c9664ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-70a2d73a-f3ce-47cb-b19f-73b4452d904b req-7b2318f4-766a-4db4-9ec0-319d9788105d service nova] Acquired lock "refresh_cache-38a63a30-a3bc-4556-9fb6-53522dbf2c68" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.network.neutron [req-70a2d73a-f3ce-47cb-b19f-73b4452d904b req-7b2318f4-766a-4db4-9ec0-319d9788105d service nova] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Refreshing network info cache for port b89e475f-2d05-4427-81aa-64a19c9664ee {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Start _get_guest_xml network_info=[{"id": "b89e475f-2d05-4427-81aa-64a19c9664ee", "address": "fa:16:3e:8f:aa:98", "network": {"id": "5567560c-b3c5-4802-b758-92d672458351", "bridge": "br-int", "label": "tempest-TestStampPattern-268456575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e0ca1f6ce542a482164410c5e67e13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89e475f-2d", "ovs_interfaceid": "b89e475f-2d05-4427-81aa-64a19c9664ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:42:56 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:42:56 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:42:56 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:42:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1307944408',display_name='tempest-TestStampPattern-server-1307944408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1307944408',id=11,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3B/LEgcjzrDXoVcTjod3suFtQaJB7/AKBOdUne7T90RZ2Rsek9XiExDiKs3DHc1kAHMCNWLEQyKPOAYwsFFBz1wohZQQ7UNT2IOBVNPlD2nJvR8+6i+tJnL4hmFgKSyA==',key_name='tempest-TestStampPattern-587335042',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49e0ca1f6ce542a482164410c5e67e13',ramdisk_id='',reservation_id='r-fnkdct1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1142812634',owner_user_name='tempest-TestStampPattern-1142812634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:54Z,user_data=None,user_id='80bf1a1698dc420799dbaf2e254e5d74',uuid=38a63a30-a3bc-4556-9fb6-53522dbf2c68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b89e475f-2d05-4427-81aa-64a19c9664ee", "address": "fa:16:3e:8f:aa:98", "network": {"id": "5567560c-b3c5-4802-b758-92d672458351", "bridge": "br-int", "label": "tempest-TestStampPattern-268456575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e0ca1f6ce542a482164410c5e67e13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89e475f-2d", "ovs_interfaceid": "b89e475f-2d05-4427-81aa-64a19c9664ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Converting VIF {"id": "b89e475f-2d05-4427-81aa-64a19c9664ee", "address": "fa:16:3e:8f:aa:98", "network": {"id": "5567560c-b3c5-4802-b758-92d672458351", "bridge": "br-int", "label": "tempest-TestStampPattern-268456575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e0ca1f6ce542a482164410c5e67e13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89e475f-2d", "ovs_interfaceid": "b89e475f-2d05-4427-81aa-64a19c9664ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:aa:98,bridge_name='br-int',has_traffic_filtering=True,id=b89e475f-2d05-4427-81aa-64a19c9664ee,network=Network(5567560c-b3c5-4802-b758-92d672458351),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb89e475f-2d') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG nova.objects.instance [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lazy-loading 'pci_devices' on Instance uuid 38a63a30-a3bc-4556-9fb6-53522dbf2c68 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:42:57 user nova-compute[75391]:   <uuid>38a63a30-a3bc-4556-9fb6-53522dbf2c68</uuid>
Nov 15 02:42:57 user nova-compute[75391]:   <name>instance-0000000b</name>
Nov 15 02:42:57 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:42:57 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:42:57 user nova-compute[75391]:   <metadata>
Nov 15 02:42:57 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:42:57 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:42:57 user nova-compute[75391]:       <nova:name>tempest-TestStampPattern-server-1307944408</nova:name>
Nov 15 02:42:57 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:42:56</nova:creationTime>
Nov 15 02:42:57 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:42:57 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:42:57 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:42:57 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:42:57 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:42:57 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:42:57 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:42:57 user nova-compute[75391]:       <nova:owner>
Nov 15 02:42:57 user nova-compute[75391]:         <nova:user uuid="80bf1a1698dc420799dbaf2e254e5d74">tempest-TestStampPattern-1142812634-project-member</nova:user>
Nov 15 02:42:57 user nova-compute[75391]:         <nova:project uuid="49e0ca1f6ce542a482164410c5e67e13">tempest-TestStampPattern-1142812634</nova:project>
Nov 15 02:42:57 user nova-compute[75391]:       </nova:owner>
Nov 15 02:42:57 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:42:57 user nova-compute[75391]:       <nova:ports>
Nov 15 02:42:57 user nova-compute[75391]:         <nova:port uuid="b89e475f-2d05-4427-81aa-64a19c9664ee">
Nov 15 02:42:57 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 02:42:57 user nova-compute[75391]:         </nova:port>
Nov 15 02:42:57 user nova-compute[75391]:       </nova:ports>
Nov 15 02:42:57 user nova-compute[75391]:     </nova:instance>
Nov 15 02:42:57 user nova-compute[75391]:   </metadata>
Nov 15 02:42:57 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:42:57 user nova-compute[75391]:     <system>
Nov 15 02:42:57 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:42:57 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:42:57 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:42:57 user nova-compute[75391]:       <entry name="serial">38a63a30-a3bc-4556-9fb6-53522dbf2c68</entry>
Nov 15 02:42:57 user nova-compute[75391]:       <entry name="uuid">38a63a30-a3bc-4556-9fb6-53522dbf2c68</entry>
Nov 15 02:42:57 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:42:57 user nova-compute[75391]:     </system>
Nov 15 02:42:57 user nova-compute[75391]:   </sysinfo>
Nov 15 02:42:57 user nova-compute[75391]:   <os>
Nov 15 02:42:57 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:42:57 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:42:57 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:42:57 user nova-compute[75391]:   </os>
Nov 15 02:42:57 user nova-compute[75391]:   <features>
Nov 15 02:42:57 user nova-compute[75391]:     <acpi/>
Nov 15 02:42:57 user nova-compute[75391]:     <apic/>
Nov 15 02:42:57 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:42:57 user nova-compute[75391]:   </features>
Nov 15 02:42:57 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:42:57 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:42:57 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:42:57 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:42:57 user nova-compute[75391]:   </clock>
Nov 15 02:42:57 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:42:57 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:42:57 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:42:57 user nova-compute[75391]:   </cpu>
Nov 15 02:42:57 user nova-compute[75391]:   <devices>
Nov 15 02:42:57 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:42:57 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:42:57 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk"/>
Nov 15 02:42:57 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:42:57 user nova-compute[75391]:     </disk>
Nov 15 02:42:57 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:42:57 user nova-compute[75391]:       <mac address="fa:16:3e:8f:aa:98"/>
Nov 15 02:42:57 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:42:57 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:42:57 user nova-compute[75391]:       <target dev="tapb89e475f-2d"/>
Nov 15 02:42:57 user nova-compute[75391]:     </interface>
Nov 15 02:42:57 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:42:57 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/console.log" append="off"/>
Nov 15 02:42:57 user nova-compute[75391]:     </serial>
Nov 15 02:42:57 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:42:57 user nova-compute[75391]:     <video>
Nov 15 02:42:57 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:42:57 user nova-compute[75391]:     </video>
Nov 15 02:42:57 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:42:57 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:42:57 user nova-compute[75391]:     </rng>
Nov 15 02:42:57 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:42:57 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:42:57 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:42:57 user nova-compute[75391]:     </memballoon>
Nov 15 02:42:57 user nova-compute[75391]:   </devices>
Nov 15 02:42:57 user nova-compute[75391]: </domain>
Nov 15 02:42:57 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:42:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1307944408',display_name='tempest-TestStampPattern-server-1307944408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1307944408',id=11,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3B/LEgcjzrDXoVcTjod3suFtQaJB7/AKBOdUne7T90RZ2Rsek9XiExDiKs3DHc1kAHMCNWLEQyKPOAYwsFFBz1wohZQQ7UNT2IOBVNPlD2nJvR8+6i+tJnL4hmFgKSyA==',key_name='tempest-TestStampPattern-587335042',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49e0ca1f6ce542a482164410c5e67e13',ramdisk_id='',reservation_id='r-fnkdct1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1142812634',owner_user_name='tempest-TestStampPattern-1142812634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:54Z,user_data=None,user_id='80bf1a1698dc420799dbaf2e254e5d74',uuid=38a63a30-a3bc-4556-9fb6-53522dbf2c68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b89e475f-2d05-4427-81aa-64a19c9664ee", "address": "fa:16:3e:8f:aa:98", "network": {"id": "5567560c-b3c5-4802-b758-92d672458351", "bridge": "br-int", "label": "tempest-TestStampPattern-268456575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e0ca1f6ce542a482164410c5e67e13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89e475f-2d", "ovs_interfaceid": "b89e475f-2d05-4427-81aa-64a19c9664ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Converting VIF {"id": "b89e475f-2d05-4427-81aa-64a19c9664ee", "address": "fa:16:3e:8f:aa:98", "network": {"id": "5567560c-b3c5-4802-b758-92d672458351", "bridge": "br-int", "label": "tempest-TestStampPattern-268456575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e0ca1f6ce542a482164410c5e67e13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89e475f-2d", "ovs_interfaceid": "b89e475f-2d05-4427-81aa-64a19c9664ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:aa:98,bridge_name='br-int',has_traffic_filtering=True,id=b89e475f-2d05-4427-81aa-64a19c9664ee,network=Network(5567560c-b3c5-4802-b758-92d672458351),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb89e475f-2d') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG os_vif [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:aa:98,bridge_name='br-int',has_traffic_filtering=True,id=b89e475f-2d05-4427-81aa-64a19c9664ee,network=Network(5567560c-b3c5-4802-b758-92d672458351),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb89e475f-2d') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd791aa9b-5e3e-537e-a124-44a6143635b6', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb89e475f-2d, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb89e475f-2d, col_values=(('qos', UUID('0621adde-2909-4f7f-9c84-8432187370ad')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb89e475f-2d, col_values=(('external_ids', {'iface-id': 'b89e475f-2d05-4427-81aa-64a19c9664ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:aa:98', 'vm-uuid': '38a63a30-a3bc-4556-9fb6-53522dbf2c68'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:57 user nova-compute[75391]: INFO os_vif [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:aa:98,bridge_name='br-int',has_traffic_filtering=True,id=b89e475f-2d05-4427-81aa-64a19c9664ee,network=Network(5567560c-b3c5-4802-b758-92d672458351),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb89e475f-2d')
Nov 15 02:42:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] No VIF found with MAC fa:16:3e:8f:aa:98, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG nova.network.neutron [req-70a2d73a-f3ce-47cb-b19f-73b4452d904b req-7b2318f4-766a-4db4-9ec0-319d9788105d service nova] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Updated VIF entry in instance network info cache for port b89e475f-2d05-4427-81aa-64a19c9664ee. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG nova.network.neutron [req-70a2d73a-f3ce-47cb-b19f-73b4452d904b req-7b2318f4-766a-4db4-9ec0-319d9788105d service nova] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Updating instance_info_cache with network_info: [{"id": "b89e475f-2d05-4427-81aa-64a19c9664ee", "address": "fa:16:3e:8f:aa:98", "network": {"id": "5567560c-b3c5-4802-b758-92d672458351", "bridge": "br-int", "label": "tempest-TestStampPattern-268456575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e0ca1f6ce542a482164410c5e67e13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89e475f-2d", "ovs_interfaceid": "b89e475f-2d05-4427-81aa-64a19c9664ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-70a2d73a-f3ce-47cb-b19f-73b4452d904b req-7b2318f4-766a-4db4-9ec0-319d9788105d service nova] Releasing lock "refresh_cache-38a63a30-a3bc-4556-9fb6-53522dbf2c68" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:42:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "25884e14-afa3-4e5d-8154-a9e9eb455b94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:58 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:42:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:58 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:42:58 user nova-compute[75391]: INFO nova.compute.claims [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Claim successful on node user
Nov 15 02:42:58 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:42:58 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:42:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:58 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:42:58 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:42:58 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:42:58 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:42:58 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:42:58 user nova-compute[75391]: DEBUG nova.policy [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '409532d98aae4e5b962d3b142981c79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41caf593c4994c5c86570e1216c01337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:42:58 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:42:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:42:58 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Creating image(s)
Nov 15 02:42:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "/opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "/opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "/opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "96c3e94aea325c0be9d564670108914ecea7194e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "96c3e94aea325c0be9d564670108914ecea7194e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96c3e94aea325c0be9d564670108914ecea7194e.part --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:59 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Successfully created port: 6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:42:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96c3e94aea325c0be9d564670108914ecea7194e.part --force-share --output=json" returned: 0 in 0.217s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:59 user nova-compute[75391]: DEBUG nova.virt.images [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] 143f1837-4d6a-4e72-b7f3-8571cb18b9e3 was qcow2, converting to raw {{(pid=75391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 02:42:59 user nova-compute[75391]: DEBUG nova.privsep.utils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 02:42:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/96c3e94aea325c0be9d564670108914ecea7194e.part /opt/stack/data/nova/instances/_base/96c3e94aea325c0be9d564670108914ecea7194e.converted {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:59 user nova-compute[75391]: DEBUG nova.compute.manager [req-a5223e27-094c-47d3-8e26-d69bab8f9ebe req-fb50cbe4-cae9-4527-a31b-36b05a709664 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-plugged-dea6d9d9-b176-440e-9589-d8d8def6471d {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:42:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a5223e27-094c-47d3-8e26-d69bab8f9ebe req-fb50cbe4-cae9-4527-a31b-36b05a709664 service nova] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:42:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a5223e27-094c-47d3-8e26-d69bab8f9ebe req-fb50cbe4-cae9-4527-a31b-36b05a709664 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:42:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a5223e27-094c-47d3-8e26-d69bab8f9ebe req-fb50cbe4-cae9-4527-a31b-36b05a709664 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:42:59 user nova-compute[75391]: DEBUG nova.compute.manager [req-a5223e27-094c-47d3-8e26-d69bab8f9ebe req-fb50cbe4-cae9-4527-a31b-36b05a709664 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] No waiting events found dispatching network-vif-plugged-dea6d9d9-b176-440e-9589-d8d8def6471d {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:42:59 user nova-compute[75391]: WARNING nova.compute.manager [req-a5223e27-094c-47d3-8e26-d69bab8f9ebe req-fb50cbe4-cae9-4527-a31b-36b05a709664 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received unexpected event network-vif-plugged-dea6d9d9-b176-440e-9589-d8d8def6471d for instance with vm_state building and task_state spawning.
Nov 15 02:42:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:42:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/96c3e94aea325c0be9d564670108914ecea7194e.part /opt/stack/data/nova/instances/_base/96c3e94aea325c0be9d564670108914ecea7194e.converted" returned: 0 in 0.191s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:42:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96c3e94aea325c0be9d564670108914ecea7194e.converted --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:42:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96c3e94aea325c0be9d564670108914ecea7194e.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "96c3e94aea325c0be9d564670108914ecea7194e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.140s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96c3e94aea325c0be9d564670108914ecea7194e --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96c3e94aea325c0be9d564670108914ecea7194e --force-share --output=json" returned: 0 in 0.192s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "96c3e94aea325c0be9d564670108914ecea7194e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "96c3e94aea325c0be9d564670108914ecea7194e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96c3e94aea325c0be9d564670108914ecea7194e --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Successfully updated port: 6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "refresh_cache-25884e14-afa3-4e5d-8154-a9e9eb455b94" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquired lock "refresh_cache-25884e14-afa3-4e5d-8154-a9e9eb455b94" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG nova.compute.manager [req-c38d50c4-ec3d-46c0-b0d0-bc27b7d7bd24 req-be2d1bb5-90f8-4d1a-9fa1-ad909e5bda38 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Received event network-changed-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG nova.compute.manager [req-c38d50c4-ec3d-46c0-b0d0-bc27b7d7bd24 req-be2d1bb5-90f8-4d1a-9fa1-ad909e5bda38 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Refreshing instance network info cache due to event network-changed-6b8f74f5-6f5f-4946-afdb-80269c0d03b1. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c38d50c4-ec3d-46c0-b0d0-bc27b7d7bd24 req-be2d1bb5-90f8-4d1a-9fa1-ad909e5bda38 service nova] Acquiring lock "refresh_cache-25884e14-afa3-4e5d-8154-a9e9eb455b94" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96c3e94aea325c0be9d564670108914ecea7194e --force-share --output=json" returned: 0 in 0.201s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96c3e94aea325c0be9d564670108914ecea7194e,backing_fmt=raw /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96c3e94aea325c0be9d564670108914ecea7194e,backing_fmt=raw /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk 1073741824" returned: 0 in 0.050s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "96c3e94aea325c0be9d564670108914ecea7194e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96c3e94aea325c0be9d564670108914ecea7194e --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96c3e94aea325c0be9d564670108914ecea7194e --force-share --output=json" returned: 0 in 0.197s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Updating instance_info_cache with network_info: [{"id": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "address": "fa:16:3e:6b:28:6d", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b8f74f5-6f", "ovs_interfaceid": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Cannot resize image /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Ensure instance console log exists: /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Releasing lock "refresh_cache-25884e14-afa3-4e5d-8154-a9e9eb455b94" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Instance network_info: |[{"id": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "address": "fa:16:3e:6b:28:6d", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b8f74f5-6f", "ovs_interfaceid": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c38d50c4-ec3d-46c0-b0d0-bc27b7d7bd24 req-be2d1bb5-90f8-4d1a-9fa1-ad909e5bda38 service nova] Acquired lock "refresh_cache-25884e14-afa3-4e5d-8154-a9e9eb455b94" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.network.neutron [req-c38d50c4-ec3d-46c0-b0d0-bc27b7d7bd24 req-be2d1bb5-90f8-4d1a-9fa1-ad909e5bda38 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Refreshing network info cache for port 6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Start _get_guest_xml network_info=[{"id": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "address": "fa:16:3e:6b:28:6d", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b8f74f5-6f", "ovs_interfaceid": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:42:55Z,direct_url=<?>,disk_format='qcow2',id=143f1837-4d6a-4e72-b7f3-8571cb18b9e3,min_disk=0,min_ram=0,name='tempest-scenario-img--1901942017',owner='41caf593c4994c5c86570e1216c01337',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:42:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '143f1837-4d6a-4e72-b7f3-8571cb18b9e3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:01 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:43:01 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:42:55Z,direct_url=<?>,disk_format='qcow2',id=143f1837-4d6a-4e72-b7f3-8571cb18b9e3,min_disk=0,min_ram=0,name='tempest-scenario-img--1901942017',owner='41caf593c4994c5c86570e1216c01337',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:42:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:42:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-228689750',display_name='tempest-TestMinimumBasicScenario-server-228689750',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-228689750',id=12,image_ref='143f1837-4d6a-4e72-b7f3-8571cb18b9e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwK3j8HHIRg419cIoS1FnvOd+dER4MDrZCMWVzQif1BmXlSl8hZBKvaJ6w8P2cNF/xp+wN/TK/t6oiz+7Ge/xo4VPAisWnTlayJP8UXoEhk3eR07YIFuG12GEzrT+Hxxw==',key_name='tempest-TestMinimumBasicScenario-1293343834',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41caf593c4994c5c86570e1216c01337',ramdisk_id='',reservation_id='r-gxn3d76p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='143f1837-4d6a-4e72-b7f3-8571cb18b9e3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1859352909',owner_user_name='tempest-TestMinimumBasicScenario-1859352909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:59Z,user_data=None,user_id='409532d98aae4e5b962d3b142981c79a',uuid=25884e14-afa3-4e5d-8154-a9e9eb455b94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "address": "fa:16:3e:6b:28:6d", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b8f74f5-6f", "ovs_interfaceid": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Converting VIF {"id": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "address": "fa:16:3e:6b:28:6d", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b8f74f5-6f", "ovs_interfaceid": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:28:6d,bridge_name='br-int',has_traffic_filtering=True,id=6b8f74f5-6f5f-4946-afdb-80269c0d03b1,network=Network(ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b8f74f5-6f') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.objects.instance [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lazy-loading 'pci_devices' on Instance uuid 25884e14-afa3-4e5d-8154-a9e9eb455b94 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:43:01 user nova-compute[75391]:   <uuid>25884e14-afa3-4e5d-8154-a9e9eb455b94</uuid>
Nov 15 02:43:01 user nova-compute[75391]:   <name>instance-0000000c</name>
Nov 15 02:43:01 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:43:01 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:43:01 user nova-compute[75391]:   <metadata>
Nov 15 02:43:01 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:43:01 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:43:01 user nova-compute[75391]:       <nova:name>tempest-TestMinimumBasicScenario-server-228689750</nova:name>
Nov 15 02:43:01 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:43:01</nova:creationTime>
Nov 15 02:43:01 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:43:01 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:43:01 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:43:01 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:43:01 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:43:01 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:43:01 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:43:01 user nova-compute[75391]:       <nova:owner>
Nov 15 02:43:01 user nova-compute[75391]:         <nova:user uuid="409532d98aae4e5b962d3b142981c79a">tempest-TestMinimumBasicScenario-1859352909-project-member</nova:user>
Nov 15 02:43:01 user nova-compute[75391]:         <nova:project uuid="41caf593c4994c5c86570e1216c01337">tempest-TestMinimumBasicScenario-1859352909</nova:project>
Nov 15 02:43:01 user nova-compute[75391]:       </nova:owner>
Nov 15 02:43:01 user nova-compute[75391]:       <nova:root type="image" uuid="143f1837-4d6a-4e72-b7f3-8571cb18b9e3"/>
Nov 15 02:43:01 user nova-compute[75391]:       <nova:ports>
Nov 15 02:43:01 user nova-compute[75391]:         <nova:port uuid="6b8f74f5-6f5f-4946-afdb-80269c0d03b1">
Nov 15 02:43:01 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 02:43:01 user nova-compute[75391]:         </nova:port>
Nov 15 02:43:01 user nova-compute[75391]:       </nova:ports>
Nov 15 02:43:01 user nova-compute[75391]:     </nova:instance>
Nov 15 02:43:01 user nova-compute[75391]:   </metadata>
Nov 15 02:43:01 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:43:01 user nova-compute[75391]:     <system>
Nov 15 02:43:01 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:43:01 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:43:01 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:43:01 user nova-compute[75391]:       <entry name="serial">25884e14-afa3-4e5d-8154-a9e9eb455b94</entry>
Nov 15 02:43:01 user nova-compute[75391]:       <entry name="uuid">25884e14-afa3-4e5d-8154-a9e9eb455b94</entry>
Nov 15 02:43:01 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:43:01 user nova-compute[75391]:     </system>
Nov 15 02:43:01 user nova-compute[75391]:   </sysinfo>
Nov 15 02:43:01 user nova-compute[75391]:   <os>
Nov 15 02:43:01 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:43:01 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:43:01 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:43:01 user nova-compute[75391]:   </os>
Nov 15 02:43:01 user nova-compute[75391]:   <features>
Nov 15 02:43:01 user nova-compute[75391]:     <acpi/>
Nov 15 02:43:01 user nova-compute[75391]:     <apic/>
Nov 15 02:43:01 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:43:01 user nova-compute[75391]:   </features>
Nov 15 02:43:01 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:43:01 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:43:01 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:43:01 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:43:01 user nova-compute[75391]:   </clock>
Nov 15 02:43:01 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:43:01 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:43:01 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:43:01 user nova-compute[75391]:   </cpu>
Nov 15 02:43:01 user nova-compute[75391]:   <devices>
Nov 15 02:43:01 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:43:01 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:43:01 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk"/>
Nov 15 02:43:01 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:43:01 user nova-compute[75391]:     </disk>
Nov 15 02:43:01 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:43:01 user nova-compute[75391]:       <mac address="fa:16:3e:6b:28:6d"/>
Nov 15 02:43:01 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:43:01 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:43:01 user nova-compute[75391]:       <target dev="tap6b8f74f5-6f"/>
Nov 15 02:43:01 user nova-compute[75391]:     </interface>
Nov 15 02:43:01 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:43:01 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/console.log" append="off"/>
Nov 15 02:43:01 user nova-compute[75391]:     </serial>
Nov 15 02:43:01 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:43:01 user nova-compute[75391]:     <video>
Nov 15 02:43:01 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:43:01 user nova-compute[75391]:     </video>
Nov 15 02:43:01 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:43:01 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:43:01 user nova-compute[75391]:     </rng>
Nov 15 02:43:01 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:43:01 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:43:01 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:43:01 user nova-compute[75391]:     </memballoon>
Nov 15 02:43:01 user nova-compute[75391]:   </devices>
Nov 15 02:43:01 user nova-compute[75391]: </domain>
Nov 15 02:43:01 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:42:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-228689750',display_name='tempest-TestMinimumBasicScenario-server-228689750',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-228689750',id=12,image_ref='143f1837-4d6a-4e72-b7f3-8571cb18b9e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwK3j8HHIRg419cIoS1FnvOd+dER4MDrZCMWVzQif1BmXlSl8hZBKvaJ6w8P2cNF/xp+wN/TK/t6oiz+7Ge/xo4VPAisWnTlayJP8UXoEhk3eR07YIFuG12GEzrT+Hxxw==',key_name='tempest-TestMinimumBasicScenario-1293343834',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41caf593c4994c5c86570e1216c01337',ramdisk_id='',reservation_id='r-gxn3d76p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='143f1837-4d6a-4e72-b7f3-8571cb18b9e3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1859352909',owner_user_name='tempest-TestMinimumBasicScenario-1859352909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:42:59Z,user_data=None,user_id='409532d98aae4e5b962d3b142981c79a',uuid=25884e14-afa3-4e5d-8154-a9e9eb455b94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "address": "fa:16:3e:6b:28:6d", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b8f74f5-6f", "ovs_interfaceid": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Converting VIF {"id": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "address": "fa:16:3e:6b:28:6d", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b8f74f5-6f", "ovs_interfaceid": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:28:6d,bridge_name='br-int',has_traffic_filtering=True,id=6b8f74f5-6f5f-4946-afdb-80269c0d03b1,network=Network(ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b8f74f5-6f') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG os_vif [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:28:6d,bridge_name='br-int',has_traffic_filtering=True,id=6b8f74f5-6f5f-4946-afdb-80269c0d03b1,network=Network(ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b8f74f5-6f') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd4229937-8fbf-5e31-a202-900d6be50ace', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b8f74f5-6f, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b8f74f5-6f, col_values=(('qos', UUID('04808d7b-0a2b-44fe-8343-e311af3b0fc7')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b8f74f5-6f, col_values=(('external_ids', {'iface-id': '6b8f74f5-6f5f-4946-afdb-80269c0d03b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:28:6d', 'vm-uuid': '25884e14-afa3-4e5d-8154-a9e9eb455b94'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:01 user nova-compute[75391]: INFO os_vif [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:28:6d,bridge_name='br-int',has_traffic_filtering=True,id=6b8f74f5-6f5f-4946-afdb-80269c0d03b1,network=Network(ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b8f74f5-6f')
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] No VIF found with MAC fa:16:3e:6b:28:6d, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.network.neutron [req-c38d50c4-ec3d-46c0-b0d0-bc27b7d7bd24 req-be2d1bb5-90f8-4d1a-9fa1-ad909e5bda38 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Updated VIF entry in instance network info cache for port 6b8f74f5-6f5f-4946-afdb-80269c0d03b1. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.network.neutron [req-c38d50c4-ec3d-46c0-b0d0-bc27b7d7bd24 req-be2d1bb5-90f8-4d1a-9fa1-ad909e5bda38 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Updating instance_info_cache with network_info: [{"id": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "address": "fa:16:3e:6b:28:6d", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b8f74f5-6f", "ovs_interfaceid": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c38d50c4-ec3d-46c0-b0d0-bc27b7d7bd24 req-be2d1bb5-90f8-4d1a-9fa1-ad909e5bda38 service nova] Releasing lock "refresh_cache-25884e14-afa3-4e5d-8154-a9e9eb455b94" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.compute.manager [req-0c60faa2-2faf-4758-bda8-46439aba4756 req-43ea05af-1840-4bf1-83dd-87cc2e26d404 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-plugged-a60510f0-b568-4276-914e-3c8cd49eafe5 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0c60faa2-2faf-4758-bda8-46439aba4756 req-43ea05af-1840-4bf1-83dd-87cc2e26d404 service nova] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0c60faa2-2faf-4758-bda8-46439aba4756 req-43ea05af-1840-4bf1-83dd-87cc2e26d404 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0c60faa2-2faf-4758-bda8-46439aba4756 req-43ea05af-1840-4bf1-83dd-87cc2e26d404 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.compute.manager [req-0c60faa2-2faf-4758-bda8-46439aba4756 req-43ea05af-1840-4bf1-83dd-87cc2e26d404 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] No waiting events found dispatching network-vif-plugged-a60510f0-b568-4276-914e-3c8cd49eafe5 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:43:01 user nova-compute[75391]: WARNING nova.compute.manager [req-0c60faa2-2faf-4758-bda8-46439aba4756 req-43ea05af-1840-4bf1-83dd-87cc2e26d404 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received unexpected event network-vif-plugged-a60510f0-b568-4276-914e-3c8cd49eafe5 for instance with vm_state building and task_state spawning.
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.compute.manager [req-ca32530d-a299-4067-9f41-e2a4fa363f70 req-e5e3584d-3828-41a3-a75b-a10234de80dd service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-plugged-dea6d9d9-b176-440e-9589-d8d8def6471d {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ca32530d-a299-4067-9f41-e2a4fa363f70 req-e5e3584d-3828-41a3-a75b-a10234de80dd service nova] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ca32530d-a299-4067-9f41-e2a4fa363f70 req-e5e3584d-3828-41a3-a75b-a10234de80dd service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ca32530d-a299-4067-9f41-e2a4fa363f70 req-e5e3584d-3828-41a3-a75b-a10234de80dd service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG nova.compute.manager [req-ca32530d-a299-4067-9f41-e2a4fa363f70 req-e5e3584d-3828-41a3-a75b-a10234de80dd service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] No waiting events found dispatching network-vif-plugged-dea6d9d9-b176-440e-9589-d8d8def6471d {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:43:01 user nova-compute[75391]: WARNING nova.compute.manager [req-ca32530d-a299-4067-9f41-e2a4fa363f70 req-e5e3584d-3828-41a3-a75b-a10234de80dd service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received unexpected event network-vif-plugged-dea6d9d9-b176-440e-9589-d8d8def6471d for instance with vm_state building and task_state spawning.
Nov 15 02:43:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-f9544c18-0747-42ca-94f9-7f7c039334f3 req-0670fa68-aec1-41e6-a6e7-5db29abfc616 service nova] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Received event network-vif-plugged-b89e475f-2d05-4427-81aa-64a19c9664ee {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:43:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f9544c18-0747-42ca-94f9-7f7c039334f3 req-0670fa68-aec1-41e6-a6e7-5db29abfc616 service nova] Acquiring lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:43:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f9544c18-0747-42ca-94f9-7f7c039334f3 req-0670fa68-aec1-41e6-a6e7-5db29abfc616 service nova] Lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:43:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f9544c18-0747-42ca-94f9-7f7c039334f3 req-0670fa68-aec1-41e6-a6e7-5db29abfc616 service nova] Lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:43:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-f9544c18-0747-42ca-94f9-7f7c039334f3 req-0670fa68-aec1-41e6-a6e7-5db29abfc616 service nova] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] No waiting events found dispatching network-vif-plugged-b89e475f-2d05-4427-81aa-64a19c9664ee {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:43:02 user nova-compute[75391]: WARNING nova.compute.manager [req-f9544c18-0747-42ca-94f9-7f7c039334f3 req-0670fa68-aec1-41e6-a6e7-5db29abfc616 service nova] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Received unexpected event network-vif-plugged-b89e475f-2d05-4427-81aa-64a19c9664ee for instance with vm_state building and task_state spawning.
Nov 15 02:43:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-f9544c18-0747-42ca-94f9-7f7c039334f3 req-0670fa68-aec1-41e6-a6e7-5db29abfc616 service nova] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Received event network-vif-plugged-b89e475f-2d05-4427-81aa-64a19c9664ee {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:43:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f9544c18-0747-42ca-94f9-7f7c039334f3 req-0670fa68-aec1-41e6-a6e7-5db29abfc616 service nova] Acquiring lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:43:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f9544c18-0747-42ca-94f9-7f7c039334f3 req-0670fa68-aec1-41e6-a6e7-5db29abfc616 service nova] Lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:43:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f9544c18-0747-42ca-94f9-7f7c039334f3 req-0670fa68-aec1-41e6-a6e7-5db29abfc616 service nova] Lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:43:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-f9544c18-0747-42ca-94f9-7f7c039334f3 req-0670fa68-aec1-41e6-a6e7-5db29abfc616 service nova] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] No waiting events found dispatching network-vif-plugged-b89e475f-2d05-4427-81aa-64a19c9664ee {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:43:02 user nova-compute[75391]: WARNING nova.compute.manager [req-f9544c18-0747-42ca-94f9-7f7c039334f3 req-0670fa68-aec1-41e6-a6e7-5db29abfc616 service nova] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Received unexpected event network-vif-plugged-b89e475f-2d05-4427-81aa-64a19c9664ee for instance with vm_state building and task_state spawning.
Nov 15 02:43:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:03 user nova-compute[75391]: DEBUG nova.compute.manager [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:43:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:43:03 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Instance spawned successfully.
Nov 15 02:43:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:43:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:43:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:43:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:43:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:43:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:43:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:43:03 user nova-compute[75391]: INFO nova.compute.manager [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Took 8.66 seconds to spawn the instance on the hypervisor.
Nov 15 02:43:03 user nova-compute[75391]: DEBUG nova.compute.manager [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:43:03 user nova-compute[75391]: INFO nova.compute.manager [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Took 9.52 seconds to build instance.
Nov 15 02:43:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-991b995a-0132-4439-a81f-d766ca3adc92 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.627s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:43:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:03 user nova-compute[75391]: DEBUG nova.compute.manager [req-76b5f487-0316-46c5-9df9-8fd55aa39b30 req-ff0547fc-908f-4f90-a238-24f2545c5079 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-plugged-a60510f0-b568-4276-914e-3c8cd49eafe5 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:43:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-76b5f487-0316-46c5-9df9-8fd55aa39b30 req-ff0547fc-908f-4f90-a238-24f2545c5079 service nova] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:43:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-76b5f487-0316-46c5-9df9-8fd55aa39b30 req-ff0547fc-908f-4f90-a238-24f2545c5079 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:43:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-76b5f487-0316-46c5-9df9-8fd55aa39b30 req-ff0547fc-908f-4f90-a238-24f2545c5079 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:43:03 user nova-compute[75391]: DEBUG nova.compute.manager [req-76b5f487-0316-46c5-9df9-8fd55aa39b30 req-ff0547fc-908f-4f90-a238-24f2545c5079 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] No waiting events found dispatching network-vif-plugged-a60510f0-b568-4276-914e-3c8cd49eafe5 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:43:03 user nova-compute[75391]: WARNING nova.compute.manager [req-76b5f487-0316-46c5-9df9-8fd55aa39b30 req-ff0547fc-908f-4f90-a238-24f2545c5079 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received unexpected event network-vif-plugged-a60510f0-b568-4276-914e-3c8cd49eafe5 for instance with vm_state building and task_state spawning.
Nov 15 02:43:03 user nova-compute[75391]: DEBUG nova.compute.manager [req-76b5f487-0316-46c5-9df9-8fd55aa39b30 req-ff0547fc-908f-4f90-a238-24f2545c5079 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-plugged-c2725a77-bc15-423e-9795-49c2647a2d82 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:43:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-76b5f487-0316-46c5-9df9-8fd55aa39b30 req-ff0547fc-908f-4f90-a238-24f2545c5079 service nova] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:43:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-76b5f487-0316-46c5-9df9-8fd55aa39b30 req-ff0547fc-908f-4f90-a238-24f2545c5079 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:43:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-76b5f487-0316-46c5-9df9-8fd55aa39b30 req-ff0547fc-908f-4f90-a238-24f2545c5079 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:43:03 user nova-compute[75391]: DEBUG nova.compute.manager [req-76b5f487-0316-46c5-9df9-8fd55aa39b30 req-ff0547fc-908f-4f90-a238-24f2545c5079 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] No waiting events found dispatching network-vif-plugged-c2725a77-bc15-423e-9795-49c2647a2d82 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:43:03 user nova-compute[75391]: WARNING nova.compute.manager [req-76b5f487-0316-46c5-9df9-8fd55aa39b30 req-ff0547fc-908f-4f90-a238-24f2545c5079 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received unexpected event network-vif-plugged-c2725a77-bc15-423e-9795-49c2647a2d82 for instance with vm_state building and task_state spawning.
Nov 15 02:43:03 user nova-compute[75391]: DEBUG nova.compute.manager [req-76b5f487-0316-46c5-9df9-8fd55aa39b30 req-ff0547fc-908f-4f90-a238-24f2545c5079 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-plugged-c2725a77-bc15-423e-9795-49c2647a2d82 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:43:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-76b5f487-0316-46c5-9df9-8fd55aa39b30 req-ff0547fc-908f-4f90-a238-24f2545c5079 service nova] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:43:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-76b5f487-0316-46c5-9df9-8fd55aa39b30 req-ff0547fc-908f-4f90-a238-24f2545c5079 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:43:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-76b5f487-0316-46c5-9df9-8fd55aa39b30 req-ff0547fc-908f-4f90-a238-24f2545c5079 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:43:03 user nova-compute[75391]: DEBUG nova.compute.manager [req-76b5f487-0316-46c5-9df9-8fd55aa39b30 req-ff0547fc-908f-4f90-a238-24f2545c5079 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] No waiting events found dispatching network-vif-plugged-c2725a77-bc15-423e-9795-49c2647a2d82 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:43:03 user nova-compute[75391]: WARNING nova.compute.manager [req-76b5f487-0316-46c5-9df9-8fd55aa39b30 req-ff0547fc-908f-4f90-a238-24f2545c5079 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received unexpected event network-vif-plugged-c2725a77-bc15-423e-9795-49c2647a2d82 for instance with vm_state building and task_state spawning.
Nov 15 02:43:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-plugged-7f659917-6ad3-4ccc-ac49-622470b330aa {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] No waiting events found dispatching network-vif-plugged-7f659917-6ad3-4ccc-ac49-622470b330aa {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:43:04 user nova-compute[75391]: WARNING nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received unexpected event network-vif-plugged-7f659917-6ad3-4ccc-ac49-622470b330aa for instance with vm_state building and task_state spawning.
Nov 15 02:43:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-plugged-7f659917-6ad3-4ccc-ac49-622470b330aa {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] No waiting events found dispatching network-vif-plugged-7f659917-6ad3-4ccc-ac49-622470b330aa {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:43:04 user nova-compute[75391]: WARNING nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received unexpected event network-vif-plugged-7f659917-6ad3-4ccc-ac49-622470b330aa for instance with vm_state building and task_state spawning.
Nov 15 02:43:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-plugged-51356594-af31-476d-a34b-697c80f519c8 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] No waiting events found dispatching network-vif-plugged-51356594-af31-476d-a34b-697c80f519c8 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:43:04 user nova-compute[75391]: WARNING nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received unexpected event network-vif-plugged-51356594-af31-476d-a34b-697c80f519c8 for instance with vm_state building and task_state spawning.
Nov 15 02:43:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-plugged-51356594-af31-476d-a34b-697c80f519c8 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] No waiting events found dispatching network-vif-plugged-51356594-af31-476d-a34b-697c80f519c8 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:43:04 user nova-compute[75391]: WARNING nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received unexpected event network-vif-plugged-51356594-af31-476d-a34b-697c80f519c8 for instance with vm_state building and task_state spawning.
Nov 15 02:43:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-plugged-2100ab6d-db20-43a9-ba96-d9630430c14f {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] No waiting events found dispatching network-vif-plugged-2100ab6d-db20-43a9-ba96-d9630430c14f {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:43:04 user nova-compute[75391]: WARNING nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received unexpected event network-vif-plugged-2100ab6d-db20-43a9-ba96-d9630430c14f for instance with vm_state building and task_state spawning.
Nov 15 02:43:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-plugged-2100ab6d-db20-43a9-ba96-d9630430c14f {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] No waiting events found dispatching network-vif-plugged-2100ab6d-db20-43a9-ba96-d9630430c14f {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:43:04 user nova-compute[75391]: WARNING nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received unexpected event network-vif-plugged-2100ab6d-db20-43a9-ba96-d9630430c14f for instance with vm_state building and task_state spawning.
Nov 15 02:43:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-plugged-9425c66c-2e1e-43e3-b611-70477c102b95 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] No waiting events found dispatching network-vif-plugged-9425c66c-2e1e-43e3-b611-70477c102b95 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:43:04 user nova-compute[75391]: WARNING nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received unexpected event network-vif-plugged-9425c66c-2e1e-43e3-b611-70477c102b95 for instance with vm_state building and task_state spawning.
Nov 15 02:43:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-plugged-9425c66c-2e1e-43e3-b611-70477c102b95 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] No waiting events found dispatching network-vif-plugged-9425c66c-2e1e-43e3-b611-70477c102b95 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:43:04 user nova-compute[75391]: WARNING nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received unexpected event network-vif-plugged-9425c66c-2e1e-43e3-b611-70477c102b95 for instance with vm_state building and task_state spawning.
Nov 15 02:43:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Received event network-vif-plugged-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Acquiring lock "25884e14-afa3-4e5d-8154-a9e9eb455b94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] No waiting events found dispatching network-vif-plugged-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:43:04 user nova-compute[75391]: WARNING nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Received unexpected event network-vif-plugged-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 for instance with vm_state building and task_state spawning.
Nov 15 02:43:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Received event network-vif-plugged-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Acquiring lock "25884e14-afa3-4e5d-8154-a9e9eb455b94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] No waiting events found dispatching network-vif-plugged-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:43:04 user nova-compute[75391]: WARNING nova.compute.manager [req-5a15df7c-3753-447b-b898-31b734676dae req-e9148f1a-617f-4d02-ab7c-66ee17add750 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Received unexpected event network-vif-plugged-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 for instance with vm_state building and task_state spawning.
Nov 15 02:43:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:05 user nova-compute[75391]: DEBUG nova.compute.manager [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:43:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:43:05 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Instance spawned successfully.
Nov 15 02:43:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:43:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:43:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:43:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:43:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:43:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:43:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:43:05 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:43:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:43:05 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Instance spawned successfully.
Nov 15 02:43:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:43:05 user nova-compute[75391]: INFO nova.compute.manager [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Took 14.99 seconds to spawn the instance on the hypervisor.
Nov 15 02:43:05 user nova-compute[75391]: DEBUG nova.compute.manager [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:43:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:43:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:43:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:43:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:43:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:43:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:43:05 user nova-compute[75391]: INFO nova.compute.manager [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Took 7.02 seconds to spawn the instance on the hypervisor.
Nov 15 02:43:05 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:43:05 user nova-compute[75391]: INFO nova.compute.manager [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Took 35.80 seconds to build instance.
Nov 15 02:43:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b617a8bc-305d-427e-a1dd-af963f8f7fe1 tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.991s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:43:06 user nova-compute[75391]: INFO nova.compute.manager [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Took 7.98 seconds to build instance.
Nov 15 02:43:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ec1aba09-d471-4418-a5d7-3b1a6d7d0a1a tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.187s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:43:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:17 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:21 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:22 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:38 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5dfd9bf1-56ff-4f81-9276-1959aeaa9ce3 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:43:38 user nova-compute[75391]: INFO nova.compute.manager [None req-5dfd9bf1-56ff-4f81-9276-1959aeaa9ce3 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] instance snapshotting
Nov 15 02:43:38 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-5dfd9bf1-56ff-4f81-9276-1959aeaa9ce3 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Beginning live snapshot process
Nov 15 02:43:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5dfd9bf1-56ff-4f81-9276-1959aeaa9ce3 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json -f qcow2 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5dfd9bf1-56ff-4f81-9276-1959aeaa9ce3 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json -f qcow2" returned: 0 in 0.248s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5dfd9bf1-56ff-4f81-9276-1959aeaa9ce3 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json -f qcow2 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5dfd9bf1-56ff-4f81-9276-1959aeaa9ce3 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5dfd9bf1-56ff-4f81-9276-1959aeaa9ce3 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5dfd9bf1-56ff-4f81-9276-1959aeaa9ce3 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.168s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5dfd9bf1-56ff-4f81-9276-1959aeaa9ce3 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpb4a9hjc6/001c545849774e9a85f61c87c3479de9.delta 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5dfd9bf1-56ff-4f81-9276-1959aeaa9ce3 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpb4a9hjc6/001c545849774e9a85f61c87c3479de9.delta 1073741824" returned: 0 in 0.045s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:39 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-5dfd9bf1-56ff-4f81-9276-1959aeaa9ce3 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 02:43:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-5dfd9bf1-56ff-4f81-9276-1959aeaa9ce3 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75391) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 15 02:43:39 user nova-compute[75391]: INFO nova.virt.libvirt.host [None req-5dfd9bf1-56ff-4f81-9276-1959aeaa9ce3 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] UEFI support detected
Nov 15 02:43:40 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-5dfd9bf1-56ff-4f81-9276-1959aeaa9ce3 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 02:43:40 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-5dfd9bf1-56ff-4f81-9276-1959aeaa9ce3 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 02:43:40 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-5dfd9bf1-56ff-4f81-9276-1959aeaa9ce3 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 02:43:41 user nova-compute[75391]: DEBUG nova.privsep.utils [None req-5dfd9bf1-56ff-4f81-9276-1959aeaa9ce3 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 02:43:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5dfd9bf1-56ff-4f81-9276-1959aeaa9ce3 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpb4a9hjc6/001c545849774e9a85f61c87c3479de9.delta /opt/stack/data/nova/instances/snapshots/tmpb4a9hjc6/001c545849774e9a85f61c87c3479de9 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5dfd9bf1-56ff-4f81-9276-1959aeaa9ce3 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpb4a9hjc6/001c545849774e9a85f61c87c3479de9.delta /opt/stack/data/nova/instances/snapshots/tmpb4a9hjc6/001c545849774e9a85f61c87c3479de9" returned: 0 in 0.381s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:41 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-5dfd9bf1-56ff-4f81-9276-1959aeaa9ce3 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Snapshot extracted, beginning image upload
Nov 15 02:43:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:43 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-5dfd9bf1-56ff-4f81-9276-1959aeaa9ce3 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Snapshot image upload complete
Nov 15 02:43:43 user nova-compute[75391]: INFO nova.compute.manager [None req-5dfd9bf1-56ff-4f81-9276-1959aeaa9ce3 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Took 5.33 seconds to snapshot the instance on the hypervisor.
Nov 15 02:43:45 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:43:45 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:43:45 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:43:45 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:43:45 user nova-compute[75391]: DEBUG nova.compute.manager [req-31ae33b1-b677-458b-84b1-9334fa58933c req-91584af4-289d-4ff8-bb58-a54704428b60 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Received event network-changed-c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:43:45 user nova-compute[75391]: DEBUG nova.compute.manager [req-31ae33b1-b677-458b-84b1-9334fa58933c req-91584af4-289d-4ff8-bb58-a54704428b60 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Refreshing instance network info cache due to event network-changed-c9643afc-4454-4d29-b8a2-5422753857b0. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:43:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-31ae33b1-b677-458b-84b1-9334fa58933c req-91584af4-289d-4ff8-bb58-a54704428b60 service nova] Acquiring lock "refresh_cache-ebb7e616-3c05-4d99-a0b3-76dc1723e82d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:43:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-31ae33b1-b677-458b-84b1-9334fa58933c req-91584af4-289d-4ff8-bb58-a54704428b60 service nova] Acquired lock "refresh_cache-ebb7e616-3c05-4d99-a0b3-76dc1723e82d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:43:45 user nova-compute[75391]: DEBUG nova.network.neutron [req-31ae33b1-b677-458b-84b1-9334fa58933c req-91584af4-289d-4ff8-bb58-a54704428b60 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Refreshing network info cache for port c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:43:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-ebb7e616-3c05-4d99-a0b3-76dc1723e82d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:43:45 user nova-compute[75391]: DEBUG nova.compute.manager [req-e88174bc-2933-4108-8270-fe9e2aa345d6 req-90bb9233-627e-4bbd-bf1b-0b8ea20beb3d service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Received event network-changed-d8f34e4c-5c99-45eb-a282-a721a2019209 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:43:45 user nova-compute[75391]: DEBUG nova.compute.manager [req-e88174bc-2933-4108-8270-fe9e2aa345d6 req-90bb9233-627e-4bbd-bf1b-0b8ea20beb3d service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Refreshing instance network info cache due to event network-changed-d8f34e4c-5c99-45eb-a282-a721a2019209. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:43:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e88174bc-2933-4108-8270-fe9e2aa345d6 req-90bb9233-627e-4bbd-bf1b-0b8ea20beb3d service nova] Acquiring lock "refresh_cache-fc9484c0-9083-4797-8ab1-2ad392822ce8" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:43:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e88174bc-2933-4108-8270-fe9e2aa345d6 req-90bb9233-627e-4bbd-bf1b-0b8ea20beb3d service nova] Acquired lock "refresh_cache-fc9484c0-9083-4797-8ab1-2ad392822ce8" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:43:45 user nova-compute[75391]: DEBUG nova.network.neutron [req-e88174bc-2933-4108-8270-fe9e2aa345d6 req-90bb9233-627e-4bbd-bf1b-0b8ea20beb3d service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Refreshing network info cache for port d8f34e4c-5c99-45eb-a282-a721a2019209 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:43:45 user nova-compute[75391]: DEBUG nova.network.neutron [req-31ae33b1-b677-458b-84b1-9334fa58933c req-91584af4-289d-4ff8-bb58-a54704428b60 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Updated VIF entry in instance network info cache for port c9643afc-4454-4d29-b8a2-5422753857b0. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:43:45 user nova-compute[75391]: DEBUG nova.network.neutron [req-31ae33b1-b677-458b-84b1-9334fa58933c req-91584af4-289d-4ff8-bb58-a54704428b60 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Updating instance_info_cache with network_info: [{"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:43:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-31ae33b1-b677-458b-84b1-9334fa58933c req-91584af4-289d-4ff8-bb58-a54704428b60 service nova] Releasing lock "refresh_cache-ebb7e616-3c05-4d99-a0b3-76dc1723e82d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:43:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-ebb7e616-3c05-4d99-a0b3-76dc1723e82d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:43:45 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 02:43:46 user nova-compute[75391]: DEBUG nova.network.neutron [req-e88174bc-2933-4108-8270-fe9e2aa345d6 req-90bb9233-627e-4bbd-bf1b-0b8ea20beb3d service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Updated VIF entry in instance network info cache for port d8f34e4c-5c99-45eb-a282-a721a2019209. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:43:46 user nova-compute[75391]: DEBUG nova.network.neutron [req-e88174bc-2933-4108-8270-fe9e2aa345d6 req-90bb9233-627e-4bbd-bf1b-0b8ea20beb3d service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Updating instance_info_cache with network_info: [{"id": "d8f34e4c-5c99-45eb-a282-a721a2019209", "address": "fa:16:3e:ca:58:46", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f34e4c-5c", "ovs_interfaceid": "d8f34e4c-5c99-45eb-a282-a721a2019209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:43:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e88174bc-2933-4108-8270-fe9e2aa345d6 req-90bb9233-627e-4bbd-bf1b-0b8ea20beb3d service nova] Releasing lock "refresh_cache-fc9484c0-9083-4797-8ab1-2ad392822ce8" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:43:46 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Updating instance_info_cache with network_info: [{"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:43:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-ebb7e616-3c05-4d99-a0b3-76dc1723e82d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:43:46 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 02:43:46 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:43:46 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:43:46 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:43:46 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:43:46 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:43:46 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:43:46 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:43:46 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:43:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:43:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:43:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:43:46 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:43:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:43:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:43:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:43:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:43:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:47 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:47 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:47 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:47 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5c2514-d819-4792-afde-dfedc85e8e88/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:47 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5c2514-d819-4792-afde-dfedc85e8e88/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:47 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5c2514-d819-4792-afde-dfedc85e8e88/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:47 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5c2514-d819-4792-afde-dfedc85e8e88/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:47 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5586645-063f-463f-b03a-16e783b1c2d5/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:47 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5586645-063f-463f-b03a-16e783b1c2d5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:47 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5586645-063f-463f-b03a-16e783b1c2d5/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5586645-063f-463f-b03a-16e783b1c2d5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc39b27-762e-4bc8-90ba-0215d65710ec/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc39b27-762e-4bc8-90ba-0215d65710ec/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc39b27-762e-4bc8-90ba-0215d65710ec/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc39b27-762e-4bc8-90ba-0215d65710ec/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:50 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:43:50 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:43:50 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=6568MB free_disk=25.284175872802734GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:43:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:43:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:43:50 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9744c8a1-046e-4a00-92e0-92ebb3275ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:43:50 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance fc9484c0-9083-4797-8ab1-2ad392822ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:43:50 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance ebb7e616-3c05-4d99-a0b3-76dc1723e82d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:43:50 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:43:50 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance f5586645-063f-463f-b03a-16e783b1c2d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:43:50 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 60093cdf-015e-4c39-a514-1818a6e55385 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:43:50 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance bb472aa5-47dd-48d6-8e9f-e179afd1d8ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:43:50 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 1fc39b27-762e-4bc8-90ba-0215d65710ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:43:50 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance bc5c2514-d819-4792-afde-dfedc85e8e88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:43:50 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 2fb1dc69-6781-4a4f-a43f-9165d6dae447 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:43:50 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 38a63a30-a3bc-4556-9fb6-53522dbf2c68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:43:50 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 25884e14-afa3-4e5d-8154-a9e9eb455b94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:43:51 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:43:51 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:43:51 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:43:51 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:43:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:51 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:43:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:43:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:55 user nova-compute[75391]: DEBUG nova.compute.manager [req-2438781f-9892-4e03-b70b-0cb2738dc9d5 req-b4c08ac1-ba5a-4301-8cb0-4f4b8f1a65f3 service nova] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Received event network-changed-4ff5dedb-acb1-489b-a2dc-18a0f53f2933 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:43:55 user nova-compute[75391]: DEBUG nova.compute.manager [req-2438781f-9892-4e03-b70b-0cb2738dc9d5 req-b4c08ac1-ba5a-4301-8cb0-4f4b8f1a65f3 service nova] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Refreshing instance network info cache due to event network-changed-4ff5dedb-acb1-489b-a2dc-18a0f53f2933. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:43:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2438781f-9892-4e03-b70b-0cb2738dc9d5 req-b4c08ac1-ba5a-4301-8cb0-4f4b8f1a65f3 service nova] Acquiring lock "refresh_cache-1ee84f40-ff95-41d2-97f6-2ef320cdf9f2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:43:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2438781f-9892-4e03-b70b-0cb2738dc9d5 req-b4c08ac1-ba5a-4301-8cb0-4f4b8f1a65f3 service nova] Acquired lock "refresh_cache-1ee84f40-ff95-41d2-97f6-2ef320cdf9f2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:43:55 user nova-compute[75391]: DEBUG nova.network.neutron [req-2438781f-9892-4e03-b70b-0cb2738dc9d5 req-b4c08ac1-ba5a-4301-8cb0-4f4b8f1a65f3 service nova] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Refreshing network info cache for port 4ff5dedb-acb1-489b-a2dc-18a0f53f2933 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:43:56 user nova-compute[75391]: DEBUG nova.network.neutron [req-2438781f-9892-4e03-b70b-0cb2738dc9d5 req-b4c08ac1-ba5a-4301-8cb0-4f4b8f1a65f3 service nova] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Updated VIF entry in instance network info cache for port 4ff5dedb-acb1-489b-a2dc-18a0f53f2933. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:43:56 user nova-compute[75391]: DEBUG nova.network.neutron [req-2438781f-9892-4e03-b70b-0cb2738dc9d5 req-b4c08ac1-ba5a-4301-8cb0-4f4b8f1a65f3 service nova] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Updating instance_info_cache with network_info: [{"id": "4ff5dedb-acb1-489b-a2dc-18a0f53f2933", "address": "fa:16:3e:2e:13:88", "network": {"id": "cb1a9e37-451d-43be-ab84-a0ebe7ab264b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500424491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9265d1e4bccb467fbf0c738844d8735b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff5dedb-ac", "ovs_interfaceid": "4ff5dedb-acb1-489b-a2dc-18a0f53f2933", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:43:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2438781f-9892-4e03-b70b-0cb2738dc9d5 req-b4c08ac1-ba5a-4301-8cb0-4f4b8f1a65f3 service nova] Releasing lock "refresh_cache-1ee84f40-ff95-41d2-97f6-2ef320cdf9f2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:43:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:43:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Acquiring lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:43:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:43:57 user nova-compute[75391]: DEBUG nova.objects.instance [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lazy-loading 'flavor' on Instance uuid 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:43:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:43:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Acquiring lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:43:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:43:57 user nova-compute[75391]: INFO nova.compute.manager [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Attaching volume 72a4b3da-f714-4ff5-887c-7e2590b30407 to /dev/vdb
Nov 15 02:43:57 user nova-compute[75391]: DEBUG os_brick.utils [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:43:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d62ded-985b-45fc-97ae-86d8c41f99a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:43:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2901d12-d48c-4941-a416-5e8602dbd49a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:43:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:43:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5bc593-9fb0-42a4-864f-90d0f8c3b0c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:43:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5660b051-da23-4a38-8232-efe07a3e7279]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:43:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:43:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:43:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:43:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:43:57 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:43:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73d69bb-9b51-4806-85ef-99b67fe24925]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:43:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:43:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:43:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:43:57 user nova-compute[75391]: DEBUG os_brick.utils [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:43:57 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Updating existing volume attachment record: d8d59082-fdcf-4b7d-ac8d-0170ba2e1b2d {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:43:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:00 user nova-compute[75391]: DEBUG nova.compute.manager [req-88409747-b4ca-48cb-a8cd-22bae70f0851 req-e098fd94-123d-40b6-bfd4-4a4699fb2f95 service nova] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Received event network-changed-13f9f606-3317-4760-b79b-39199222f706 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:00 user nova-compute[75391]: DEBUG nova.compute.manager [req-88409747-b4ca-48cb-a8cd-22bae70f0851 req-e098fd94-123d-40b6-bfd4-4a4699fb2f95 service nova] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Refreshing instance network info cache due to event network-changed-13f9f606-3317-4760-b79b-39199222f706. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:44:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-88409747-b4ca-48cb-a8cd-22bae70f0851 req-e098fd94-123d-40b6-bfd4-4a4699fb2f95 service nova] Acquiring lock "refresh_cache-f5586645-063f-463f-b03a-16e783b1c2d5" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:44:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-88409747-b4ca-48cb-a8cd-22bae70f0851 req-e098fd94-123d-40b6-bfd4-4a4699fb2f95 service nova] Acquired lock "refresh_cache-f5586645-063f-463f-b03a-16e783b1c2d5" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:44:00 user nova-compute[75391]: DEBUG nova.network.neutron [req-88409747-b4ca-48cb-a8cd-22bae70f0851 req-e098fd94-123d-40b6-bfd4-4a4699fb2f95 service nova] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Refreshing network info cache for port 13f9f606-3317-4760-b79b-39199222f706 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:44:00 user nova-compute[75391]: DEBUG nova.compute.manager [req-3d3d4c5d-51ec-4a89-ad3a-662cf2f37253 req-857b4008-ba2f-4641-88a5-8eaf5517877e service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Received event network-changed-5f28911d-785a-4eee-aa6a-5de54d6836e5 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:00 user nova-compute[75391]: DEBUG nova.compute.manager [req-3d3d4c5d-51ec-4a89-ad3a-662cf2f37253 req-857b4008-ba2f-4641-88a5-8eaf5517877e service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Refreshing instance network info cache due to event network-changed-5f28911d-785a-4eee-aa6a-5de54d6836e5. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:44:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3d3d4c5d-51ec-4a89-ad3a-662cf2f37253 req-857b4008-ba2f-4641-88a5-8eaf5517877e service nova] Acquiring lock "refresh_cache-60093cdf-015e-4c39-a514-1818a6e55385" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:44:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3d3d4c5d-51ec-4a89-ad3a-662cf2f37253 req-857b4008-ba2f-4641-88a5-8eaf5517877e service nova] Acquired lock "refresh_cache-60093cdf-015e-4c39-a514-1818a6e55385" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:44:00 user nova-compute[75391]: DEBUG nova.network.neutron [req-3d3d4c5d-51ec-4a89-ad3a-662cf2f37253 req-857b4008-ba2f-4641-88a5-8eaf5517877e service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Refreshing network info cache for port 5f28911d-785a-4eee-aa6a-5de54d6836e5 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:44:01 user nova-compute[75391]: DEBUG nova.network.neutron [req-88409747-b4ca-48cb-a8cd-22bae70f0851 req-e098fd94-123d-40b6-bfd4-4a4699fb2f95 service nova] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Updated VIF entry in instance network info cache for port 13f9f606-3317-4760-b79b-39199222f706. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:44:01 user nova-compute[75391]: DEBUG nova.network.neutron [req-88409747-b4ca-48cb-a8cd-22bae70f0851 req-e098fd94-123d-40b6-bfd4-4a4699fb2f95 service nova] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Updating instance_info_cache with network_info: [{"id": "13f9f606-3317-4760-b79b-39199222f706", "address": "fa:16:3e:8e:ba:2a", "network": {"id": "df52f039-d434-4640-8224-5bb1d10a7ad6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2084034119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5682e8d440c343039dc2baf1d2687863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f9f606-33", "ovs_interfaceid": "13f9f606-3317-4760-b79b-39199222f706", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:44:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-88409747-b4ca-48cb-a8cd-22bae70f0851 req-e098fd94-123d-40b6-bfd4-4a4699fb2f95 service nova] Releasing lock "refresh_cache-f5586645-063f-463f-b03a-16e783b1c2d5" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:44:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:01 user nova-compute[75391]: DEBUG nova.network.neutron [req-3d3d4c5d-51ec-4a89-ad3a-662cf2f37253 req-857b4008-ba2f-4641-88a5-8eaf5517877e service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Updated VIF entry in instance network info cache for port 5f28911d-785a-4eee-aa6a-5de54d6836e5. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:44:01 user nova-compute[75391]: DEBUG nova.network.neutron [req-3d3d4c5d-51ec-4a89-ad3a-662cf2f37253 req-857b4008-ba2f-4641-88a5-8eaf5517877e service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Updating instance_info_cache with network_info: [{"id": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "address": "fa:16:3e:39:41:1f", "network": {"id": "8904261f-fabd-4932-b540-dcc6be4fe56e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-180821931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e357f7331b8042adbc7e74190412daa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f28911d-78", "ovs_interfaceid": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:44:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3d3d4c5d-51ec-4a89-ad3a-662cf2f37253 req-857b4008-ba2f-4641-88a5-8eaf5517877e service nova] Releasing lock "refresh_cache-60093cdf-015e-4c39-a514-1818a6e55385" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:44:02 user nova-compute[75391]: INFO nova.compute.manager [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Rebuilding instance
Nov 15 02:44:02 user nova-compute[75391]: DEBUG nova.compute.manager [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nUbmWrvy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:02 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:02 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:02 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b0dfb9-cfe1-4883-ab68-833da187f25e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:44:02 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5b2045-f32f-4118-83e5-6753123f796c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407] added
Nov 15 02:44:02 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42f8b04-bba8-4057-97b3-30573dca6e89]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[53eccfe0-a557-49d3-969b-2f9953657ddd]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nUbmWrvy {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nUbmWrvy" returned: 0 in 0.089s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6709f5e6-bb62-4f54-9fdd-a027f549583f]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nUbmWrvy'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[652eb0eb-44cd-4ff5-8f13-7f11281779b7]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70550a3-e1f7-4d34-aa7a-d0f112bffc52]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:02 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:02 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:02 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:02 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:02 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:02 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:02 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:02 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df6cb3e-ac4a-450e-9aee-e23218f09b95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407, portal: 172.16.0.220,3260]
Nov 15 02:44:02 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407, portal: 172.16.0.220,3260] successful.
Nov 15 02:44:02 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-7e123eeb-527a-4290-80b3-1a4e653dfa76 req-3f7836c1-9cd9-4d82-b0bf-c5fda678a649 service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Received event network-changed-86eacc9d-8245-4fa1-9a0a-a0a9f396872b {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-7e123eeb-527a-4290-80b3-1a4e653dfa76 req-3f7836c1-9cd9-4d82-b0bf-c5fda678a649 service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Refreshing instance network info cache due to event network-changed-86eacc9d-8245-4fa1-9a0a-a0a9f396872b. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7e123eeb-527a-4290-80b3-1a4e653dfa76 req-3f7836c1-9cd9-4d82-b0bf-c5fda678a649 service nova] Acquiring lock "refresh_cache-bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7e123eeb-527a-4290-80b3-1a4e653dfa76 req-3f7836c1-9cd9-4d82-b0bf-c5fda678a649 service nova] Acquired lock "refresh_cache-bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG nova.network.neutron [req-7e123eeb-527a-4290-80b3-1a4e653dfa76 req-3f7836c1-9cd9-4d82-b0bf-c5fda678a649 service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Refreshing network info cache for port 86eacc9d-8245-4fa1-9a0a-a0a9f396872b {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d322a2e-a3cd-4001-8b6f-3cc2b10ebb57]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03595fc-e0bd-4c12-9084-2097280e77cf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:02 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:02 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:02 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:02 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:02 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:02 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:02 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:02 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:02 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:02 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49b0d05-9317-4a35-98df-4bdcecef3929]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:44:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nUbmWrvy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG nova.compute.manager [req-96e1f1c8-fca4-40c7-89fe-e3fb08f05703 req-fb06c903-295b-4af9-b253-73bc52f177bb service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Received event network-vif-unplugged-5f28911d-785a-4eee-aa6a-5de54d6836e5 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-96e1f1c8-fca4-40c7-89fe-e3fb08f05703 req-fb06c903-295b-4af9-b253-73bc52f177bb service nova] Acquiring lock "60093cdf-015e-4c39-a514-1818a6e55385-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-96e1f1c8-fca4-40c7-89fe-e3fb08f05703 req-fb06c903-295b-4af9-b253-73bc52f177bb service nova] Lock "60093cdf-015e-4c39-a514-1818a6e55385-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-96e1f1c8-fca4-40c7-89fe-e3fb08f05703 req-fb06c903-295b-4af9-b253-73bc52f177bb service nova] Lock "60093cdf-015e-4c39-a514-1818a6e55385-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG nova.compute.manager [req-96e1f1c8-fca4-40c7-89fe-e3fb08f05703 req-fb06c903-295b-4af9-b253-73bc52f177bb service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] No waiting events found dispatching network-vif-unplugged-5f28911d-785a-4eee-aa6a-5de54d6836e5 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:44:03 user nova-compute[75391]: WARNING nova.compute.manager [req-96e1f1c8-fca4-40c7-89fe-e3fb08f05703 req-fb06c903-295b-4af9-b253-73bc52f177bb service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Received unexpected event network-vif-unplugged-5f28911d-785a-4eee-aa6a-5de54d6836e5 for instance with vm_state active and task_state rebuilding.
Nov 15 02:44:03 user nova-compute[75391]: DEBUG nova.compute.manager [req-96e1f1c8-fca4-40c7-89fe-e3fb08f05703 req-fb06c903-295b-4af9-b253-73bc52f177bb service nova] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Received event network-changed-8bff8066-85b6-4359-88db-9d717d9a04f9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG nova.compute.manager [req-96e1f1c8-fca4-40c7-89fe-e3fb08f05703 req-fb06c903-295b-4af9-b253-73bc52f177bb service nova] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Refreshing instance network info cache due to event network-changed-8bff8066-85b6-4359-88db-9d717d9a04f9. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-96e1f1c8-fca4-40c7-89fe-e3fb08f05703 req-fb06c903-295b-4af9-b253-73bc52f177bb service nova] Acquiring lock "refresh_cache-1fc39b27-762e-4bc8-90ba-0215d65710ec" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-96e1f1c8-fca4-40c7-89fe-e3fb08f05703 req-fb06c903-295b-4af9-b253-73bc52f177bb service nova] Acquired lock "refresh_cache-1fc39b27-762e-4bc8-90ba-0215d65710ec" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG nova.network.neutron [req-96e1f1c8-fca4-40c7-89fe-e3fb08f05703 req-fb06c903-295b-4af9-b253-73bc52f177bb service nova] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Refreshing network info cache for port 8bff8066-85b6-4359-88db-9d717d9a04f9 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Acquiring lock "f5586645-063f-463f-b03a-16e783b1c2d5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "f5586645-063f-463f-b03a-16e783b1c2d5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:03 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Instance destroyed successfully.
Nov 15 02:44:03 user nova-compute[75391]: DEBUG nova.objects.instance [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lazy-loading 'flavor' on Instance uuid f5586645-063f-463f-b03a-16e783b1c2d5 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:44:03 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Instance destroyed successfully.
Nov 15 02:44:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-687676829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1071606514',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJpUqLBG9MXTa4b8ttJcUyIaQWwwfKw3oQQHLLLE6hRohPvI+iHNv7PsUg7WlW0Rk9dnTSBu2zUo7T1ApUjCFWDWZfBwkbNbFZxmqfiLBpDMCEOaVy2Lcdga2I1GHUEGQ==',key_name='tempest-keypair-1458525323',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:42:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e357f7331b8042adbc7e74190412daa2',ramdisk_id='',reservation_id='r-2jmtqabu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1642963392',owner_user_name='tempest-ServerActionsV293TestJSON-1642963392-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:44:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='541a74f4f1004769b64f8086feae6255',uuid=60093cdf-015e-4c39-a514-1818a6e55385,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "address": "fa:16:3e:39:41:1f", "network": {"id": "8904261f-fabd-4932-b540-dcc6be4fe56e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-180821931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e357f7331b8042adbc7e74190412daa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f28911d-78", "ovs_interfaceid": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Converting VIF {"id": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "address": "fa:16:3e:39:41:1f", "network": {"id": "8904261f-fabd-4932-b540-dcc6be4fe56e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-180821931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e357f7331b8042adbc7e74190412daa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f28911d-78", "ovs_interfaceid": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:41:1f,bridge_name='br-int',has_traffic_filtering=True,id=5f28911d-785a-4eee-aa6a-5de54d6836e5,network=Network(8904261f-fabd-4932-b540-dcc6be4fe56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f28911d-78') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG os_vif [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:41:1f,bridge_name='br-int',has_traffic_filtering=True,id=5f28911d-785a-4eee-aa6a-5de54d6836e5,network=Network(8904261f-fabd-4932-b540-dcc6be4fe56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f28911d-78') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f28911d-78, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=929df5be-3e13-465c-bd68-8b47e062262c) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Acquiring lock "1fc39b27-762e-4bc8-90ba-0215d65710ec" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lock "1fc39b27-762e-4bc8-90ba-0215d65710ec" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "f5586645-063f-463f-b03a-16e783b1c2d5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.109s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:44:03 user nova-compute[75391]: INFO os_vif [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:41:1f,bridge_name='br-int',has_traffic_filtering=True,id=5f28911d-785a-4eee-aa6a-5de54d6836e5,network=Network(8904261f-fabd-4932-b540-dcc6be4fe56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f28911d-78')
Nov 15 02:44:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG nova.objects.instance [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lazy-loading 'flavor' on Instance uuid 1fc39b27-762e-4bc8-90ba-0215d65710ec {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQIuJiSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:03 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 02:44:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lock "1fc39b27-762e-4bc8-90ba-0215d65710ec" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d3256068-c5bd-40fc-a151-073425cff5f1 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Acquiring lock "interface-bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d3256068-c5bd-40fc-a151-073425cff5f1 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "interface-bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG nova.objects.instance [None req-d3256068-c5bd-40fc-a151-073425cff5f1 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lazy-loading 'flavor' on Instance uuid bb472aa5-47dd-48d6-8e9f-e179afd1d8ec {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Acquiring lock "f5586645-063f-463f-b03a-16e783b1c2d5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "f5586645-063f-463f-b03a-16e783b1c2d5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:03 user nova-compute[75391]: INFO nova.compute.manager [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Attaching volume 3ec81723-86c4-4a49-b656-763ce2eb96c2 to /dev/sdc
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Acquiring lock "1fc39b27-762e-4bc8-90ba-0215d65710ec" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lock "1fc39b27-762e-4bc8-90ba-0215d65710ec" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:03 user nova-compute[75391]: INFO nova.compute.manager [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Attaching volume f76e360b-eb5e-47bb-ae1a-9acd86e55d1b to /dev/vdb
Nov 15 02:44:03 user nova-compute[75391]: DEBUG os_brick.utils [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[91989508-2691-48d0-8175-07ebd219ac2f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39f4ce8-e9e5-407f-9fbc-62ec74aac1e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG os_brick.utils [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bce9af-d193-4540-b2fb-39bb28e651b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8e250d-3dc3-461d-b759-3e07daccc646]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[150e7aa5-d9c8-4453-a4b5-43916b0d030a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG nova.network.neutron [req-7e123eeb-527a-4290-80b3-1a4e653dfa76 req-3f7836c1-9cd9-4d82-b0bf-c5fda678a649 service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Updated VIF entry in instance network info cache for port 86eacc9d-8245-4fa1-9a0a-a0a9f396872b. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG nova.network.neutron [req-7e123eeb-527a-4290-80b3-1a4e653dfa76 req-3f7836c1-9cd9-4d82-b0bf-c5fda678a649 service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Updating instance_info_cache with network_info: [{"id": "86eacc9d-8245-4fa1-9a0a-a0a9f396872b", "address": "fa:16:3e:08:66:14", "network": {"id": "c36f20d0-0398-4c34-b593-d9610a7b5fc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-689770940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68070c12bf9f4c45a8c12165d571fa41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eacc9d-82", "ovs_interfaceid": "86eacc9d-8245-4fa1-9a0a-a0a9f396872b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:44:03 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d088d1-789b-4745-881b-84b05eda848f]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG os_brick.utils [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Updating existing volume attachment record: 30b2dac5-85fe-4eec-9f52-266c3ee9e490 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[474456fa-2cd3-45ee-a9c6-c95af6e97cfd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7e123eeb-527a-4290-80b3-1a4e653dfa76 req-3f7836c1-9cd9-4d82-b0bf-c5fda678a649 service nova] Releasing lock "refresh_cache-bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b159a8-f43d-4cd7-89bf-999b2071058d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfd7ceb-8b46-4a7f-87be-ebe0728cc746]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:44:03 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3b0447-bf49-487f-a4dc-4c1ac18623fa]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG os_brick.utils [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Updating existing volume attachment record: a868e954-730b-447c-a7fd-ec4ae12ee1f2 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG nova.objects.instance [None req-d3256068-c5bd-40fc-a151-073425cff5f1 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lazy-loading 'pci_requests' on Instance uuid bb472aa5-47dd-48d6-8e9f-e179afd1d8ec {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG nova.objects.base [None req-d3256068-c5bd-40fc-a151-073425cff5f1 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Object Instance<bb472aa5-47dd-48d6-8e9f-e179afd1d8ec> lazy-loaded attributes: flavor,pci_requests {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG nova.network.neutron [None req-d3256068-c5bd-40fc-a151-073425cff5f1 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '23865663838346237', 'path': '/dev/sdf'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865663838346237', 'path': '/dev/sdf'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG nova.network.neutron [req-96e1f1c8-fca4-40c7-89fe-e3fb08f05703 req-fb06c903-295b-4af9-b253-73bc52f177bb service nova] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Updated VIF entry in instance network info cache for port 8bff8066-85b6-4359-88db-9d717d9a04f9. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG nova.network.neutron [req-96e1f1c8-fca4-40c7-89fe-e3fb08f05703 req-fb06c903-295b-4af9-b253-73bc52f177bb service nova] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Updating instance_info_cache with network_info: [{"id": "8bff8066-85b6-4359-88db-9d717d9a04f9", "address": "fa:16:3e:97:51:45", "network": {"id": "092f8c09-7149-4498-909e-88abbcd706c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-926291745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed52241ecd1247e988041262db5831d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bff8066-85", "ovs_interfaceid": "8bff8066-85b6-4359-88db-9d717d9a04f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.613s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG nova.objects.instance [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lazy-loading 'flavor' on Instance uuid 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG nova.policy [None req-d3256068-c5bd-40fc-a151-073425cff5f1 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1727eae8986646508dbb022ae69ab573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68070c12bf9f4c45a8c12165d571fa41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-96e1f1c8-fca4-40c7-89fe-e3fb08f05703 req-fb06c903-295b-4af9-b253-73bc52f177bb service nova] Releasing lock "refresh_cache-1fc39b27-762e-4bc8-90ba-0215d65710ec" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3dfbde-419a-4c20-87ce-ad15f9ed07cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:44:03 user nova-compute[75391]: No targets found.
Nov 15 02:44:03 user nova-compute[75391]: iSNS:
Nov 15 02:44:03 user nova-compute[75391]: No targets found.
Nov 15 02:44:03 user nova-compute[75391]: STATIC:
Nov 15 02:44:03 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407
Nov 15 02:44:03 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:03 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:03 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c
Nov 15 02:44:03 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:03 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:03 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40
Nov 15 02:44:03 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:03 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:03 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d
Nov 15 02:44:03 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:03 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:03 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6
Nov 15 02:44:03 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:03 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:03 user nova-compute[75391]: FIRMWARE:
Nov 15 02:44:03 user nova-compute[75391]: No targets found.
Nov 15 02:44:03 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:44:03 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:44:03 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 02:44:03 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:44:03 user nova-compute[75391]:   <source dev="/dev/sdf"/>
Nov 15 02:44:03 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:44:03 user nova-compute[75391]:   <serial>72a4b3da-f714-4ff5-887c-7e2590b30407</serial>
Nov 15 02:44:03 user nova-compute[75391]: </disk>
Nov 15 02:44:03 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6307509-98c5-4cf9-bd10-a5f2ea25806a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b18dcc-d857-424f-8d18-1b575461db7a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:03 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:03 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:03 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:03 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:03 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:03 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:03 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:03 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:03 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:03 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6244258550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40'): ({'sdb'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Removing single pathed devices sdb {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:44:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda55054-d40e-4a81-afbd-833590ffb37a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d596aa-e1a8-4b7b-bbda-74aad31a6898]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Flushing IO for device /dev/sdb {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa02c56-861b-4507-8f7b-c010cf425249]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b134de-b103-4311-939a-732dd2f391ed]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea08975-da9e-402d-8592-3b9b10e5ee09]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e5a426-547a-4592-9d73-b42c9f6ce87a]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40, portal: 172.16.0.220,3260]
Nov 15 02:44:04 user nova-compute[75391]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40, portal: 172.16.0.220,3260] successful.
Nov 15 02:44:04 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1965e3-aa09-413e-abff-77393b0f4185]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] <== disconnect_volume: return (934ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:44:04 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Deleting instance files /opt/stack/data/nova/instances/60093cdf-015e-4c39-a514-1818a6e55385_del
Nov 15 02:44:04 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Deletion of /opt/stack/data/nova/instances/60093cdf-015e-4c39-a514-1818a6e55385_del complete
Nov 15 02:44:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] No VIF found with MAC fa:16:3e:2e:13:88, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:44:04 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 60093cdf-015e-4c39-a514-1818a6e55385 could not be found.
Nov 15 02:44:04 user nova-compute[75391]: DEBUG nova.network.neutron [None req-d3256068-c5bd-40fc-a151-073425cff5f1 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Successfully created port: 34633d4d-5212-4738-847f-25acca40b074 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQIuJiSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:04 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 02:44:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[49042514-f0b0-44dc-85b2-53c6b5d51f2f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:44:04 user nova-compute[75391]: No targets found.
Nov 15 02:44:04 user nova-compute[75391]: iSNS:
Nov 15 02:44:04 user nova-compute[75391]: No targets found.
Nov 15 02:44:04 user nova-compute[75391]: STATIC:
Nov 15 02:44:04 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407
Nov 15 02:44:04 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:04 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:04 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c
Nov 15 02:44:04 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:04 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:04 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d
Nov 15 02:44:04 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:04 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:04 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6
Nov 15 02:44:04 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:04 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:04 user nova-compute[75391]: FIRMWARE:
Nov 15 02:44:04 user nova-compute[75391]: No targets found.
Nov 15 02:44:04 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:44:04 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:44:04 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0517aef0-fd72-4f3d-a3b2-91aa32ba3ae9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81f6220-3a76-49dd-a313-663452bc15ec]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:04 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:04 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:04 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:04 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:04 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:04 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:04 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:04 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6244759fc0>, {}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Disconnecting from: [] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.085s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] <== disconnect_volume: return (86ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:44:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3aff4165-5567-4f13-a06b-68800e1dac2c tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.303s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG nova.network.neutron [None req-d3256068-c5bd-40fc-a151-073425cff5f1 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Successfully updated port: 34633d4d-5212-4738-847f-25acca40b074 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d3256068-c5bd-40fc-a151-073425cff5f1 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Acquiring lock "refresh_cache-bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d3256068-c5bd-40fc-a151-073425cff5f1 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Acquired lock "refresh_cache-bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG nova.network.neutron [None req-d3256068-c5bd-40fc-a151-073425cff5f1 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-c86864a5-2ab0-4183-8313-c234eb07c110 req-809eec32-759c-40eb-b395-46fa11dde55f service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Received event network-changed-34633d4d-5212-4738-847f-25acca40b074 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-c86864a5-2ab0-4183-8313-c234eb07c110 req-809eec32-759c-40eb-b395-46fa11dde55f service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Refreshing instance network info cache due to event network-changed-34633d4d-5212-4738-847f-25acca40b074. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c86864a5-2ab0-4183-8313-c234eb07c110 req-809eec32-759c-40eb-b395-46fa11dde55f service nova] Acquiring lock "refresh_cache-bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-1285dbd2-ad88-4604-bf2a-9723f922a45d req-48a0e2ae-bb1a-4045-98a5-b747d21f0bcc service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Received event network-vif-plugged-5f28911d-785a-4eee-aa6a-5de54d6836e5 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1285dbd2-ad88-4604-bf2a-9723f922a45d req-48a0e2ae-bb1a-4045-98a5-b747d21f0bcc service nova] Acquiring lock "60093cdf-015e-4c39-a514-1818a6e55385-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1285dbd2-ad88-4604-bf2a-9723f922a45d req-48a0e2ae-bb1a-4045-98a5-b747d21f0bcc service nova] Lock "60093cdf-015e-4c39-a514-1818a6e55385-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1285dbd2-ad88-4604-bf2a-9723f922a45d req-48a0e2ae-bb1a-4045-98a5-b747d21f0bcc service nova] Lock "60093cdf-015e-4c39-a514-1818a6e55385-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-1285dbd2-ad88-4604-bf2a-9723f922a45d req-48a0e2ae-bb1a-4045-98a5-b747d21f0bcc service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] No waiting events found dispatching network-vif-plugged-5f28911d-785a-4eee-aa6a-5de54d6836e5 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:44:05 user nova-compute[75391]: WARNING nova.compute.manager [req-1285dbd2-ad88-4604-bf2a-9723f922a45d req-48a0e2ae-bb1a-4045-98a5-b747d21f0bcc service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Received unexpected event network-vif-plugged-5f28911d-785a-4eee-aa6a-5de54d6836e5 for instance with vm_state active and task_state rebuilding.
Nov 15 02:44:05 user nova-compute[75391]: DEBUG nova.network.neutron [None req-d3256068-c5bd-40fc-a151-073425cff5f1 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Updating instance_info_cache with network_info: [{"id": "86eacc9d-8245-4fa1-9a0a-a0a9f396872b", "address": "fa:16:3e:08:66:14", "network": {"id": "c36f20d0-0398-4c34-b593-d9610a7b5fc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-689770940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68070c12bf9f4c45a8c12165d571fa41", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eacc9d-82", "ovs_interfaceid": "86eacc9d-8245-4fa1-9a0a-a0a9f396872b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34633d4d-5212-4738-847f-25acca40b074", "address": "fa:16:3e:64:fc:ab", "network": {"id": "1a6d6e24-345d-40d3-badd-a60f9ec9373e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1185402927", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "68070c12bf9f4c45a8c12165d571fa41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34633d4d-52", "ovs_interfaceid": "34633d4d-5212-4738-847f-25acca40b074", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d3256068-c5bd-40fc-a151-073425cff5f1 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Releasing lock "refresh_cache-bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c86864a5-2ab0-4183-8313-c234eb07c110 req-809eec32-759c-40eb-b395-46fa11dde55f service nova] Acquired lock "refresh_cache-bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG nova.network.neutron [req-c86864a5-2ab0-4183-8313-c234eb07c110 req-809eec32-759c-40eb-b395-46fa11dde55f service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Refreshing network info cache for port 34633d4d-5212-4738-847f-25acca40b074 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-d3256068-c5bd-40fc-a151-073425cff5f1 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-84898992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-84898992',id=7,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjGjAlXtIFwyK48Tn0rWDvwO+CMiqK5nwES7Ozr0xqfWpvP+GLtsNTghKrGqtv5RFJtUL1Xov3deHDY6XnlkjWriT5bcxPdE96duFESi6cETl7FauYVa7ChUe8ZPLW7IQ==',key_name='tempest-keypair-1251809303',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:42:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='68070c12bf9f4c45a8c12165d571fa41',ramdisk_id='',reservation_id='r-j0qi94j3',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-382223691',owner_user_name='tempest-TaggedAttachmentsTest-382223691-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:42:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1727eae8986646508dbb022ae69ab573',uuid=bb472aa5-47dd-48d6-8e9f-e179afd1d8ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34633d4d-5212-4738-847f-25acca40b074", "address": "fa:16:3e:64:fc:ab", "network": {"id": "1a6d6e24-345d-40d3-badd-a60f9ec9373e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1185402927", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "68070c12bf9f4c45a8c12165d571fa41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34633d4d-52", "ovs_interfaceid": "34633d4d-5212-4738-847f-25acca40b074", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-d3256068-c5bd-40fc-a151-073425cff5f1 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Converting VIF {"id": "34633d4d-5212-4738-847f-25acca40b074", "address": "fa:16:3e:64:fc:ab", "network": {"id": "1a6d6e24-345d-40d3-badd-a60f9ec9373e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1185402927", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "68070c12bf9f4c45a8c12165d571fa41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34633d4d-52", "ovs_interfaceid": "34633d4d-5212-4738-847f-25acca40b074", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-d3256068-c5bd-40fc-a151-073425cff5f1 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:fc:ab,bridge_name='br-int',has_traffic_filtering=True,id=34633d4d-5212-4738-847f-25acca40b074,network=Network(1a6d6e24-345d-40d3-badd-a60f9ec9373e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34633d4d-52') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG os_vif [None req-d3256068-c5bd-40fc-a151-073425cff5f1 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:fc:ab,bridge_name='br-int',has_traffic_filtering=True,id=34633d4d-5212-4738-847f-25acca40b074,network=Network(1a6d6e24-345d-40d3-badd-a60f9ec9373e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34633d4d-52') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7152eda5-f98c-5caa-99f9-3c063cb8aa7b', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34633d4d-52, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap34633d4d-52, col_values=(('qos', UUID('38bc0663-b4f2-464a-85ac-474d5076f722')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap34633d4d-52, col_values=(('external_ids', {'iface-id': '34633d4d-5212-4738-847f-25acca40b074', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:fc:ab', 'vm-uuid': 'bb472aa5-47dd-48d6-8e9f-e179afd1d8ec'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:05 user nova-compute[75391]: INFO os_vif [None req-d3256068-c5bd-40fc-a151-073425cff5f1 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:fc:ab,bridge_name='br-int',has_traffic_filtering=True,id=34633d4d-5212-4738-847f-25acca40b074,network=Network(1a6d6e24-345d-40d3-badd-a60f9ec9373e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34633d4d-52')
Nov 15 02:44:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-d3256068-c5bd-40fc-a151-073425cff5f1 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-84898992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-84898992',id=7,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjGjAlXtIFwyK48Tn0rWDvwO+CMiqK5nwES7Ozr0xqfWpvP+GLtsNTghKrGqtv5RFJtUL1Xov3deHDY6XnlkjWriT5bcxPdE96duFESi6cETl7FauYVa7ChUe8ZPLW7IQ==',key_name='tempest-keypair-1251809303',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:42:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='68070c12bf9f4c45a8c12165d571fa41',ramdisk_id='',reservation_id='r-j0qi94j3',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-382223691',owner_user_name='tempest-TaggedAttachmentsTest-382223691-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:42:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1727eae8986646508dbb022ae69ab573',uuid=bb472aa5-47dd-48d6-8e9f-e179afd1d8ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34633d4d-5212-4738-847f-25acca40b074", "address": "fa:16:3e:64:fc:ab", "network": {"id": "1a6d6e24-345d-40d3-badd-a60f9ec9373e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1185402927", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "68070c12bf9f4c45a8c12165d571fa41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34633d4d-52", "ovs_interfaceid": "34633d4d-5212-4738-847f-25acca40b074", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-d3256068-c5bd-40fc-a151-073425cff5f1 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Converting VIF {"id": "34633d4d-5212-4738-847f-25acca40b074", "address": "fa:16:3e:64:fc:ab", "network": {"id": "1a6d6e24-345d-40d3-badd-a60f9ec9373e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1185402927", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "68070c12bf9f4c45a8c12165d571fa41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34633d4d-52", "ovs_interfaceid": "34633d4d-5212-4738-847f-25acca40b074", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-d3256068-c5bd-40fc-a151-073425cff5f1 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:fc:ab,bridge_name='br-int',has_traffic_filtering=True,id=34633d4d-5212-4738-847f-25acca40b074,network=Network(1a6d6e24-345d-40d3-badd-a60f9ec9373e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34633d4d-52') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-d3256068-c5bd-40fc-a151-073425cff5f1 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] attach device xml: <interface type="ethernet">
Nov 15 02:44:05 user nova-compute[75391]:   <mac address="fa:16:3e:64:fc:ab"/>
Nov 15 02:44:05 user nova-compute[75391]:   <model type="virtio"/>
Nov 15 02:44:05 user nova-compute[75391]:   <mtu size="1442"/>
Nov 15 02:44:05 user nova-compute[75391]:   <target dev="tap34633d4d-52"/>
Nov 15 02:44:05 user nova-compute[75391]: </interface>
Nov 15 02:44:05 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:06 user nova-compute[75391]: DEBUG nova.network.neutron [req-c86864a5-2ab0-4183-8313-c234eb07c110 req-809eec32-759c-40eb-b395-46fa11dde55f service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Updated VIF entry in instance network info cache for port 34633d4d-5212-4738-847f-25acca40b074. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:44:06 user nova-compute[75391]: DEBUG nova.network.neutron [req-c86864a5-2ab0-4183-8313-c234eb07c110 req-809eec32-759c-40eb-b395-46fa11dde55f service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Updating instance_info_cache with network_info: [{"id": "86eacc9d-8245-4fa1-9a0a-a0a9f396872b", "address": "fa:16:3e:08:66:14", "network": {"id": "c36f20d0-0398-4c34-b593-d9610a7b5fc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-689770940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68070c12bf9f4c45a8c12165d571fa41", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eacc9d-82", "ovs_interfaceid": "86eacc9d-8245-4fa1-9a0a-a0a9f396872b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34633d4d-5212-4738-847f-25acca40b074", "address": "fa:16:3e:64:fc:ab", "network": {"id": "1a6d6e24-345d-40d3-badd-a60f9ec9373e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1185402927", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "68070c12bf9f4c45a8c12165d571fa41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34633d4d-52", "ovs_interfaceid": "34633d4d-5212-4738-847f-25acca40b074", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:44:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c86864a5-2ab0-4183-8313-c234eb07c110 req-809eec32-759c-40eb-b395-46fa11dde55f service nova] Releasing lock "refresh_cache-bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:44:06 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-d3256068-c5bd-40fc-a151-073425cff5f1 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:44:06 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-d3256068-c5bd-40fc-a151-073425cff5f1 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] No BDM found with device name hda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:44:06 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-d3256068-c5bd-40fc-a151-073425cff5f1 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] No VIF found with MAC fa:16:3e:08:66:14, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:44:06 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-d3256068-c5bd-40fc-a151-073425cff5f1 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:44:06 user nova-compute[75391]:   <nova:package version="0.0.0"/>
Nov 15 02:44:06 user nova-compute[75391]:   <nova:name>tempest-device-tagging-server-84898992</nova:name>
Nov 15 02:44:06 user nova-compute[75391]:   <nova:creationTime>2023-11-15 02:44:06</nova:creationTime>
Nov 15 02:44:06 user nova-compute[75391]:   <nova:flavor name="m1.tiny">
Nov 15 02:44:06 user nova-compute[75391]:     <nova:memory>512</nova:memory>
Nov 15 02:44:06 user nova-compute[75391]:     <nova:disk>1</nova:disk>
Nov 15 02:44:06 user nova-compute[75391]:     <nova:swap>0</nova:swap>
Nov 15 02:44:06 user nova-compute[75391]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:44:06 user nova-compute[75391]:     <nova:vcpus>1</nova:vcpus>
Nov 15 02:44:06 user nova-compute[75391]:   </nova:flavor>
Nov 15 02:44:06 user nova-compute[75391]:   <nova:owner>
Nov 15 02:44:06 user nova-compute[75391]:     <nova:user uuid="1727eae8986646508dbb022ae69ab573">tempest-TaggedAttachmentsTest-382223691-project-member</nova:user>
Nov 15 02:44:06 user nova-compute[75391]:     <nova:project uuid="68070c12bf9f4c45a8c12165d571fa41">tempest-TaggedAttachmentsTest-382223691</nova:project>
Nov 15 02:44:06 user nova-compute[75391]:   </nova:owner>
Nov 15 02:44:06 user nova-compute[75391]:   <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:44:06 user nova-compute[75391]:   <nova:ports>
Nov 15 02:44:06 user nova-compute[75391]:     <nova:port uuid="86eacc9d-8245-4fa1-9a0a-a0a9f396872b">
Nov 15 02:44:06 user nova-compute[75391]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 02:44:06 user nova-compute[75391]:     </nova:port>
Nov 15 02:44:06 user nova-compute[75391]:     <nova:port uuid="34633d4d-5212-4738-847f-25acca40b074">
Nov 15 02:44:06 user nova-compute[75391]:       <nova:ip type="fixed" address="10.10.10.161" ipVersion="4"/>
Nov 15 02:44:06 user nova-compute[75391]:     </nova:port>
Nov 15 02:44:06 user nova-compute[75391]:   </nova:ports>
Nov 15 02:44:06 user nova-compute[75391]: </nova:instance>
Nov 15 02:44:06 user nova-compute[75391]:  {{(pid=75391) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 02:44:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d3256068-c5bd-40fc-a151-073425cff5f1 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "interface-bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.826s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-16a4ccb6-51c2-4af6-af65-e1abec371e53 req-22f47b02-4edb-4097-a30d-fa4ef922c826 service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Received event network-vif-plugged-34633d4d-5212-4738-847f-25acca40b074 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-16a4ccb6-51c2-4af6-af65-e1abec371e53 req-22f47b02-4edb-4097-a30d-fa4ef922c826 service nova] Acquiring lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-16a4ccb6-51c2-4af6-af65-e1abec371e53 req-22f47b02-4edb-4097-a30d-fa4ef922c826 service nova] Lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-16a4ccb6-51c2-4af6-af65-e1abec371e53 req-22f47b02-4edb-4097-a30d-fa4ef922c826 service nova] Lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-16a4ccb6-51c2-4af6-af65-e1abec371e53 req-22f47b02-4edb-4097-a30d-fa4ef922c826 service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] No waiting events found dispatching network-vif-plugged-34633d4d-5212-4738-847f-25acca40b074 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:44:07 user nova-compute[75391]: WARNING nova.compute.manager [req-16a4ccb6-51c2-4af6-af65-e1abec371e53 req-22f47b02-4edb-4097-a30d-fa4ef922c826 service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Received unexpected event network-vif-plugged-34633d4d-5212-4738-847f-25acca40b074 for instance with vm_state active and task_state None.
Nov 15 02:44:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-16a4ccb6-51c2-4af6-af65-e1abec371e53 req-22f47b02-4edb-4097-a30d-fa4ef922c826 service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Received event network-vif-plugged-34633d4d-5212-4738-847f-25acca40b074 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-16a4ccb6-51c2-4af6-af65-e1abec371e53 req-22f47b02-4edb-4097-a30d-fa4ef922c826 service nova] Acquiring lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-16a4ccb6-51c2-4af6-af65-e1abec371e53 req-22f47b02-4edb-4097-a30d-fa4ef922c826 service nova] Lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-16a4ccb6-51c2-4af6-af65-e1abec371e53 req-22f47b02-4edb-4097-a30d-fa4ef922c826 service nova] Lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-16a4ccb6-51c2-4af6-af65-e1abec371e53 req-22f47b02-4edb-4097-a30d-fa4ef922c826 service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] No waiting events found dispatching network-vif-plugged-34633d4d-5212-4738-847f-25acca40b074 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:44:07 user nova-compute[75391]: WARNING nova.compute.manager [req-16a4ccb6-51c2-4af6-af65-e1abec371e53 req-22f47b02-4edb-4097-a30d-fa4ef922c826 service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Received unexpected event network-vif-plugged-34633d4d-5212-4738-847f-25acca40b074 for instance with vm_state active and task_state None.
Nov 15 02:44:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aCZexIPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:08 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:08 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:08 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:08 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:08 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[98162bca-809d-4b1f-b2ca-2ff90da01482]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:44:08 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e94e48-5118-4b72-8ce8-ecc4b9539d14]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2] added
Nov 15 02:44:08 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed66875-93fb-47ea-b2aa-9385cf09b453]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e27c15c-4af8-4bae-8667-dbcf95024658]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aCZexIPp {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aCZexIPp" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f60bde2-dbf3-4df4-8388-d642864086d7]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aCZexIPp'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3461247f-a4cb-40cb-8ded-c5f39c88a0b1]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Acquiring lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0ab3f2-2a18-4de4-b90b-19c247d22020]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:08 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:08 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:08 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:08 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:08 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:08 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:08 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:08 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG nova.objects.instance [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lazy-loading 'flavor' on Instance uuid bb472aa5-47dd-48d6-8e9f-e179afd1d8ec {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a8f948-3b62-4f8e-9b57-c45fce7b751c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2, portal: 172.16.0.220,3260]
Nov 15 02:44:08 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2, portal: 172.16.0.220,3260] successful.
Nov 15 02:44:08 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.102s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3191a287-6125-47e6-b772-5e2ef2c5f887]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5440dd-661e-4f49-9047-60ed9082df0a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:08 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:08 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:08 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:08 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:08 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:08 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:08 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:08 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:08 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:08 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] HCTL ('33', '-', '-', 0) found on session 7 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4769a32d-0809-4ae3-80e4-8761a79885bf]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Searching for a device in session 7 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aCZexIPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Acquiring lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:08 user nova-compute[75391]: INFO nova.compute.manager [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Attaching volume 73d0c9f6-98ce-4e4b-8253-20830022185a to /dev/vdb
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Acquiring lock "bc5c2514-d819-4792-afde-dfedc85e8e88" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Lock "bc5c2514-d819-4792-afde-dfedc85e8e88" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:08 user nova-compute[75391]: DEBUG nova.objects.instance [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Lazy-loading 'flavor' on Instance uuid bc5c2514-d819-4792-afde-dfedc85e8e88 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Lock "bc5c2514-d819-4792-afde-dfedc85e8e88" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG os_brick.utils [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0c3ece-0e84-43d7-ba5a-e0937d666991]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d54b3c-5327-4b79-b115-91031e868841]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5cb5e0-786b-4570-a7fa-3fbbbe1e7af3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b86810d-068a-463f-b44f-f1cb7270517e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG nova.compute.manager [req-a06dd838-445e-48ad-ba88-8fac3b5f8568 req-b2eb5dc8-5ff7-4a17-a906-706c37e848cb service nova] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Received event network-changed-499cebaa-a6e6-4908-b5c5-1bc2b199b439 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG nova.compute.manager [req-a06dd838-445e-48ad-ba88-8fac3b5f8568 req-b2eb5dc8-5ff7-4a17-a906-706c37e848cb service nova] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Refreshing instance network info cache due to event network-changed-499cebaa-a6e6-4908-b5c5-1bc2b199b439. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a06dd838-445e-48ad-ba88-8fac3b5f8568 req-b2eb5dc8-5ff7-4a17-a906-706c37e848cb service nova] Acquiring lock "refresh_cache-bc5c2514-d819-4792-afde-dfedc85e8e88" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a06dd838-445e-48ad-ba88-8fac3b5f8568 req-b2eb5dc8-5ff7-4a17-a906-706c37e848cb service nova] Acquired lock "refresh_cache-bc5c2514-d819-4792-afde-dfedc85e8e88" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG nova.network.neutron [req-a06dd838-445e-48ad-ba88-8fac3b5f8568 req-b2eb5dc8-5ff7-4a17-a906-706c37e848cb service nova] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Refreshing network info cache for port 499cebaa-a6e6-4908-b5c5-1bc2b199b439 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:44:09 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[152a3ce9-b828-4049-84c8-75c5d2d7c230]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG os_brick.utils [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Updating existing volume attachment record: 35ec1400-7aac-4283-9fff-a7fd3c399ddc {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Acquiring lock "bc5c2514-d819-4792-afde-dfedc85e8e88" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Lock "bc5c2514-d819-4792-afde-dfedc85e8e88" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:09 user nova-compute[75391]: INFO nova.compute.manager [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Attaching volume 4704b25d-7971-4b70-b39b-ce9bfe07f769 to /dev/vdb
Nov 15 02:44:09 user nova-compute[75391]: DEBUG nova.compute.manager [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Preparing to wait for external event volume-reimaged-7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 {{(pid=75391) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Acquiring lock "60093cdf-015e-4c39-a514-1818a6e55385-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "60093cdf-015e-4c39-a514-1818a6e55385-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "60093cdf-015e-4c39-a514-1818a6e55385-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Acquiring lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:09 user nova-compute[75391]: INFO nova.compute.manager [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Detaching volume 72a4b3da-f714-4ff5-887c-7e2590b30407
Nov 15 02:44:09 user nova-compute[75391]: DEBUG os_brick.utils [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a378638a-63c7-468b-93f9-214522773520]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f154ef-2227-453b-a506-5fd0f8aeeb06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG nova.network.neutron [req-a06dd838-445e-48ad-ba88-8fac3b5f8568 req-b2eb5dc8-5ff7-4a17-a906-706c37e848cb service nova] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Updated VIF entry in instance network info cache for port 499cebaa-a6e6-4908-b5c5-1bc2b199b439. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG nova.network.neutron [req-a06dd838-445e-48ad-ba88-8fac3b5f8568 req-b2eb5dc8-5ff7-4a17-a906-706c37e848cb service nova] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Updating instance_info_cache with network_info: [{"id": "499cebaa-a6e6-4908-b5c5-1bc2b199b439", "address": "fa:16:3e:57:1b:52", "network": {"id": "d15ab552-8cb5-4ee5-b029-f7149258b103", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-788844379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09abd2ac842143d59109cf7bcccb9dc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499cebaa-a6", "ovs_interfaceid": "499cebaa-a6e6-4908-b5c5-1bc2b199b439", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cd2b09-a122-45c8-b08d-73684c9c2508]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf8a431-32ed-472b-b9e1-b79269de3447]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a06dd838-445e-48ad-ba88-8fac3b5f8568 req-b2eb5dc8-5ff7-4a17-a906-706c37e848cb service nova] Releasing lock "refresh_cache-bc5c2514-d819-4792-afde-dfedc85e8e88" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:44:09 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:44:09 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b3a877-6337-4606-a018-ca17515feaed]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG os_brick.utils [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Updating existing volume attachment record: c0bb6fc2-3748-411b-aa02-f9dd4ac54f2b {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23035386635653835', 'path': '/dev/sdb'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035386635653835', 'path': '/dev/sdb'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG nova.objects.instance [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lazy-loading 'flavor' on Instance uuid f5586645-063f-463f-b03a-16e783b1c2d5 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:44:09 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 02:44:09 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:44:09 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 02:44:09 user nova-compute[75391]:   <target dev="sdc" bus="scsi"/>
Nov 15 02:44:09 user nova-compute[75391]:   <serial>3ec81723-86c4-4a49-b656-763ce2eb96c2</serial>
Nov 15 02:44:09 user nova-compute[75391]:   <address type="drive" controller="0" unit="2"/>
Nov 15 02:44:09 user nova-compute[75391]: </disk>
Nov 15 02:44:09 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:44:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] No BDM found with device name sda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:44:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:44:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:44:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] No VIF found with MAC fa:16:3e:8e:ba:2a, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:44:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sgwDFGfo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:14 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:14 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:14 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5938a153-4b7d-4305-8b8f-8a0af076aa9b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:44:14 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:14 user nova-compute[75391]: INFO nova.virt.block_device [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Attempting to driver detach volume 72a4b3da-f714-4ff5-887c-7e2590b30407 from mountpoint /dev/vdb
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[483440fa-7afc-4197-90f5-91936a73f9cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b] added
Nov 15 02:44:14 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Attempting to detach device vdb from instance 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2 from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:44:14 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:44:14 user nova-compute[75391]:   <source dev="/dev/sdf"/>
Nov 15 02:44:14 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:44:14 user nova-compute[75391]:   <serial>72a4b3da-f714-4ff5-887c-7e2590b30407</serial>
Nov 15 02:44:14 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:44:14 user nova-compute[75391]: </disk>
Nov 15 02:44:14 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:44:14 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Successfully detached device vdb from instance 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2 from the persistent domain config.
Nov 15 02:44:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2 from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:44:14 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:44:14 user nova-compute[75391]:   <source dev="/dev/sdf"/>
Nov 15 02:44:14 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:44:14 user nova-compute[75391]:   <serial>72a4b3da-f714-4ff5-887c-7e2590b30407</serial>
Nov 15 02:44:14 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:44:14 user nova-compute[75391]: </disk>
Nov 15 02:44:14 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f62b98-d260-47fa-9b83-a75d8c8c40cd]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac5c59d-864c-4214-b322-6fcc04e8dfa7]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sgwDFGfo {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sgwDFGfo" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7ce7b4-9eab-4e63-8cea-aff5edd9abdb]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sgwDFGfo'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3081e81-db82-4f8d-991f-f1dab0550ab5]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a341e6-c0a2-4e55-b547-3a86899a3baf]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:14 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:14 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:14 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:14 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:14 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:14 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:14 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:14 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:14 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:14 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cb003b8b-f9a1-4e92-8958-7344f0632e8f tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "f5586645-063f-463f-b03a-16e783b1c2d5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.890s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'brYDTgXO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:14 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[df566198-ac5d-4d96-8147-3e938ae01d39]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b, portal: 172.16.0.220,3260]
Nov 15 02:44:14 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b, portal: 172.16.0.220,3260] successful.
Nov 15 02:44:14 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb918c13-0f43-4d97-891e-4a96ec754233]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b41330e-3e8d-4d9c-951a-b8def6b9abb6]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:14 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:14 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:14 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:14 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:14 user nova-compute[75391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:14 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:14 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:14 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:14 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:14 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:14 user nova-compute[75391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:14 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c18e1f-4a03-4023-8671-a0e04c287430]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sgwDFGfo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2 {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Acquiring lock "f5586645-063f-463f-b03a-16e783b1c2d5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "f5586645-063f-463f-b03a-16e783b1c2d5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:14 user nova-compute[75391]: INFO nova.compute.manager [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Detaching volume 3ec81723-86c4-4a49-b656-763ce2eb96c2
Nov 15 02:44:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BkLIuMEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:14 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:14 user nova-compute[75391]: INFO nova.virt.block_device [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Attempting to driver detach volume 3ec81723-86c4-4a49-b656-763ce2eb96c2 from mountpoint /dev/sdc
Nov 15 02:44:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Attempting to detach device sdc from instance f5586645-063f-463f-b03a-16e783b1c2d5 from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:44:14 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:44:14 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 02:44:14 user nova-compute[75391]:   <target dev="sdc" bus="scsi"/>
Nov 15 02:44:14 user nova-compute[75391]:   <serial>3ec81723-86c4-4a49-b656-763ce2eb96c2</serial>
Nov 15 02:44:14 user nova-compute[75391]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 15 02:44:14 user nova-compute[75391]: </disk>
Nov 15 02:44:14 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:44:14 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Successfully detached device sdc from instance f5586645-063f-463f-b03a-16e783b1c2d5 from the persistent domain config.
Nov 15 02:44:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance f5586645-063f-463f-b03a-16e783b1c2d5 from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 02:44:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:44:14 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:44:14 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 02:44:14 user nova-compute[75391]:   <target dev="sdc" bus="scsi"/>
Nov 15 02:44:14 user nova-compute[75391]:   <serial>3ec81723-86c4-4a49-b656-763ce2eb96c2</serial>
Nov 15 02:44:14 user nova-compute[75391]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 15 02:44:14 user nova-compute[75391]: </disk>
Nov 15 02:44:14 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance f5586645-063f-463f-b03a-16e783b1c2d5 {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23437383761346563', 'path': '/dev/sdg'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437383761346563', 'path': '/dev/sdg'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.118s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:15 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:15 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:15 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG nova.objects.instance [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lazy-loading 'flavor' on Instance uuid 1fc39b27-762e-4bc8-90ba-0215d65710ec {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d0032f-2a66-4fff-a673-d872ff9ec5d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:44:15 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 02:44:15 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:44:15 user nova-compute[75391]:   <source dev="/dev/sdg"/>
Nov 15 02:44:15 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:44:15 user nova-compute[75391]:   <serial>f76e360b-eb5e-47bb-ae1a-9acd86e55d1b</serial>
Nov 15 02:44:15 user nova-compute[75391]: </disk>
Nov 15 02:44:15 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4201b42e-8880-4691-928b-50b2c0933563]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a] added
Nov 15 02:44:15 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0bbfd2-a45d-4d46-b412-1b0376094ce4]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec07dce-501f-4594-9e1c-467fbeaf258b]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v brYDTgXO {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v brYDTgXO" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3d5e7b-f9f0-429c-84a8-a0604513ad15]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'brYDTgXO'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d182a8ff-f699-4711-9242-87ff0eb91fdd]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3499da2a-01aa-42a8-97f1-a338aa004abb]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:15 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:15 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:15 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:15 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:15 user nova-compute[75391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:15 user nova-compute[75391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:15 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:15 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:15 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:15 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:15 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:15 user nova-compute[75391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:15 user nova-compute[75391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:15 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a432b0-5849-4a1f-8d7b-f1d5d615944f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a, portal: 172.16.0.220,3260]
Nov 15 02:44:15 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a, portal: 172.16.0.220,3260] successful.
Nov 15 02:44:15 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8799b5b5-61f5-42a7-a689-84a02ead3db1]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fbe1ec-48b5-4424-ac0a-4b6d9f94a46c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:15 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:15 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:15 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:15 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:15 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:15 user nova-compute[75391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:15 user nova-compute[75391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:15 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:15 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:15 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:15 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:15 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:15 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:15 user nova-compute[75391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:15 user nova-compute[75391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:15 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d752c37-86bb-4fed-8f62-559e8619c9f1]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'brYDTgXO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:44:15 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] No VIF found with MAC fa:16:3e:97:51:45, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:44:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d2fcc842-90b5-48c0-b3f1-94bcc44e20b2 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lock "1fc39b27-762e-4bc8-90ba-0215d65710ec" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.579s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] <== connect_volume: return (2467ms) {'type': 'block', 'scsi_wwn': '26631353438303538', 'path': '/dev/sdi'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631353438303538', 'path': '/dev/sdi'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:44:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.964s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:16 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:16 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:44:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:16 user nova-compute[75391]: DEBUG nova.objects.instance [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lazy-loading 'flavor' on Instance uuid bb472aa5-47dd-48d6-8e9f-e179afd1d8ec {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:44:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:16 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f415ba9a-03ec-4082-b9db-63e3b39f811a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:44:16 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 02:44:16 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:44:16 user nova-compute[75391]:   <source dev="/dev/sdi"/>
Nov 15 02:44:16 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:44:16 user nova-compute[75391]:   <serial>73d0c9f6-98ce-4e4b-8253-20830022185a</serial>
Nov 15 02:44:16 user nova-compute[75391]: </disk>
Nov 15 02:44:16 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:44:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:16 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[919af7c5-99e6-4fe7-a15d-dd437eb97687]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769] added
Nov 15 02:44:16 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:16 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c17f55d-5f83-454d-8889-3001e4a5de3d]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:16 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[42445f9b-7bc8-467b-8613-b75f7589a19e]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BkLIuMEa {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BkLIuMEa" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5a6c67-eb71-4690-8c7d-374df1f23dc9]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BkLIuMEa'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e133eb-a359-4c1c-8b6b-42744e2af6e7]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cade66c-cc1c-4085-b105-d46388fbc910]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:17 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:17 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Acquiring lock "1fc39b27-762e-4bc8-90ba-0215d65710ec" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Lock "1fc39b27-762e-4bc8-90ba-0215d65710ec" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG os_brick.utils [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef99130-8c5a-4a07-8691-077e3a431c30]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769, portal: 172.16.0.220,3260]
Nov 15 02:44:17 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769, portal: 172.16.0.220,3260] successful.
Nov 15 02:44:17 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6808db60-18b1-4784-9a24-76d5642181c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60c15c9-95d4-4c28-87f8-cf1534bf101f]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a963c12-dee3-40ab-84a9-8e0d3c72d00b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[158100ac-40f6-4917-bcab-f9777cf0d8ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[773a5fe2-0ba8-448b-a845-9e5912dd4cbd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:17 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:17 user nova-compute[75391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:17 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f012348f-3815-422b-b564-ffb8452ae04d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc50b942-527b-4876-aab4-4b63cc7b8a67]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BkLIuMEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:44:17 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6255fee6-73e4-46a3-8ace-3cf18aba8093]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG os_brick.utils [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] No BDM found with device name hda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] No VIF found with MAC fa:16:3e:08:66:14, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:44:17 user nova-compute[75391]: INFO nova.compute.manager [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Swapping volume f76e360b-eb5e-47bb-ae1a-9acd86e55d1b for 5c1fa670-5821-477b-947b-717e4f3a25d8
Nov 15 02:44:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4c4652bf-0adf-4869-9cd4-78f55ce0c511 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.579s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:17 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:18 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:18 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] <== connect_volume: return (3378ms) {'type': 'block', 'scsi_wwn': '26337313833373036', 'path': '/dev/sdj'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337313833373036', 'path': '/dev/sdj'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:44:18 user nova-compute[75391]: DEBUG nova.objects.instance [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Lazy-loading 'flavor' on Instance uuid bc5c2514-d819-4792-afde-dfedc85e8e88 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:44:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] attach device xml: <disk type="block" device="disk">
Nov 15 02:44:18 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:44:18 user nova-compute[75391]:   <source dev="/dev/sdj"/>
Nov 15 02:44:18 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:44:18 user nova-compute[75391]:   <serial>4704b25d-7971-4b70-b39b-ce9bfe07f769</serial>
Nov 15 02:44:18 user nova-compute[75391]: </disk>
Nov 15 02:44:18 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:44:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:44:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:44:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] No VIF found with MAC fa:16:3e:57:1b:52, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:44:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c62cb519-72da-474a-be5a-d9fddb429f2a tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Lock "bc5c2514-d819-4792-afde-dfedc85e8e88" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.652s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Acquiring lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:19 user nova-compute[75391]: INFO nova.compute.manager [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Detaching volume 73d0c9f6-98ce-4e4b-8253-20830022185a
Nov 15 02:44:19 user nova-compute[75391]: INFO nova.virt.block_device [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Attempting to driver detach volume 73d0c9f6-98ce-4e4b-8253-20830022185a from mountpoint /dev/vdb
Nov 15 02:44:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Attempting to detach device vdb from instance bb472aa5-47dd-48d6-8e9f-e179afd1d8ec from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:44:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:44:19 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:44:19 user nova-compute[75391]:   <source dev="/dev/sdi"/>
Nov 15 02:44:19 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:44:19 user nova-compute[75391]:   <serial>73d0c9f6-98ce-4e4b-8253-20830022185a</serial>
Nov 15 02:44:19 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 02:44:19 user nova-compute[75391]: </disk>
Nov 15 02:44:19 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:44:19 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Successfully detached device vdb from instance bb472aa5-47dd-48d6-8e9f-e179afd1d8ec from the persistent domain config.
Nov 15 02:44:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb472aa5-47dd-48d6-8e9f-e179afd1d8ec from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 02:44:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:44:19 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:44:19 user nova-compute[75391]:   <source dev="/dev/sdi"/>
Nov 15 02:44:19 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:44:19 user nova-compute[75391]:   <serial>73d0c9f6-98ce-4e4b-8253-20830022185a</serial>
Nov 15 02:44:19 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 02:44:19 user nova-compute[75391]: </disk>
Nov 15 02:44:19 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:44:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb472aa5-47dd-48d6-8e9f-e179afd1d8ec {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 02:44:20 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-7c0788de-9c1c-4755-88d5-f7505d5cd100 tempest-VolumesAssistedSnapshotsTest-87598544 tempest-VolumesAssistedSnapshotsTest-87598544-project] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] volume_snapshot_create: create_info: {'snapshot_id': 'f7f52d81-af94-416a-8a56-0ea467180db3', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75391) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 15 02:44:20 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-7c0788de-9c1c-4755-88d5-f7505d5cd100 tempest-VolumesAssistedSnapshotsTest-87598544 tempest-VolumesAssistedSnapshotsTest-87598544-project] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] snap xml: <domainsnapshot>
Nov 15 02:44:20 user nova-compute[75391]:   <disks>
Nov 15 02:44:20 user nova-compute[75391]:     <disk name="/dev/sdj" snapshot="external" type="file">
Nov 15 02:44:20 user nova-compute[75391]:       <source file="/dev/new_file"/>
Nov 15 02:44:20 user nova-compute[75391]:     </disk>
Nov 15 02:44:20 user nova-compute[75391]:     <disk name="vda" snapshot="no"/>
Nov 15 02:44:20 user nova-compute[75391]:   </disks>
Nov 15 02:44:20 user nova-compute[75391]: </domainsnapshot>
Nov 15 02:44:20 user nova-compute[75391]:  {{(pid=75391) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 15 02:44:20 user nova-compute[75391]: DEBUG nova.objects.instance [None req-7c0788de-9c1c-4755-88d5-f7505d5cd100 tempest-VolumesAssistedSnapshotsTest-87598544 tempest-VolumesAssistedSnapshotsTest-87598544-project] Lazy-loading 'system_metadata' on Instance uuid bc5c2514-d819-4792-afde-dfedc85e8e88 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:44:20 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-7c0788de-9c1c-4755-88d5-f7505d5cd100 tempest-VolumesAssistedSnapshotsTest-87598544 tempest-VolumesAssistedSnapshotsTest-87598544-project] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [None req-7c0788de-9c1c-4755-88d5-f7505d5cd100 tempest-VolumesAssistedSnapshotsTest-87598544 tempest-VolumesAssistedSnapshotsTest-87598544-project] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Traceback (most recent call last):
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]     rv = execute(f, *args, **kwargs)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]     six.reraise(c, e, tb)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]     raise value
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]     rv = meth(*args, **kwargs)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] 
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [None req-7c0788de-9c1c-4755-88d5-f7505d5cd100 tempest-VolumesAssistedSnapshotsTest-87598544 tempest-VolumesAssistedSnapshotsTest-87598544-project] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Traceback (most recent call last):
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]     self._volume_snapshot_create(context, instance, guest,
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]     rv = execute(f, *args, **kwargs)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]     six.reraise(c, e, tb)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]     raise value
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]     rv = meth(*args, **kwargs)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] 
Nov 15 02:44:20 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-68c6ed0e-fb8b-4add-8f50-0adf5c01b14d tempest-VolumesAssistedSnapshotsTest-87598544 tempest-VolumesAssistedSnapshotsTest-87598544-project] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] volume_snapshot_delete: delete_info: {'volume_id': '4704b25d-7971-4b70-b39b-ce9bfe07f769'} {{(pid=75391) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [None req-68c6ed0e-fb8b-4add-8f50-0adf5c01b14d tempest-VolumesAssistedSnapshotsTest-87598544 tempest-VolumesAssistedSnapshotsTest-87598544-project] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Traceback (most recent call last):
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88]     if delete_info['type'] != 'qcow2':
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] KeyError: 'type'
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] 
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [None req-7c0788de-9c1c-4755-88d5-f7505d5cd100 tempest-VolumesAssistedSnapshotsTest-87598544 tempest-VolumesAssistedSnapshotsTest-87598544-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot f7f52d81-af94-416a-8a56-0ea467180db3 could not be found.
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     raise value
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver 
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver 
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot f7f52d81-af94-416a-8a56-0ea467180db3 could not be found. (HTTP 404) (Request-ID: req-e91f6eea-2fb5-469e-9c58-cc52e0bf74bf)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver 
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver 
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot f7f52d81-af94-416a-8a56-0ea467180db3 could not be found.
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver 
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server [None req-7c0788de-9c1c-4755-88d5-f7505d5cd100 tempest-VolumesAssistedSnapshotsTest-87598544 tempest-VolumesAssistedSnapshotsTest-87598544-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     raise value
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server 
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver [None req-68c6ed0e-fb8b-4add-8f50-0adf5c01b14d tempest-VolumesAssistedSnapshotsTest-87598544 tempest-VolumesAssistedSnapshotsTest-87598544-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver 
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver 
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-0b71309a-5840-437d-933c-55fd527e4319)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver 
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver 
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 15 02:44:20 user nova-compute[75391]: ERROR nova.virt.libvirt.driver 
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server [None req-68c6ed0e-fb8b-4add-8f50-0adf5c01b14d tempest-VolumesAssistedSnapshotsTest-87598544 tempest-VolumesAssistedSnapshotsTest-87598544-project] Exception during message handling: KeyError: 'type'
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 15 02:44:20 user nova-compute[75391]: ERROR oslo_messaging.rpc.server 
Nov 15 02:44:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Acquiring lock "bc5c2514-d819-4792-afde-dfedc85e8e88" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Lock "bc5c2514-d819-4792-afde-dfedc85e8e88" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:20 user nova-compute[75391]: INFO nova.compute.manager [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Detaching volume 4704b25d-7971-4b70-b39b-ce9bfe07f769
Nov 15 02:44:20 user nova-compute[75391]: INFO nova.virt.block_device [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Attempting to driver detach volume 4704b25d-7971-4b70-b39b-ce9bfe07f769 from mountpoint /dev/vdb
Nov 15 02:44:20 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Attempting to detach device vdb from instance bc5c2514-d819-4792-afde-dfedc85e8e88 from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:44:20 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] detach device xml: <disk type="block" device="disk">
Nov 15 02:44:20 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:44:20 user nova-compute[75391]:   <source dev="/dev/sdj"/>
Nov 15 02:44:20 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:44:20 user nova-compute[75391]:   <serial>4704b25d-7971-4b70-b39b-ce9bfe07f769</serial>
Nov 15 02:44:20 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:44:20 user nova-compute[75391]: </disk>
Nov 15 02:44:20 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:44:20 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Successfully detached device vdb from instance bc5c2514-d819-4792-afde-dfedc85e8e88 from the persistent domain config.
Nov 15 02:44:20 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bc5c2514-d819-4792-afde-dfedc85e8e88 from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 02:44:20 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] detach device xml: <disk type="block" device="disk">
Nov 15 02:44:20 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:44:20 user nova-compute[75391]:   <source dev="/dev/sdj"/>
Nov 15 02:44:20 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:44:20 user nova-compute[75391]:   <serial>4704b25d-7971-4b70-b39b-ce9bfe07f769</serial>
Nov 15 02:44:20 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:44:20 user nova-compute[75391]: </disk>
Nov 15 02:44:20 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:44:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:20 user nova-compute[75391]: DEBUG nova.compute.manager [req-6f30fb4b-0db2-43d3-ada1-1d33af4fa13f req-704d4e86-bc77-4d41-a8f7-9c3b30c66588 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-changed-dea6d9d9-b176-440e-9589-d8d8def6471d {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:20 user nova-compute[75391]: DEBUG nova.compute.manager [req-6f30fb4b-0db2-43d3-ada1-1d33af4fa13f req-704d4e86-bc77-4d41-a8f7-9c3b30c66588 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Refreshing instance network info cache due to event network-changed-dea6d9d9-b176-440e-9589-d8d8def6471d. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:44:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6f30fb4b-0db2-43d3-ada1-1d33af4fa13f req-704d4e86-bc77-4d41-a8f7-9c3b30c66588 service nova] Acquiring lock "refresh_cache-2fb1dc69-6781-4a4f-a43f-9165d6dae447" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:44:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6f30fb4b-0db2-43d3-ada1-1d33af4fa13f req-704d4e86-bc77-4d41-a8f7-9c3b30c66588 service nova] Acquired lock "refresh_cache-2fb1dc69-6781-4a4f-a43f-9165d6dae447" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:44:20 user nova-compute[75391]: DEBUG nova.network.neutron [req-6f30fb4b-0db2-43d3-ada1-1d33af4fa13f req-704d4e86-bc77-4d41-a8f7-9c3b30c66588 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Refreshing network info cache for port dea6d9d9-b176-440e-9589-d8d8def6471d {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:44:21 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bc5c2514-d819-4792-afde-dfedc85e8e88 {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 02:44:21 user nova-compute[75391]: DEBUG nova.network.neutron [req-6f30fb4b-0db2-43d3-ada1-1d33af4fa13f req-704d4e86-bc77-4d41-a8f7-9c3b30c66588 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Updated VIF entry in instance network info cache for port dea6d9d9-b176-440e-9589-d8d8def6471d. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:44:21 user nova-compute[75391]: DEBUG nova.network.neutron [req-6f30fb4b-0db2-43d3-ada1-1d33af4fa13f req-704d4e86-bc77-4d41-a8f7-9c3b30c66588 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Updating instance_info_cache with network_info: [{"id": "dea6d9d9-b176-440e-9589-d8d8def6471d", "address": "fa:16:3e:9f:29:46", "network": {"id": "e1a8c17d-9960-4500-9f24-e3a447dba928", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-521564942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea6d9d9-b1", "ovs_interfaceid": "dea6d9d9-b176-440e-9589-d8d8def6471d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f659917-6ad3-4ccc-ac49-622470b330aa", "address": "fa:16:3e:16:a3:74", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f659917-6a", "ovs_interfaceid": "7f659917-6ad3-4ccc-ac49-622470b330aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51356594-af31-476d-a34b-697c80f519c8", "address": "fa:16:3e:45:1b:c0", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51356594-af", "ovs_interfaceid": "51356594-af31-476d-a34b-697c80f519c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2100ab6d-db20-43a9-ba96-d9630430c14f", "address": "fa:16:3e:3e:62:83", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2100ab6d-db", "ovs_interfaceid": "2100ab6d-db20-43a9-ba96-d9630430c14f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a60510f0-b568-4276-914e-3c8cd49eafe5", "address": "fa:16:3e:5d:21:af", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa60510f0-b5", "ovs_interfaceid": "a60510f0-b568-4276-914e-3c8cd49eafe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9425c66c-2e1e-43e3-b611-70477c102b95", "address": "fa:16:3e:fb:32:26", "network": {"id": "594b2a44-0933-4ecd-ae26-5fd6f9582d15", "bridge": "br-int", "label": "tempest-device-tagging-net2-996422155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9425c66c-2e", "ovs_interfaceid": "9425c66c-2e1e-43e3-b611-70477c102b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2725a77-bc15-423e-9795-49c2647a2d82", "address": "fa:16:3e:ca:82:17", "network": {"id": "594b2a44-0933-4ecd-ae26-5fd6f9582d15", "bridge": "br-int", "label": "tempest-device-tagging-net2-996422155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2725a77-bc", "ovs_interfaceid": "c2725a77-bc15-423e-9795-49c2647a2d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:44:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6f30fb4b-0db2-43d3-ada1-1d33af4fa13f req-704d4e86-bc77-4d41-a8f7-9c3b30c66588 service nova] Releasing lock "refresh_cache-2fb1dc69-6781-4a4f-a43f-9165d6dae447" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:44:22 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:23 user nova-compute[75391]: INFO nova.compute.manager [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Terminating instance
Nov 15 02:44:23 user nova-compute[75391]: DEBUG nova.compute.manager [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG nova.compute.manager [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NkKUSbzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1fc39b27-762e-4bc8-90ba-0215d65710ec', 'attached_at': '', 'detached_at': '', 'volume_id': '5c1fa670-5821-477b-947b-717e4f3a25d8', 'serial': '5c1fa670-5821-477b-947b-717e4f3a25d8'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sgwDFGfo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '1fc39b27-762e-4bc8-90ba-0215d65710ec', 'attached_at': '', 'detached_at': '', 'volume_id': 'f76e360b-eb5e-47bb-ae1a-9acd86e55d1b', 'serial'} {{(pid=75391) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NkKUSbzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:23 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:23 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:23 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:44:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc473a1-7dae-40d2-9bad-77f16b8128e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:44:23 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd69ec6-2a67-45a1-9272-e2061e26182d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8] added
Nov 15 02:44:23 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[97336d80-fdbc-49a8-a55b-d2cfc322ba58]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1eb0396-6430-4141-aec1-27bcb3074835]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NkKUSbzI {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NkKUSbzI" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[42901da3-1e40-44da-bfd0-f1db7ceafff2]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NkKUSbzI'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee7ad9b-a6c1-44a1-bea2-04a3f746e065]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bfa936-8b9e-47d7-a66f-e920a1cbbf1f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:23 user nova-compute[75391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:23 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:23 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:23 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:23 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:23 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:23 user nova-compute[75391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:23 user nova-compute[75391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:23 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:23 user nova-compute[75391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:23 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:23 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:23 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:23 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:23 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:23 user nova-compute[75391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:23 user nova-compute[75391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:23 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG nova.compute.manager [req-c5988bdb-9f30-4e5b-9610-03f59d8654f0 req-2e4ac6bf-ce44-453d-9d39-0375036702a4 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-unplugged-dea6d9d9-b176-440e-9589-d8d8def6471d {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c5988bdb-9f30-4e5b-9610-03f59d8654f0 req-2e4ac6bf-ce44-453d-9d39-0375036702a4 service nova] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c5988bdb-9f30-4e5b-9610-03f59d8654f0 req-2e4ac6bf-ce44-453d-9d39-0375036702a4 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c5988bdb-9f30-4e5b-9610-03f59d8654f0 req-2e4ac6bf-ce44-453d-9d39-0375036702a4 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG nova.compute.manager [req-c5988bdb-9f30-4e5b-9610-03f59d8654f0 req-2e4ac6bf-ce44-453d-9d39-0375036702a4 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] No waiting events found dispatching network-vif-unplugged-dea6d9d9-b176-440e-9589-d8d8def6471d {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG nova.compute.manager [req-c5988bdb-9f30-4e5b-9610-03f59d8654f0 req-2e4ac6bf-ce44-453d-9d39-0375036702a4 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-unplugged-dea6d9d9-b176-440e-9589-d8d8def6471d for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76a637b-c651-4cf7-869d-7afe91ae5a16]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8, portal: 172.16.0.220,3260]
Nov 15 02:44:24 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8, portal: 172.16.0.220,3260] successful.
Nov 15 02:44:24 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[20be7c40-a943-48e3-8317-89e73660aa10]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG nova.compute.manager [req-084304ef-4cfd-4917-9b1b-eb0788116a56 req-0429f8ab-a432-4b84-9722-40459630af92 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-unplugged-7f659917-6ad3-4ccc-ac49-622470b330aa {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-084304ef-4cfd-4917-9b1b-eb0788116a56 req-0429f8ab-a432-4b84-9722-40459630af92 service nova] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-084304ef-4cfd-4917-9b1b-eb0788116a56 req-0429f8ab-a432-4b84-9722-40459630af92 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-084304ef-4cfd-4917-9b1b-eb0788116a56 req-0429f8ab-a432-4b84-9722-40459630af92 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG nova.compute.manager [req-084304ef-4cfd-4917-9b1b-eb0788116a56 req-0429f8ab-a432-4b84-9722-40459630af92 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] No waiting events found dispatching network-vif-unplugged-7f659917-6ad3-4ccc-ac49-622470b330aa {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG nova.compute.manager [req-084304ef-4cfd-4917-9b1b-eb0788116a56 req-0429f8ab-a432-4b84-9722-40459630af92 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-unplugged-7f659917-6ad3-4ccc-ac49-622470b330aa for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cfafdf-4157-4c8f-9152-feff17206db8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:24 user nova-compute[75391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:24 user nova-compute[75391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)
Nov 15 02:44:24 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:24 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:24 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:24 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:24 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:24 user nova-compute[75391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:24 user nova-compute[75391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:24 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:24 user nova-compute[75391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:24 user nova-compute[75391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)
Nov 15 02:44:24 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:24 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:24 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:24 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:24 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:24 user nova-compute[75391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:24 user nova-compute[75391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:24 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae89ba9-67d3-4edf-89fa-689037073587]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: None {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG nova.compute.manager [req-c182c56f-aa12-485d-9e71-3903ad54caf1 req-383937b6-7901-48a3-a389-ecabfc8edbf0 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-unplugged-a60510f0-b568-4276-914e-3c8cd49eafe5 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c182c56f-aa12-485d-9e71-3903ad54caf1 req-383937b6-7901-48a3-a389-ecabfc8edbf0 service nova] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c182c56f-aa12-485d-9e71-3903ad54caf1 req-383937b6-7901-48a3-a389-ecabfc8edbf0 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c182c56f-aa12-485d-9e71-3903ad54caf1 req-383937b6-7901-48a3-a389-ecabfc8edbf0 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG nova.compute.manager [req-c182c56f-aa12-485d-9e71-3903ad54caf1 req-383937b6-7901-48a3-a389-ecabfc8edbf0 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] No waiting events found dispatching network-vif-unplugged-a60510f0-b568-4276-914e-3c8cd49eafe5 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG nova.compute.manager [req-c182c56f-aa12-485d-9e71-3903ad54caf1 req-383937b6-7901-48a3-a389-ecabfc8edbf0 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-unplugged-a60510f0-b568-4276-914e-3c8cd49eafe5 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NkKUSbzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '23635633437373833', 'path': '/dev/sdk'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635633437373833', 'path': '/dev/sdk'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG nova.objects.instance [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Lazy-loading 'flavor' on Instance uuid 1fc39b27-762e-4bc8-90ba-0215d65710ec {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:44:25 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Instance destroyed successfully.
Nov 15 02:44:25 user nova-compute[75391]: DEBUG nova.objects.instance [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lazy-loading 'resources' on Instance uuid 2fb1dc69-6781-4a4f-a43f-9165d6dae447 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1018077259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1018077259',id=10,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFxBIJtMc6rdEEE5PmtCZZuasEZKTJPyJbYNRf7xKiToeZC5XJLYc37PvHDM4IIDRTo34kL9xnqrJnk7+ChGOAisKWVRibv9MKp3KSbdcqN5xajEODL2a30tQyo5fQiug==',key_name='tempest-keypair-58485789',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:43:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1286381f6f484f8ca35024e8386f5c03',ramdisk_id='',reservation_id='r-iiwbby7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1936342241',owner_user_name='tempest-TaggedBootDevicesTest-1936342241-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:43:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bada9568d8784e109d917376e03afeb9',uuid=2fb1dc69-6781-4a4f-a43f-9165d6dae447,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dea6d9d9-b176-440e-9589-d8d8def6471d", "address": "fa:16:3e:9f:29:46", "network": {"id": "e1a8c17d-9960-4500-9f24-e3a447dba928", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-521564942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea6d9d9-b1", "ovs_interfaceid": "dea6d9d9-b176-440e-9589-d8d8def6471d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converting VIF {"id": "dea6d9d9-b176-440e-9589-d8d8def6471d", "address": "fa:16:3e:9f:29:46", "network": {"id": "e1a8c17d-9960-4500-9f24-e3a447dba928", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-521564942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea6d9d9-b1", "ovs_interfaceid": "dea6d9d9-b176-440e-9589-d8d8def6471d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:29:46,bridge_name='br-int',has_traffic_filtering=True,id=dea6d9d9-b176-440e-9589-d8d8def6471d,network=Network(e1a8c17d-9960-4500-9f24-e3a447dba928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdea6d9d9-b1') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG os_vif [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:29:46,bridge_name='br-int',has_traffic_filtering=True,id=dea6d9d9-b176-440e-9589-d8d8def6471d,network=Network(e1a8c17d-9960-4500-9f24-e3a447dba928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdea6d9d9-b1') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdea6d9d9-b1, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6266386d-7875-46ad-8635-f3197879ecf0) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:25 user nova-compute[75391]: INFO os_vif [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:29:46,bridge_name='br-int',has_traffic_filtering=True,id=dea6d9d9-b176-440e-9589-d8d8def6471d,network=Network(e1a8c17d-9960-4500-9f24-e3a447dba928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdea6d9d9-b1')
Nov 15 02:44:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1018077259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1018077259',id=10,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFxBIJtMc6rdEEE5PmtCZZuasEZKTJPyJbYNRf7xKiToeZC5XJLYc37PvHDM4IIDRTo34kL9xnqrJnk7+ChGOAisKWVRibv9MKp3KSbdcqN5xajEODL2a30tQyo5fQiug==',key_name='tempest-keypair-58485789',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:43:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1286381f6f484f8ca35024e8386f5c03',ramdisk_id='',reservation_id='r-iiwbby7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1936342241',owner_user_name='tempest-TaggedBootDevicesTest-1936342241-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:43:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bada9568d8784e109d917376e03afeb9',uuid=2fb1dc69-6781-4a4f-a43f-9165d6dae447,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f659917-6ad3-4ccc-ac49-622470b330aa", "address": "fa:16:3e:16:a3:74", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f659917-6a", "ovs_interfaceid": "7f659917-6ad3-4ccc-ac49-622470b330aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converting VIF {"id": "7f659917-6ad3-4ccc-ac49-622470b330aa", "address": "fa:16:3e:16:a3:74", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f659917-6a", "ovs_interfaceid": "7f659917-6ad3-4ccc-ac49-622470b330aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:a3:74,bridge_name='br-int',has_traffic_filtering=True,id=7f659917-6ad3-4ccc-ac49-622470b330aa,network=Network(477acc99-8e84-4441-96c4-fddf8a5b5a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f659917-6a') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG os_vif [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a3:74,bridge_name='br-int',has_traffic_filtering=True,id=7f659917-6ad3-4ccc-ac49-622470b330aa,network=Network(477acc99-8e84-4441-96c4-fddf8a5b5a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f659917-6a') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f659917-6a, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e974c703-41f6-4fa8-8e00-6c932a7d46a1) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:25 user nova-compute[75391]: INFO os_vif [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a3:74,bridge_name='br-int',has_traffic_filtering=True,id=7f659917-6ad3-4ccc-ac49-622470b330aa,network=Network(477acc99-8e84-4441-96c4-fddf8a5b5a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f659917-6a')
Nov 15 02:44:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1018077259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1018077259',id=10,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFxBIJtMc6rdEEE5PmtCZZuasEZKTJPyJbYNRf7xKiToeZC5XJLYc37PvHDM4IIDRTo34kL9xnqrJnk7+ChGOAisKWVRibv9MKp3KSbdcqN5xajEODL2a30tQyo5fQiug==',key_name='tempest-keypair-58485789',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:43:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1286381f6f484f8ca35024e8386f5c03',ramdisk_id='',reservation_id='r-iiwbby7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1936342241',owner_user_name='tempest-TaggedBootDevicesTest-1936342241-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:43:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bada9568d8784e109d917376e03afeb9',uuid=2fb1dc69-6781-4a4f-a43f-9165d6dae447,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51356594-af31-476d-a34b-697c80f519c8", "address": "fa:16:3e:45:1b:c0", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51356594-af", "ovs_interfaceid": "51356594-af31-476d-a34b-697c80f519c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converting VIF {"id": "51356594-af31-476d-a34b-697c80f519c8", "address": "fa:16:3e:45:1b:c0", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51356594-af", "ovs_interfaceid": "51356594-af31-476d-a34b-697c80f519c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:1b:c0,bridge_name='br-int',has_traffic_filtering=True,id=51356594-af31-476d-a34b-697c80f519c8,network=Network(477acc99-8e84-4441-96c4-fddf8a5b5a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51356594-af') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:44:25 user nova-compute[75391]: DEBUG os_vif [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:1b:c0,bridge_name='br-int',has_traffic_filtering=True,id=51356594-af31-476d-a34b-697c80f519c8,network=Network(477acc99-8e84-4441-96c4-fddf8a5b5a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51356594-af') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51356594-af, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e63a33d0-4f05-40d6-b38b-c33f13f94dc5) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-5de9b3a5-be34-476b-ac3a-cce85915716f req-d8c4421e-c70b-441c-b438-42514a99efa2 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-plugged-dea6d9d9-b176-440e-9589-d8d8def6471d {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5de9b3a5-be34-476b-ac3a-cce85915716f req-d8c4421e-c70b-441c-b438-42514a99efa2 service nova] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5de9b3a5-be34-476b-ac3a-cce85915716f req-d8c4421e-c70b-441c-b438-42514a99efa2 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5de9b3a5-be34-476b-ac3a-cce85915716f req-d8c4421e-c70b-441c-b438-42514a99efa2 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-5de9b3a5-be34-476b-ac3a-cce85915716f req-d8c4421e-c70b-441c-b438-42514a99efa2 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] No waiting events found dispatching network-vif-plugged-dea6d9d9-b176-440e-9589-d8d8def6471d {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:44:26 user nova-compute[75391]: WARNING nova.compute.manager [req-5de9b3a5-be34-476b-ac3a-cce85915716f req-d8c4421e-c70b-441c-b438-42514a99efa2 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received unexpected event network-vif-plugged-dea6d9d9-b176-440e-9589-d8d8def6471d for instance with vm_state active and task_state deleting.
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: INFO os_vif [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:1b:c0,bridge_name='br-int',has_traffic_filtering=True,id=51356594-af31-476d-a34b-697c80f519c8,network=Network(477acc99-8e84-4441-96c4-fddf8a5b5a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51356594-af')
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1018077259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1018077259',id=10,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFxBIJtMc6rdEEE5PmtCZZuasEZKTJPyJbYNRf7xKiToeZC5XJLYc37PvHDM4IIDRTo34kL9xnqrJnk7+ChGOAisKWVRibv9MKp3KSbdcqN5xajEODL2a30tQyo5fQiug==',key_name='tempest-keypair-58485789',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:43:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1286381f6f484f8ca35024e8386f5c03',ramdisk_id='',reservation_id='r-iiwbby7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1936342241',owner_user_name='tempest-TaggedBootDevicesTest-1936342241-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:43:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bada9568d8784e109d917376e03afeb9',uuid=2fb1dc69-6781-4a4f-a43f-9165d6dae447,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2100ab6d-db20-43a9-ba96-d9630430c14f", "address": "fa:16:3e:3e:62:83", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2100ab6d-db", "ovs_interfaceid": "2100ab6d-db20-43a9-ba96-d9630430c14f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converting VIF {"id": "2100ab6d-db20-43a9-ba96-d9630430c14f", "address": "fa:16:3e:3e:62:83", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2100ab6d-db", "ovs_interfaceid": "2100ab6d-db20-43a9-ba96-d9630430c14f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:62:83,bridge_name='br-int',has_traffic_filtering=True,id=2100ab6d-db20-43a9-ba96-d9630430c14f,network=Network(477acc99-8e84-4441-96c4-fddf8a5b5a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2100ab6d-db') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG os_vif [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:62:83,bridge_name='br-int',has_traffic_filtering=True,id=2100ab6d-db20-43a9-ba96-d9630430c14f,network=Network(477acc99-8e84-4441-96c4-fddf8a5b5a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2100ab6d-db') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2100ab6d-db, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] COPY block job progress, current cursor: 112197632 final cursor: 1073741824 {{(pid=75391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 req-34b970f1-9615-4f94-b297-34ce92bf34df service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Received event volume-reimaged-7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 req-34b970f1-9615-4f94-b297-34ce92bf34df service nova] Acquiring lock "60093cdf-015e-4c39-a514-1818a6e55385-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 req-34b970f1-9615-4f94-b297-34ce92bf34df service nova] Lock "60093cdf-015e-4c39-a514-1818a6e55385-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 req-34b970f1-9615-4f94-b297-34ce92bf34df service nova] Lock "60093cdf-015e-4c39-a514-1818a6e55385-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 req-34b970f1-9615-4f94-b297-34ce92bf34df service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Processing event volume-reimaged-7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Instance event wait completed in 16 seconds for volume-reimaged {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aeb3f525-046e-4491-a6f9-a101368b0e85) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-plugged-7f659917-6ad3-4ccc-ac49-622470b330aa {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] No waiting events found dispatching network-vif-plugged-7f659917-6ad3-4ccc-ac49-622470b330aa {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:44:26 user nova-compute[75391]: WARNING nova.compute.manager [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received unexpected event network-vif-plugged-7f659917-6ad3-4ccc-ac49-622470b330aa for instance with vm_state active and task_state deleting.
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-unplugged-51356594-af31-476d-a34b-697c80f519c8 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] No waiting events found dispatching network-vif-unplugged-51356594-af31-476d-a34b-697c80f519c8 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-unplugged-51356594-af31-476d-a34b-697c80f519c8 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-plugged-51356594-af31-476d-a34b-697c80f519c8 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] No waiting events found dispatching network-vif-plugged-51356594-af31-476d-a34b-697c80f519c8 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:44:26 user nova-compute[75391]: WARNING nova.compute.manager [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received unexpected event network-vif-plugged-51356594-af31-476d-a34b-697c80f519c8 for instance with vm_state active and task_state deleting.
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-unplugged-2100ab6d-db20-43a9-ba96-d9630430c14f {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] No waiting events found dispatching network-vif-unplugged-2100ab6d-db20-43a9-ba96-d9630430c14f {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-unplugged-2100ab6d-db20-43a9-ba96-d9630430c14f for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-plugged-2100ab6d-db20-43a9-ba96-d9630430c14f {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] No waiting events found dispatching network-vif-plugged-2100ab6d-db20-43a9-ba96-d9630430c14f {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:44:26 user nova-compute[75391]: WARNING nova.compute.manager [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received unexpected event network-vif-plugged-2100ab6d-db20-43a9-ba96-d9630430c14f for instance with vm_state active and task_state deleting.
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-unplugged-9425c66c-2e1e-43e3-b611-70477c102b95 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] No waiting events found dispatching network-vif-unplugged-9425c66c-2e1e-43e3-b611-70477c102b95 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-unplugged-9425c66c-2e1e-43e3-b611-70477c102b95 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-plugged-9425c66c-2e1e-43e3-b611-70477c102b95 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] No waiting events found dispatching network-vif-plugged-9425c66c-2e1e-43e3-b611-70477c102b95 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:44:26 user nova-compute[75391]: WARNING nova.compute.manager [req-6f66e449-abe9-4f56-a827-e45909fd25e2 req-6914730c-e773-47d2-a36b-23592fd79749 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received unexpected event network-vif-plugged-9425c66c-2e1e-43e3-b611-70477c102b95 for instance with vm_state active and task_state deleting.
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: INFO nova.virt.block_device [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Booting with volume 7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 at /dev/vda
Nov 15 02:44:26 user nova-compute[75391]: INFO os_vif [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:62:83,bridge_name='br-int',has_traffic_filtering=True,id=2100ab6d-db20-43a9-ba96-d9630430c14f,network=Network(477acc99-8e84-4441-96c4-fddf8a5b5a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2100ab6d-db')
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1018077259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1018077259',id=10,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFxBIJtMc6rdEEE5PmtCZZuasEZKTJPyJbYNRf7xKiToeZC5XJLYc37PvHDM4IIDRTo34kL9xnqrJnk7+ChGOAisKWVRibv9MKp3KSbdcqN5xajEODL2a30tQyo5fQiug==',key_name='tempest-keypair-58485789',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:43:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1286381f6f484f8ca35024e8386f5c03',ramdisk_id='',reservation_id='r-iiwbby7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1936342241',owner_user_name='tempest-TaggedBootDevicesTest-1936342241-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:43:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bada9568d8784e109d917376e03afeb9',uuid=2fb1dc69-6781-4a4f-a43f-9165d6dae447,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a60510f0-b568-4276-914e-3c8cd49eafe5", "address": "fa:16:3e:5d:21:af", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa60510f0-b5", "ovs_interfaceid": "a60510f0-b568-4276-914e-3c8cd49eafe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converting VIF {"id": "a60510f0-b568-4276-914e-3c8cd49eafe5", "address": "fa:16:3e:5d:21:af", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa60510f0-b5", "ovs_interfaceid": "a60510f0-b568-4276-914e-3c8cd49eafe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:21:af,bridge_name='br-int',has_traffic_filtering=True,id=a60510f0-b568-4276-914e-3c8cd49eafe5,network=Network(477acc99-8e84-4441-96c4-fddf8a5b5a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa60510f0-b5') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG os_vif [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:21:af,bridge_name='br-int',has_traffic_filtering=True,id=a60510f0-b568-4276-914e-3c8cd49eafe5,network=Network(477acc99-8e84-4441-96c4-fddf8a5b5a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa60510f0-b5') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa60510f0-b5, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1f0cc48-a838-4a18-b579-4db0c1872ead) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: INFO os_vif [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:21:af,bridge_name='br-int',has_traffic_filtering=True,id=a60510f0-b568-4276-914e-3c8cd49eafe5,network=Network(477acc99-8e84-4441-96c4-fddf8a5b5a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa60510f0-b5')
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1018077259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1018077259',id=10,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFxBIJtMc6rdEEE5PmtCZZuasEZKTJPyJbYNRf7xKiToeZC5XJLYc37PvHDM4IIDRTo34kL9xnqrJnk7+ChGOAisKWVRibv9MKp3KSbdcqN5xajEODL2a30tQyo5fQiug==',key_name='tempest-keypair-58485789',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:43:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1286381f6f484f8ca35024e8386f5c03',ramdisk_id='',reservation_id='r-iiwbby7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1936342241',owner_user_name='tempest-TaggedBootDevicesTest-1936342241-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:43:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bada9568d8784e109d917376e03afeb9',uuid=2fb1dc69-6781-4a4f-a43f-9165d6dae447,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9425c66c-2e1e-43e3-b611-70477c102b95", "address": "fa:16:3e:fb:32:26", "network": {"id": "594b2a44-0933-4ecd-ae26-5fd6f9582d15", "bridge": "br-int", "label": "tempest-device-tagging-net2-996422155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9425c66c-2e", "ovs_interfaceid": "9425c66c-2e1e-43e3-b611-70477c102b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converting VIF {"id": "9425c66c-2e1e-43e3-b611-70477c102b95", "address": "fa:16:3e:fb:32:26", "network": {"id": "594b2a44-0933-4ecd-ae26-5fd6f9582d15", "bridge": "br-int", "label": "tempest-device-tagging-net2-996422155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9425c66c-2e", "ovs_interfaceid": "9425c66c-2e1e-43e3-b611-70477c102b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:32:26,bridge_name='br-int',has_traffic_filtering=True,id=9425c66c-2e1e-43e3-b611-70477c102b95,network=Network(594b2a44-0933-4ecd-ae26-5fd6f9582d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9425c66c-2e') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG os_vif [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:32:26,bridge_name='br-int',has_traffic_filtering=True,id=9425c66c-2e1e-43e3-b611-70477c102b95,network=Network(594b2a44-0933-4ecd-ae26-5fd6f9582d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9425c66c-2e') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9425c66c-2e, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG os_brick.utils [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=078526d1-1083-41c6-86ee-56790c24dfd2) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab4440d-552d-425d-9491-318af45ea2f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: INFO os_vif [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:32:26,bridge_name='br-int',has_traffic_filtering=True,id=9425c66c-2e1e-43e3-b611-70477c102b95,network=Network(594b2a44-0933-4ecd-ae26-5fd6f9582d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9425c66c-2e')
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1018077259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1018077259',id=10,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFxBIJtMc6rdEEE5PmtCZZuasEZKTJPyJbYNRf7xKiToeZC5XJLYc37PvHDM4IIDRTo34kL9xnqrJnk7+ChGOAisKWVRibv9MKp3KSbdcqN5xajEODL2a30tQyo5fQiug==',key_name='tempest-keypair-58485789',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:43:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1286381f6f484f8ca35024e8386f5c03',ramdisk_id='',reservation_id='r-iiwbby7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1936342241',owner_user_name='tempest-TaggedBootDevicesTest-1936342241-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:43:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bada9568d8784e109d917376e03afeb9',uuid=2fb1dc69-6781-4a4f-a43f-9165d6dae447,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2725a77-bc15-423e-9795-49c2647a2d82", "address": "fa:16:3e:ca:82:17", "network": {"id": "594b2a44-0933-4ecd-ae26-5fd6f9582d15", "bridge": "br-int", "label": "tempest-device-tagging-net2-996422155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2725a77-bc", "ovs_interfaceid": "c2725a77-bc15-423e-9795-49c2647a2d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converting VIF {"id": "c2725a77-bc15-423e-9795-49c2647a2d82", "address": "fa:16:3e:ca:82:17", "network": {"id": "594b2a44-0933-4ecd-ae26-5fd6f9582d15", "bridge": "br-int", "label": "tempest-device-tagging-net2-996422155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2725a77-bc", "ovs_interfaceid": "c2725a77-bc15-423e-9795-49c2647a2d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:82:17,bridge_name='br-int',has_traffic_filtering=True,id=c2725a77-bc15-423e-9795-49c2647a2d82,network=Network(594b2a44-0933-4ecd-ae26-5fd6f9582d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2725a77-bc') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG os_vif [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:82:17,bridge_name='br-int',has_traffic_filtering=True,id=c2725a77-bc15-423e-9795-49c2647a2d82,network=Network(594b2a44-0933-4ecd-ae26-5fd6f9582d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2725a77-bc') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2725a77-bc, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf94fa3-3a14-4353-9467-c47d372d3ba0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d9ae80a-6e6c-43ca-95b5-7c1c78d6eb15) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:44:26 user nova-compute[75391]: INFO os_vif [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:82:17,bridge_name='br-int',has_traffic_filtering=True,id=c2725a77-bc15-423e-9795-49c2647a2d82,network=Network(594b2a44-0933-4ecd-ae26-5fd6f9582d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2725a77-bc')
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIMPVjRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:26 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f9f55b-9a89-49a2-ba5f-a974a121fc33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea549a9f-3881-4fba-873a-3d0541f9f69a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9588c9a1-0830-442c-839f-6bf7bc0dfe67]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:44:26 user nova-compute[75391]: No targets found.
Nov 15 02:44:26 user nova-compute[75391]: iSNS:
Nov 15 02:44:26 user nova-compute[75391]: No targets found.
Nov 15 02:44:26 user nova-compute[75391]: STATIC:
Nov 15 02:44:26 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407
Nov 15 02:44:26 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:26 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:26 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c
Nov 15 02:44:26 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:26 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:26 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769
Nov 15 02:44:26 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:26 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:26 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8
Nov 15 02:44:26 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:26 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:26 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a
Nov 15 02:44:26 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:26 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:26 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d
Nov 15 02:44:26 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:26 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:26 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6
Nov 15 02:44:26 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:26 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:26 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b
Nov 15 02:44:26 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:26 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:26 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2
Nov 15 02:44:26 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:26 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:26 user nova-compute[75391]: FIRMWARE:
Nov 15 02:44:26 user nova-compute[75391]: No targets found.
Nov 15 02:44:26 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:44:26 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:44:26 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:44:26 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[919ad631-d45a-44e0-a4c1-f801d65b29df]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG os_brick.utils [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Updating existing volume attachment record: 16473969-d911-4aa7-93f3-c9d62609914e {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5600dbb-a08f-4ee1-b7d0-61a117b65475]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] COPY block job progress, current cursor: 225443840 final cursor: 1073741824 {{(pid=75391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[67855ac8-9e23-4484-89ac-895893444b47]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:26 user nova-compute[75391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:26 user nova-compute[75391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)
Nov 15 02:44:26 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:26 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:26 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:26 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:26 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:26 user nova-compute[75391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:26 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:26 user nova-compute[75391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:26 user nova-compute[75391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)
Nov 15 02:44:26 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:26 user nova-compute[75391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d (non-flash)
Nov 15 02:44:26 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:26 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:26 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:26 user nova-compute[75391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:26 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f623c12c430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d'): ({'sdd'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Removing single pathed devices sdd {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-2bf835ee-5493-4a49-8179-c8529dd19ca5 req-4350ce2a-42b3-4e6d-99bb-6c036b2e6797 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-plugged-a60510f0-b568-4276-914e-3c8cd49eafe5 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2bf835ee-5493-4a49-8179-c8529dd19ca5 req-4350ce2a-42b3-4e6d-99bb-6c036b2e6797 service nova] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2bf835ee-5493-4a49-8179-c8529dd19ca5 req-4350ce2a-42b3-4e6d-99bb-6c036b2e6797 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2bf835ee-5493-4a49-8179-c8529dd19ca5 req-4350ce2a-42b3-4e6d-99bb-6c036b2e6797 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-2bf835ee-5493-4a49-8179-c8529dd19ca5 req-4350ce2a-42b3-4e6d-99bb-6c036b2e6797 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] No waiting events found dispatching network-vif-plugged-a60510f0-b568-4276-914e-3c8cd49eafe5 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:44:26 user nova-compute[75391]: WARNING nova.compute.manager [req-2bf835ee-5493-4a49-8179-c8529dd19ca5 req-4350ce2a-42b3-4e6d-99bb-6c036b2e6797 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received unexpected event network-vif-plugged-a60510f0-b568-4276-914e-3c8cd49eafe5 for instance with vm_state active and task_state deleting.
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-2bf835ee-5493-4a49-8179-c8529dd19ca5 req-4350ce2a-42b3-4e6d-99bb-6c036b2e6797 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-unplugged-c2725a77-bc15-423e-9795-49c2647a2d82 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2bf835ee-5493-4a49-8179-c8529dd19ca5 req-4350ce2a-42b3-4e6d-99bb-6c036b2e6797 service nova] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2bf835ee-5493-4a49-8179-c8529dd19ca5 req-4350ce2a-42b3-4e6d-99bb-6c036b2e6797 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2bf835ee-5493-4a49-8179-c8529dd19ca5 req-4350ce2a-42b3-4e6d-99bb-6c036b2e6797 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-2bf835ee-5493-4a49-8179-c8529dd19ca5 req-4350ce2a-42b3-4e6d-99bb-6c036b2e6797 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] No waiting events found dispatching network-vif-unplugged-c2725a77-bc15-423e-9795-49c2647a2d82 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-2bf835ee-5493-4a49-8179-c8529dd19ca5 req-4350ce2a-42b3-4e6d-99bb-6c036b2e6797 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-unplugged-c2725a77-bc15-423e-9795-49c2647a2d82 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-2bf835ee-5493-4a49-8179-c8529dd19ca5 req-4350ce2a-42b3-4e6d-99bb-6c036b2e6797 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-plugged-c2725a77-bc15-423e-9795-49c2647a2d82 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2bf835ee-5493-4a49-8179-c8529dd19ca5 req-4350ce2a-42b3-4e6d-99bb-6c036b2e6797 service nova] Acquiring lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2bf835ee-5493-4a49-8179-c8529dd19ca5 req-4350ce2a-42b3-4e6d-99bb-6c036b2e6797 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2bf835ee-5493-4a49-8179-c8529dd19ca5 req-4350ce2a-42b3-4e6d-99bb-6c036b2e6797 service nova] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-2bf835ee-5493-4a49-8179-c8529dd19ca5 req-4350ce2a-42b3-4e6d-99bb-6c036b2e6797 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] No waiting events found dispatching network-vif-plugged-c2725a77-bc15-423e-9795-49c2647a2d82 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:44:26 user nova-compute[75391]: WARNING nova.compute.manager [req-2bf835ee-5493-4a49-8179-c8529dd19ca5 req-4350ce2a-42b3-4e6d-99bb-6c036b2e6797 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received unexpected event network-vif-plugged-c2725a77-bc15-423e-9795-49c2647a2d82 for instance with vm_state active and task_state deleting.
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec15a19-f8bb-4ee2-85d2-978424314f86]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0422edef-7995-4ba0-a900-9d9ca1ebedcd]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Flushing IO for device /dev/sdd {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4810cdd-fc61-45f6-be97-9253dec3dcb1]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.061s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f874d05d-8aa5-4d60-b9d1-a08a3a72fbd4]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] SCSI volumes sdd have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f23a14-70da-417e-bb51-446d7f1a2f76]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54eba5f-33ec-430d-9bfb-f2e228460ba2]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d, portal: 172.16.0.220,3260]
Nov 15 02:44:27 user nova-compute[75391]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d, portal: 172.16.0.220,3260] successful.
Nov 15 02:44:27 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b426366-42eb-45d8-bcd4-0613db72180d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.052s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f139f3-4ea5-411e-a5f4-539230718d2f]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.520s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] <== disconnect_volume: return (522ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tYhvpsGw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:27 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f11ae3f-3114-4dcf-a3c1-db2f6c3fce72]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:44:27 user nova-compute[75391]: No targets found.
Nov 15 02:44:27 user nova-compute[75391]: iSNS:
Nov 15 02:44:27 user nova-compute[75391]: No targets found.
Nov 15 02:44:27 user nova-compute[75391]: STATIC:
Nov 15 02:44:27 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407
Nov 15 02:44:27 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:27 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:27 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c
Nov 15 02:44:27 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:27 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:27 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769
Nov 15 02:44:27 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:27 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:27 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8
Nov 15 02:44:27 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:27 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:27 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a
Nov 15 02:44:27 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:27 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:27 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6
Nov 15 02:44:27 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:27 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:27 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b
Nov 15 02:44:27 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:27 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:27 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2
Nov 15 02:44:27 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:27 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:27 user nova-compute[75391]: FIRMWARE:
Nov 15 02:44:27 user nova-compute[75391]: No targets found.
Nov 15 02:44:27 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:44:27 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:44:27 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb61af0-905b-4520-898d-41f4daf353e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] COPY block job progress, current cursor: 400556032 final cursor: 1073741824 {{(pid=75391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3173f3b1-441d-455c-a3c0-6bb2d28d9ef8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:27 user nova-compute[75391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:27 user nova-compute[75391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)
Nov 15 02:44:27 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:27 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:27 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:27 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:27 user nova-compute[75391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:27 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:27 user nova-compute[75391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:27 user nova-compute[75391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)
Nov 15 02:44:27 user nova-compute[75391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 (non-flash)
Nov 15 02:44:27 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:27 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:27 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:27 user nova-compute[75391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:27 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f624475ab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6'): ({'sdc'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Removing single pathed devices sdc {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5ee806-8f82-4135-b53e-41a8647ac63d]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a57c2c3-e07c-4e34-bcd7-c6590b3bf947]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Flushing IO for device /dev/sdc {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee67a12-1c51-44bf-bdd1-8244284a5345]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3252bb23-5c71-4afe-9575-aa6c68601d1f]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] SCSI volumes sdc have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[374a1a08-1642-4676-aa75-971afc2bd773]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8be382-aab6-4736-829c-264f6e1d7134]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6, portal: 172.16.0.220,3260]
Nov 15 02:44:27 user nova-compute[75391]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6, portal: 172.16.0.220,3260] successful.
Nov 15 02:44:27 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fbc7a5b-e703-4f0e-a7a7-144bd3f440c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f903d34-d00e-447d-962b-d7500972c12f]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.440s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] <== disconnect_volume: return (443ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCwjuLiA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:27 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cac6df-ab0a-4237-abd2-b4086219aba9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:44:27 user nova-compute[75391]: No targets found.
Nov 15 02:44:27 user nova-compute[75391]: iSNS:
Nov 15 02:44:27 user nova-compute[75391]: No targets found.
Nov 15 02:44:27 user nova-compute[75391]: STATIC:
Nov 15 02:44:27 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407
Nov 15 02:44:27 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:27 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:27 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c
Nov 15 02:44:27 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:27 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:27 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769
Nov 15 02:44:27 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:27 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:27 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8
Nov 15 02:44:27 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:27 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:27 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a
Nov 15 02:44:27 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:27 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:27 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b
Nov 15 02:44:27 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:27 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:27 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2
Nov 15 02:44:27 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:27 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:27 user nova-compute[75391]: FIRMWARE:
Nov 15 02:44:27 user nova-compute[75391]: No targets found.
Nov 15 02:44:27 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:44:27 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:44:27 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[186ba0fa-e7ef-4d2d-9712-81c825785cbf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7277ce07-3c0f-45ad-a891-a4ea3e27cce2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:27 user nova-compute[75391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:27 user nova-compute[75391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)
Nov 15 02:44:27 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:27 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:27 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:27 user nova-compute[75391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:27 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:27 user nova-compute[75391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:27 user nova-compute[75391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)
Nov 15 02:44:27 user nova-compute[75391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c (non-flash)
Nov 15 02:44:27 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:27 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:27 user nova-compute[75391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:27 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f624475ab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c'): ({'sde'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Removing single pathed devices sde {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d03acc0-f18c-4245-b076-06647bb455b3]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] COPY block job progress, current cursor: 524288000 final cursor: 1073741824 {{(pid=75391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d24325-29e2-4a2a-a67c-59fb7ccbc2e7]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Flushing IO for device /dev/sde {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[520472a2-b1de-48f3-926e-39d2723223e7]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f633cc98-71d7-4a80-99c0-d75b7442cd85]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] SCSI volumes sde have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c4cdac-3513-4897-8a8e-caa390577227]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c6a22d-8ffa-40ea-aaa0-b0bde11d227f]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c, portal: 172.16.0.220,3260]
Nov 15 02:44:27 user nova-compute[75391]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c, portal: 172.16.0.220,3260] successful.
Nov 15 02:44:27 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3897400-2d4d-48c5-b3ba-357e6ea42f9c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6feacf2-6824-405c-b4ac-995cdb3322f0]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] <== disconnect_volume: return (391ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:27 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:44:27 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Deleting instance files /opt/stack/data/nova/instances/2fb1dc69-6781-4a4f-a43f-9165d6dae447_del
Nov 15 02:44:27 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Deletion of /opt/stack/data/nova/instances/2fb1dc69-6781-4a4f-a43f-9165d6dae447_del complete
Nov 15 02:44:28 user nova-compute[75391]: INFO nova.compute.manager [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Took 4.38 seconds to destroy the instance on the hypervisor.
Nov 15 02:44:28 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:44:28 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:44:28 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:44:28 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] COPY block job progress, current cursor: 662700032 final cursor: 1073741824 {{(pid=75391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 02:44:28 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] COPY block job progress, current cursor: 794820608 final cursor: 1073741824 {{(pid=75391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 02:44:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] COPY block job progress, current cursor: 962592768 final cursor: 1073741824 {{(pid=75391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 02:44:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 02:44:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:44:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sgwDFGfo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:29 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[af736b19-d011-4bf9-b369-03e1ccee8b95]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:44:29 user nova-compute[75391]: No targets found.
Nov 15 02:44:29 user nova-compute[75391]: iSNS:
Nov 15 02:44:29 user nova-compute[75391]: No targets found.
Nov 15 02:44:29 user nova-compute[75391]: STATIC:
Nov 15 02:44:29 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407
Nov 15 02:44:29 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:29 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:29 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769
Nov 15 02:44:29 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:29 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:29 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8
Nov 15 02:44:29 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:29 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:29 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a
Nov 15 02:44:29 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:29 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:29 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b
Nov 15 02:44:29 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:29 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:29 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2
Nov 15 02:44:29 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:29 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:29 user nova-compute[75391]: FIRMWARE:
Nov 15 02:44:29 user nova-compute[75391]: No targets found.
Nov 15 02:44:29 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:44:29 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:44:29 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:44:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:44:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[677a9dc9-347d-4f6f-97f2-1c25dec08630]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9ce18b-3ba0-4d65-a10b-9ef6fbd8a0f6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:30 user nova-compute[75391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:30 user nova-compute[75391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)
Nov 15 02:44:30 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:30 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:30 user nova-compute[75391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:30 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:30 user nova-compute[75391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:30 user nova-compute[75391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)
Nov 15 02:44:30 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:30 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:30 user nova-compute[75391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:30 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f624475a440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b'): ({'sdg'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Removing single pathed devices sdg {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[625631a8-1abc-438a-a264-e9362ff97896]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2b63dd-0b20-4c28-81a5-d7fe2928d2f5]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Flushing IO for device /dev/sdg {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7890e7-75eb-414d-9bee-eb7efb67bd4d]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.037s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[88818bc1-2021-439b-848a-f5d5efa7bd14]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] SCSI volumes sdg have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG nova.compute.manager [req-7e62c741-44fe-4f93-9032-776331ce6822 req-025c1548-ae4e-4183-9a5a-7b7ac5941c04 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-deleted-2100ab6d-db20-43a9-ba96-d9630430c14f {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:30 user nova-compute[75391]: INFO nova.compute.manager [req-7e62c741-44fe-4f93-9032-776331ce6822 req-025c1548-ae4e-4183-9a5a-7b7ac5941c04 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Neutron deleted interface 2100ab6d-db20-43a9-ba96-d9630430c14f; detaching it from the instance and deleting it from the info cache
Nov 15 02:44:30 user nova-compute[75391]: DEBUG nova.network.neutron [req-7e62c741-44fe-4f93-9032-776331ce6822 req-025c1548-ae4e-4183-9a5a-7b7ac5941c04 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Updating instance_info_cache with network_info: [{"id": "dea6d9d9-b176-440e-9589-d8d8def6471d", "address": "fa:16:3e:9f:29:46", "network": {"id": "e1a8c17d-9960-4500-9f24-e3a447dba928", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-521564942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea6d9d9-b1", "ovs_interfaceid": "dea6d9d9-b176-440e-9589-d8d8def6471d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f659917-6ad3-4ccc-ac49-622470b330aa", "address": "fa:16:3e:16:a3:74", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f659917-6a", "ovs_interfaceid": "7f659917-6ad3-4ccc-ac49-622470b330aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51356594-af31-476d-a34b-697c80f519c8", "address": "fa:16:3e:45:1b:c0", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51356594-af", "ovs_interfaceid": "51356594-af31-476d-a34b-697c80f519c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a60510f0-b568-4276-914e-3c8cd49eafe5", "address": "fa:16:3e:5d:21:af", "network": {"id": "477acc99-8e84-4441-96c4-fddf8a5b5a5f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144017234", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa60510f0-b5", "ovs_interfaceid": "a60510f0-b568-4276-914e-3c8cd49eafe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9425c66c-2e1e-43e3-b611-70477c102b95", "address": "fa:16:3e:fb:32:26", "network": {"id": "594b2a44-0933-4ecd-ae26-5fd6f9582d15", "bridge": "br-int", "label": "tempest-device-tagging-net2-996422155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9425c66c-2e", "ovs_interfaceid": "9425c66c-2e1e-43e3-b611-70477c102b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2725a77-bc15-423e-9795-49c2647a2d82", "address": "fa:16:3e:ca:82:17", "network": {"id": "594b2a44-0933-4ecd-ae26-5fd6f9582d15", "bridge": "br-int", "label": "tempest-device-tagging-net2-996422155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1286381f6f484f8ca35024e8386f5c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2725a77-bc", "ovs_interfaceid": "c2725a77-bc15-423e-9795-49c2647a2d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6d35a9-a2cb-448e-b0ea-bfeddc9399b7]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG nova.compute.manager [req-7e62c741-44fe-4f93-9032-776331ce6822 req-025c1548-ae4e-4183-9a5a-7b7ac5941c04 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Detach interface failed, port_id=2100ab6d-db20-43a9-ba96-d9630430c14f, reason: Instance 2fb1dc69-6781-4a4f-a43f-9165d6dae447 could not be found. {{(pid=75391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[330ad9c8-146e-40cf-b2d9-51d38bc4e95b]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b, portal: 172.16.0.220,3260]
Nov 15 02:44:30 user nova-compute[75391]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b, portal: 172.16.0.220,3260] successful.
Nov 15 02:44:30 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8260d4f-5972-49de-b7db-90830da3a8e7]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] <== disconnect_volume: return (323ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG nova.compute.manager [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NkKUSbzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '1fc39b27-762e-4bc8-90ba-0215d65710ec', 'attached_at': '', 'detached_at': '', 'volume_id': '5c1fa670-5821-477b-947b-717e4f3a25d8', 'serial'} {{(pid=75391) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 15 02:44:30 user nova-compute[75391]: DEBUG nova.compute.manager [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] swap_volume: removing Cinder connection for volume f76e360b-eb5e-47bb-ae1a-9acd86e55d1b {{(pid=75391) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 15 02:44:31 user nova-compute[75391]: DEBUG nova.compute.manager [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] swap_volume: Updating volume f76e360b-eb5e-47bb-ae1a-9acd86e55d1b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "NkKUSbzI", "auth_password": "EqYWNOD2e4PUTJ", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "5c1fa670-5821-477b-947b-717e4f3a25d8"}, "status": "reserved", "instance": "1fc39b27-762e-4bc8-90ba-0215d65710ec", "attached_at": "", "detached_at": "", "volume_id": "5c1fa670-5821-477b-947b-717e4f3a25d8", "serial": "5c1fa670-5821-477b-947b-717e4f3a25d8"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '5c1fa670-5821-477b-947b-717e4f3a25d8', 'no_device': None, 'attachment_id': 'debcc23c-1595-4411-8cf7-7a83e3ed85ef'} {{(pid=75391) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 15 02:44:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c874ec8f-8ddc-4793-b71c-3da3a471ad5e tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Lock "1fc39b27-762e-4bc8-90ba-0215d65710ec" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.224s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:31 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:44:31 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Took 3.70 seconds to deallocate network for instance.
Nov 15 02:44:32 user nova-compute[75391]: DEBUG nova.compute.manager [req-f5fbb022-a75b-43a3-bf67-437cd497c453 req-e4399596-eec7-4d42-b254-42ecbc668c78 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-deleted-9425c66c-2e1e-43e3-b611-70477c102b95 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG nova.compute.manager [req-f5fbb022-a75b-43a3-bf67-437cd497c453 req-e4399596-eec7-4d42-b254-42ecbc668c78 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-deleted-c2725a77-bc15-423e-9795-49c2647a2d82 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG nova.compute.manager [req-f5fbb022-a75b-43a3-bf67-437cd497c453 req-e4399596-eec7-4d42-b254-42ecbc668c78 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-deleted-dea6d9d9-b176-440e-9589-d8d8def6471d {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG nova.compute.manager [req-f5fbb022-a75b-43a3-bf67-437cd497c453 req-e4399596-eec7-4d42-b254-42ecbc668c78 service nova] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Received event network-vif-deleted-a60510f0-b568-4276-914e-3c8cd49eafe5 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:44:32 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Creating image(s)
Nov 15 02:44:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Did not create local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Ensure instance console log exists: /opt/stack/data/nova/instances/60093cdf-015e-4c39-a514-1818a6e55385/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Start _get_guest_xml network_info=[{"id": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "address": "fa:16:3e:39:41:1f", "network": {"id": "8904261f-fabd-4932-b540-dcc6be4fe56e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-180821931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e357f7331b8042adbc7e74190412daa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f28911d-78", "ovs_interfaceid": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '16473969-d911-4aa7-93f3-c9d62609914e', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQIuJiSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '60093cdf-015e-4c39-a514-1818a6e55385', 'attached_at': '', 'detached_at': '', 'volume_id': '7c9e2931-9e6c-42a6-9b3c-b1854f32cb40', 'serial': '7c9e2931-9e6c-42a6-9b3c-b1854f32cb40'}, 'volume_type': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:44:32 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 02:44:32 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 02:44:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG nova.objects.instance [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lazy-loading 'vcpu_model' on Instance uuid 60093cdf-015e-4c39-a514-1818a6e55385 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQIuJiSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:32 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 02:44:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:32 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 02:44:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:32 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7ad754-69ba-4238-bcdb-22150fdac1c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:44:32 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[330532af-2b52-49a0-a51c-0e97fa6da7f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40] added
Nov 15 02:44:32 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93776c0-68f8-43c2-89c2-fc216508ca2c]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c79d750-3a8d-4b09-8121-ff84ed8805b4]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tQIuJiSX {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tQIuJiSX" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee57e15-d471-4916-b96f-3c1a0c51ae44]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tQIuJiSX'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f99c59b-d895-4784-8f77-e2b650618d4d]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Acquiring lock "1fc39b27-762e-4bc8-90ba-0215d65710ec" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Lock "1fc39b27-762e-4bc8-90ba-0215d65710ec" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG os_brick.utils [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3571eb2f-75df-4cb8-ac6f-2b48f3865b70]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:32 user nova-compute[75391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:32 user nova-compute[75391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)
Nov 15 02:44:32 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:32 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:32 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:32 user nova-compute[75391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:32 user nova-compute[75391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)
Nov 15 02:44:32 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:32 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:32 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8940bb5d-136e-4c8e-8a54-2df3749edea9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[68de57c0-e92c-4519-bb86-f7294e9dfece]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[784e2cec-821b-4261-85d1-ec0c35d92c7f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0733ea04-0407-406e-94b5-b59335cabb27]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07272c8-cde4-46df-aa53-f4da1e2495b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40, portal: 172.16.0.220,3260]
Nov 15 02:44:32 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40, portal: 172.16.0.220,3260] successful.
Nov 15 02:44:32 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:44:33 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:44:33 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7051c6e9-c980-428c-8249-b5babe5c4ac2]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:44:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:44:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:44:33 user nova-compute[75391]: DEBUG os_brick.utils [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:33 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc416979-3523-42f4-8de8-067ae12b04b7]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:33 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6528fb6a-e2f7-43d2-8a34-2cbfa9446e3d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:33 user nova-compute[75391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:33 user nova-compute[75391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)
Nov 15 02:44:33 user nova-compute[75391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:33 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:33 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:33 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:33 user nova-compute[75391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:33 user nova-compute[75391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)
Nov 15 02:44:33 user nova-compute[75391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:33 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:33 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:33 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:44:33 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:44:33 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:44:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:33 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1df58a-e487-4c12-a59c-e61f822be8e7]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:33 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:44:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQIuJiSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:44:33 user nova-compute[75391]: INFO nova.compute.manager [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Swapping volume 5c1fa670-5821-477b-947b-717e4f3a25d8 for f76e360b-eb5e-47bb-ae1a-9acd86e55d1b
Nov 15 02:44:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23637383936663634', 'path': '/dev/sdc'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637383936663634', 'path': '/dev/sdc'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:44:34 user nova-compute[75391]: INFO nova.compute.manager [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] [instance: 2fb1dc69-6781-4a4f-a43f-9165d6dae447] Took 2.36 seconds to detach 3 volumes for instance.
Nov 15 02:44:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T02:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-687676829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1071606514',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJpUqLBG9MXTa4b8ttJcUyIaQWwwfKw3oQQHLLLE6hRohPvI+iHNv7PsUg7WlW0Rk9dnTSBu2zUo7T1ApUjCFWDWZfBwkbNbFZxmqfiLBpDMCEOaVy2Lcdga2I1GHUEGQ==',key_name='tempest-keypair-1458525323',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:42:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e357f7331b8042adbc7e74190412daa2',ramdisk_id='',reservation_id='r-2jmtqabu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1642963392',owner_user_name='tempest-ServerActionsV293TestJSON-1642963392-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:44:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='541a74f4f1004769b64f8086feae6255',uuid=60093cdf-015e-4c39-a514-1818a6e55385,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "address": "fa:16:3e:39:41:1f", "network": {"id": "8904261f-fabd-4932-b540-dcc6be4fe56e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-180821931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e357f7331b8042adbc7e74190412daa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f28911d-78", "ovs_interfaceid": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Converting VIF {"id": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "address": "fa:16:3e:39:41:1f", "network": {"id": "8904261f-fabd-4932-b540-dcc6be4fe56e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-180821931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e357f7331b8042adbc7e74190412daa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f28911d-78", "ovs_interfaceid": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:41:1f,bridge_name='br-int',has_traffic_filtering=True,id=5f28911d-785a-4eee-aa6a-5de54d6836e5,network=Network(8904261f-fabd-4932-b540-dcc6be4fe56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f28911d-78') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:44:34 user nova-compute[75391]:   <uuid>60093cdf-015e-4c39-a514-1818a6e55385</uuid>
Nov 15 02:44:34 user nova-compute[75391]:   <name>instance-00000006</name>
Nov 15 02:44:34 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:44:34 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:44:34 user nova-compute[75391]:   <metadata>
Nov 15 02:44:34 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:44:34 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:44:34 user nova-compute[75391]:       <nova:name>tempest-ServerActionsV293TestJSON-server-687676829</nova:name>
Nov 15 02:44:34 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:44:32</nova:creationTime>
Nov 15 02:44:34 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:44:34 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:44:34 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:44:34 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:44:34 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:44:34 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:44:34 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:44:34 user nova-compute[75391]:       <nova:owner>
Nov 15 02:44:34 user nova-compute[75391]:         <nova:user uuid="541a74f4f1004769b64f8086feae6255">tempest-ServerActionsV293TestJSON-1642963392-project-member</nova:user>
Nov 15 02:44:34 user nova-compute[75391]:         <nova:project uuid="e357f7331b8042adbc7e74190412daa2">tempest-ServerActionsV293TestJSON-1642963392</nova:project>
Nov 15 02:44:34 user nova-compute[75391]:       </nova:owner>
Nov 15 02:44:34 user nova-compute[75391]:       <nova:ports>
Nov 15 02:44:34 user nova-compute[75391]:         <nova:port uuid="5f28911d-785a-4eee-aa6a-5de54d6836e5">
Nov 15 02:44:34 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 02:44:34 user nova-compute[75391]:         </nova:port>
Nov 15 02:44:34 user nova-compute[75391]:       </nova:ports>
Nov 15 02:44:34 user nova-compute[75391]:     </nova:instance>
Nov 15 02:44:34 user nova-compute[75391]:   </metadata>
Nov 15 02:44:34 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:44:34 user nova-compute[75391]:     <system>
Nov 15 02:44:34 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:44:34 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:44:34 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:44:34 user nova-compute[75391]:       <entry name="serial">60093cdf-015e-4c39-a514-1818a6e55385</entry>
Nov 15 02:44:34 user nova-compute[75391]:       <entry name="uuid">60093cdf-015e-4c39-a514-1818a6e55385</entry>
Nov 15 02:44:34 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:44:34 user nova-compute[75391]:     </system>
Nov 15 02:44:34 user nova-compute[75391]:   </sysinfo>
Nov 15 02:44:34 user nova-compute[75391]:   <os>
Nov 15 02:44:34 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:44:34 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:44:34 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:44:34 user nova-compute[75391]:   </os>
Nov 15 02:44:34 user nova-compute[75391]:   <features>
Nov 15 02:44:34 user nova-compute[75391]:     <acpi/>
Nov 15 02:44:34 user nova-compute[75391]:     <apic/>
Nov 15 02:44:34 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:44:34 user nova-compute[75391]:   </features>
Nov 15 02:44:34 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:44:34 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:44:34 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:44:34 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:44:34 user nova-compute[75391]:   </clock>
Nov 15 02:44:34 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:44:34 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:44:34 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:44:34 user nova-compute[75391]:   </cpu>
Nov 15 02:44:34 user nova-compute[75391]:   <devices>
Nov 15 02:44:34 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 02:44:34 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:44:34 user nova-compute[75391]:       <source dev="/dev/sdc"/>
Nov 15 02:44:34 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:44:34 user nova-compute[75391]:       <serial>7c9e2931-9e6c-42a6-9b3c-b1854f32cb40</serial>
Nov 15 02:44:34 user nova-compute[75391]:     </disk>
Nov 15 02:44:34 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:44:34 user nova-compute[75391]:       <mac address="fa:16:3e:39:41:1f"/>
Nov 15 02:44:34 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:44:34 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:44:34 user nova-compute[75391]:       <target dev="tap5f28911d-78"/>
Nov 15 02:44:34 user nova-compute[75391]:     </interface>
Nov 15 02:44:34 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:44:34 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/60093cdf-015e-4c39-a514-1818a6e55385/console.log" append="off"/>
Nov 15 02:44:34 user nova-compute[75391]:     </serial>
Nov 15 02:44:34 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:44:34 user nova-compute[75391]:     <video>
Nov 15 02:44:34 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:44:34 user nova-compute[75391]:     </video>
Nov 15 02:44:34 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:44:34 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:44:34 user nova-compute[75391]:     </rng>
Nov 15 02:44:34 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:44:34 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:44:34 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:44:34 user nova-compute[75391]:     </memballoon>
Nov 15 02:44:34 user nova-compute[75391]:   </devices>
Nov 15 02:44:34 user nova-compute[75391]: </domain>
Nov 15 02:44:34 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T02:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-687676829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1071606514',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJpUqLBG9MXTa4b8ttJcUyIaQWwwfKw3oQQHLLLE6hRohPvI+iHNv7PsUg7WlW0Rk9dnTSBu2zUo7T1ApUjCFWDWZfBwkbNbFZxmqfiLBpDMCEOaVy2Lcdga2I1GHUEGQ==',key_name='tempest-keypair-1458525323',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:42:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e357f7331b8042adbc7e74190412daa2',ramdisk_id='',reservation_id='r-2jmtqabu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1642963392',owner_user_name='tempest-ServerActionsV293TestJSON-1642963392-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:44:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='541a74f4f1004769b64f8086feae6255',uuid=60093cdf-015e-4c39-a514-1818a6e55385,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "address": "fa:16:3e:39:41:1f", "network": {"id": "8904261f-fabd-4932-b540-dcc6be4fe56e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-180821931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e357f7331b8042adbc7e74190412daa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f28911d-78", "ovs_interfaceid": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Converting VIF {"id": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "address": "fa:16:3e:39:41:1f", "network": {"id": "8904261f-fabd-4932-b540-dcc6be4fe56e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-180821931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e357f7331b8042adbc7e74190412daa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f28911d-78", "ovs_interfaceid": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:41:1f,bridge_name='br-int',has_traffic_filtering=True,id=5f28911d-785a-4eee-aa6a-5de54d6836e5,network=Network(8904261f-fabd-4932-b540-dcc6be4fe56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f28911d-78') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG os_vif [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:41:1f,bridge_name='br-int',has_traffic_filtering=True,id=5f28911d-785a-4eee-aa6a-5de54d6836e5,network=Network(8904261f-fabd-4932-b540-dcc6be4fe56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f28911d-78') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b23523e3-cb28-5586-8267-8f24592d0dcc', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f28911d-78, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f28911d-78, col_values=(('qos', UUID('74fdd18e-4637-4d9b-a794-4e8362d4f398')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f28911d-78, col_values=(('external_ids', {'iface-id': '5f28911d-785a-4eee-aa6a-5de54d6836e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:41:1f', 'vm-uuid': '60093cdf-015e-4c39-a514-1818a6e55385'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:34 user nova-compute[75391]: INFO os_vif [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:41:1f,bridge_name='br-int',has_traffic_filtering=True,id=5f28911d-785a-4eee-aa6a-5de54d6836e5,network=Network(8904261f-fabd-4932-b540-dcc6be4fe56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f28911d-78')
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] No VIF found with MAC fa:16:3e:39:41:1f, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:34 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Deleted allocations for instance 2fb1dc69-6781-4a4f-a43f-9165d6dae447
Nov 15 02:44:34 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2 is timed out.
Nov 15 02:44:34 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Successfully detached device vdb from instance 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2 from the live domain config.
Nov 15 02:44:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nUbmWrvy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:34 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4868f58-bab7-446f-b11d-c5ff47333470]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:44:34 user nova-compute[75391]: No targets found.
Nov 15 02:44:34 user nova-compute[75391]: iSNS:
Nov 15 02:44:34 user nova-compute[75391]: No targets found.
Nov 15 02:44:34 user nova-compute[75391]: STATIC:
Nov 15 02:44:34 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407
Nov 15 02:44:34 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:34 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:34 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769
Nov 15 02:44:34 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:34 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:34 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40
Nov 15 02:44:34 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:34 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:34 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8
Nov 15 02:44:34 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:34 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:34 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a
Nov 15 02:44:34 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:34 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:34 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2
Nov 15 02:44:34 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:34 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:34 user nova-compute[75391]: FIRMWARE:
Nov 15 02:44:34 user nova-compute[75391]: No targets found.
Nov 15 02:44:34 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:44:34 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:44:34 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[359d23ae-4b00-4df2-bdd8-f5adc57ec343]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2336b772-21f3-4999-932a-c82476288fb1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:34 user nova-compute[75391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:34 user nova-compute[75391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)
Nov 15 02:44:34 user nova-compute[75391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:34 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:34 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:34 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:34 user nova-compute[75391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:34 user nova-compute[75391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)
Nov 15 02:44:34 user nova-compute[75391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:34 user nova-compute[75391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 (non-flash)
Nov 15 02:44:34 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:34 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62247d35b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407'): ({'sdf'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Removing single pathed devices sdf {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a6ec9b13-caf9-41f5-9723-f46cfabf319d tempest-TaggedBootDevicesTest-1936342241 tempest-TaggedBootDevicesTest-1936342241-project-member] Lock "2fb1dc69-6781-4a4f-a43f-9165d6dae447" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.119s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ef506e-e1d6-4ace-abc2-a27012b1cb29]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9035290e-4234-44d7-8ed7-1a0f1e250e87]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Flushing IO for device /dev/sdf {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[72732951-252b-450c-84df-6e54253807ed]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[53888ecc-5d0c-4c3d-9c91-2c0d990daadb]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] SCSI volumes sdf have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6930fdee-d468-41b5-a325-f0d2b7feb804]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae7cec1-5f31-4070-abc4-18d08b32300c]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407, portal: 172.16.0.220,3260]
Nov 15 02:44:34 user nova-compute[75391]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407, portal: 172.16.0.220,3260] successful.
Nov 15 02:44:34 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72a4b3da-f714-4ff5-887c-7e2590b30407 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc29007-5cec-4479-a7b5-641e87e702de]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] <== disconnect_volume: return (323ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:44:35 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance f5586645-063f-463f-b03a-16e783b1c2d5 is timed out.
Nov 15 02:44:35 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Successfully detached device sdc from instance f5586645-063f-463f-b03a-16e783b1c2d5 from the live domain config.
Nov 15 02:44:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aCZexIPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:35 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:35 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdfa5c3-1d3d-4ca9-b04b-033696f71ea2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:44:35 user nova-compute[75391]: No targets found.
Nov 15 02:44:35 user nova-compute[75391]: iSNS:
Nov 15 02:44:35 user nova-compute[75391]: No targets found.
Nov 15 02:44:35 user nova-compute[75391]: STATIC:
Nov 15 02:44:35 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769
Nov 15 02:44:35 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:35 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:35 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40
Nov 15 02:44:35 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:35 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:35 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8
Nov 15 02:44:35 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:35 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:35 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a
Nov 15 02:44:35 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:35 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:35 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2
Nov 15 02:44:35 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:35 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:35 user nova-compute[75391]: FIRMWARE:
Nov 15 02:44:35 user nova-compute[75391]: No targets found.
Nov 15 02:44:35 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:44:35 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:44:35 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f89aaa-2bce-4ed8-acc8-6eeb6cb95b47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed749448-14b9-4729-88b5-8c19bf8fac85]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:35 user nova-compute[75391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:35 user nova-compute[75391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)
Nov 15 02:44:35 user nova-compute[75391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:35 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:35 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:35 user nova-compute[75391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:35 user nova-compute[75391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)
Nov 15 02:44:35 user nova-compute[75391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:35 user nova-compute[75391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 (non-flash)
Nov 15 02:44:35 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62247d3250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2'): ({'sdb'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Removing single pathed devices sdb {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[827b67c4-8737-40ba-a7aa-3deb969d61e1]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[83106c04-0705-4ecd-a1d7-9fa5f84bb624]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Flushing IO for device /dev/sdb {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a968f758-c26c-4cf8-bb16-177490aa6c13]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fa468c-7bcd-4246-90d9-38528c5fc4b6]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[52117f52-5db0-4941-beb0-af39729da77d]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.117s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff2fa42-f278-405f-af7a-48be47c1e294]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2, portal: 172.16.0.220,3260]
Nov 15 02:44:35 user nova-compute[75391]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2, portal: 172.16.0.220,3260] successful.
Nov 15 02:44:35 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec81723-86c4-4a49-b656-763ce2eb96c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c4acd8-d38d-4d0d-8bb4-23daa5eae986]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] <== disconnect_volume: return (407ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-03c840ba-1e9e-4777-8448-0b4ac5ad2100 req-96e94f8e-d999-48c1-a329-189c0e303557 service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Received event network-vif-plugged-5f28911d-785a-4eee-aa6a-5de54d6836e5 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-03c840ba-1e9e-4777-8448-0b4ac5ad2100 req-96e94f8e-d999-48c1-a329-189c0e303557 service nova] Acquiring lock "60093cdf-015e-4c39-a514-1818a6e55385-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-03c840ba-1e9e-4777-8448-0b4ac5ad2100 req-96e94f8e-d999-48c1-a329-189c0e303557 service nova] Lock "60093cdf-015e-4c39-a514-1818a6e55385-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-03c840ba-1e9e-4777-8448-0b4ac5ad2100 req-96e94f8e-d999-48c1-a329-189c0e303557 service nova] Lock "60093cdf-015e-4c39-a514-1818a6e55385-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-03c840ba-1e9e-4777-8448-0b4ac5ad2100 req-96e94f8e-d999-48c1-a329-189c0e303557 service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] No waiting events found dispatching network-vif-plugged-5f28911d-785a-4eee-aa6a-5de54d6836e5 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:44:35 user nova-compute[75391]: WARNING nova.compute.manager [req-03c840ba-1e9e-4777-8448-0b4ac5ad2100 req-96e94f8e-d999-48c1-a329-189c0e303557 service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Received unexpected event network-vif-plugged-5f28911d-785a-4eee-aa6a-5de54d6836e5 for instance with vm_state active and task_state rebuild_spawning.
Nov 15 02:44:35 user nova-compute[75391]: DEBUG nova.objects.instance [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lazy-loading 'flavor' on Instance uuid 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:44:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-81942010-2fd3-4ce0-8a6f-505845bdb8ac tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.290s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:36 user nova-compute[75391]: DEBUG nova.objects.instance [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lazy-loading 'flavor' on Instance uuid f5586645-063f-463f-b03a-16e783b1c2d5 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:44:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-854b95dd-a26d-4d93-afb3-d9535bbeebb7 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "f5586645-063f-463f-b03a-16e783b1c2d5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.902s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG nova.compute.manager [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:44:37 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Instance spawned successfully.
Nov 15 02:44:37 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG nova.compute.manager [req-f8887a9d-04b9-4fb9-adfc-9fd12df81054 req-09c6c74f-090d-421e-baa6-944f78136d95 service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Received event network-vif-plugged-5f28911d-785a-4eee-aa6a-5de54d6836e5 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f8887a9d-04b9-4fb9-adfc-9fd12df81054 req-09c6c74f-090d-421e-baa6-944f78136d95 service nova] Acquiring lock "60093cdf-015e-4c39-a514-1818a6e55385-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f8887a9d-04b9-4fb9-adfc-9fd12df81054 req-09c6c74f-090d-421e-baa6-944f78136d95 service nova] Lock "60093cdf-015e-4c39-a514-1818a6e55385-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f8887a9d-04b9-4fb9-adfc-9fd12df81054 req-09c6c74f-090d-421e-baa6-944f78136d95 service nova] Lock "60093cdf-015e-4c39-a514-1818a6e55385-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG nova.compute.manager [req-f8887a9d-04b9-4fb9-adfc-9fd12df81054 req-09c6c74f-090d-421e-baa6-944f78136d95 service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] No waiting events found dispatching network-vif-plugged-5f28911d-785a-4eee-aa6a-5de54d6836e5 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:44:37 user nova-compute[75391]: WARNING nova.compute.manager [req-f8887a9d-04b9-4fb9-adfc-9fd12df81054 req-09c6c74f-090d-421e-baa6-944f78136d95 service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Received unexpected event network-vif-plugged-5f28911d-785a-4eee-aa6a-5de54d6836e5 for instance with vm_state active and task_state rebuild_spawning.
Nov 15 02:44:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-df31411f-3628-4f13-9d2d-fefff4f75434 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Acquiring lock "f5586645-063f-463f-b03a-16e783b1c2d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-df31411f-3628-4f13-9d2d-fefff4f75434 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "f5586645-063f-463f-b03a-16e783b1c2d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-df31411f-3628-4f13-9d2d-fefff4f75434 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Acquiring lock "f5586645-063f-463f-b03a-16e783b1c2d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-df31411f-3628-4f13-9d2d-fefff4f75434 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "f5586645-063f-463f-b03a-16e783b1c2d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-df31411f-3628-4f13-9d2d-fefff4f75434 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "f5586645-063f-463f-b03a-16e783b1c2d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:37 user nova-compute[75391]: INFO nova.compute.manager [None req-df31411f-3628-4f13-9d2d-fefff4f75434 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Terminating instance
Nov 15 02:44:37 user nova-compute[75391]: DEBUG nova.compute.manager [None req-df31411f-3628-4f13-9d2d-fefff4f75434 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG nova.compute.manager [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sgwDFGfo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1fc39b27-762e-4bc8-90ba-0215d65710ec', 'attached_at': '', 'detached_at': '', 'volume_id': 'f76e360b-eb5e-47bb-ae1a-9acd86e55d1b', 'serial': 'f76e360b-eb5e-47bb-ae1a-9acd86e55d1b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NkKUSbzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '5c1fa670-5821-477b-947b-717e4f3a25d8'}, 'status': 'reserved', 'instance': '1fc39b27-762e-4bc8-90ba-0215d65710ec', 'attached_at': '', 'detached_at': '', 'volume_id': '5c1fa670-5821-477b-947b-717e4f3a25d8', 'serial'} {{(pid=75391) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sgwDFGfo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:37 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:37 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:37 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:44:37 user nova-compute[75391]: DEBUG nova.compute.manager [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[50379afe-8964-47cb-a417-e18e1f4c4256]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:44:37 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c48ab3-58ac-424a-8b93-b7eafa938f9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b] added
Nov 15 02:44:37 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d8b759-1006-4b54-a0ab-5bd77b9a15ce]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f84948-9857-484d-b193-47cc9b58bdfe]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sgwDFGfo {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG nova.objects.instance [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75391) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sgwDFGfo" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9de9bf2-b8f0-4305-af17-5c7bc75dc40e]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sgwDFGfo'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[73eeda36-c8ea-4cf8-ae84-b616a8178393]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[74224f0e-cb99-4ca9-9f4e-c3cd677fee31]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:38 user nova-compute[75391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:38 user nova-compute[75391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)
Nov 15 02:44:38 user nova-compute[75391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:38 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:38 user nova-compute[75391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:38 user nova-compute[75391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)
Nov 15 02:44:38 user nova-compute[75391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:38 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-81cfc800-13e2-458f-a0cb-1fdd0f6d4387 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.093s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd89bd03-8538-42d9-b8ec-1c14deb3e157]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b, portal: 172.16.0.220,3260]
Nov 15 02:44:38 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b, portal: 172.16.0.220,3260] successful.
Nov 15 02:44:38 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecd5124-5edf-479d-ba44-a15a719ea2c7]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ee6d0e-2638-4482-83ac-1af937eb98a6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:38 user nova-compute[75391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:38 user nova-compute[75391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)
Nov 15 02:44:38 user nova-compute[75391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:38 user nova-compute[75391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:38 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:38 user nova-compute[75391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:38 user nova-compute[75391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)
Nov 15 02:44:38 user nova-compute[75391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:38 user nova-compute[75391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:38 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b2a27a-4065-4f05-afe7-a99c7c0d68df]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: None {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:44:38 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Instance destroyed successfully.
Nov 15 02:44:38 user nova-compute[75391]: DEBUG nova.objects.instance [None req-df31411f-3628-4f13-9d2d-fefff4f75434 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lazy-loading 'resources' on Instance uuid f5586645-063f-463f-b03a-16e783b1c2d5 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-df31411f-3628-4f13-9d2d-fefff4f75434 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1066264907',display_name='tempest-AttachSCSIVolumeTestJSON-server-1066264907',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1066264907',id=5,image_ref='eefcf20c-f561-43b7-8801-e4dd7714fa4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOhNZgiA1XHgDO7hWI4cLLrmTuKsoqnrTcfPgOLG8ZdNu47cUifRr+V7QQR5SgUpMPLJyep+lsHUkg8euSYNV5oK/4UuazRUGrFpTrbLftJHZUMwi1RA7k6OFr8L3CN/w==',key_name='tempest-keypair-795349839',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:42:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5682e8d440c343039dc2baf1d2687863',ramdisk_id='',reservation_id='r-doqjqwi8',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eefcf20c-f561-43b7-8801-e4dd7714fa4f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1522481192',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1522481192-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:42:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9243da3ef1d4dfa898d30615f838aa1',uuid=f5586645-063f-463f-b03a-16e783b1c2d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13f9f606-3317-4760-b79b-39199222f706", "address": "fa:16:3e:8e:ba:2a", "network": {"id": "df52f039-d434-4640-8224-5bb1d10a7ad6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2084034119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5682e8d440c343039dc2baf1d2687863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f9f606-33", "ovs_interfaceid": "13f9f606-3317-4760-b79b-39199222f706", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-df31411f-3628-4f13-9d2d-fefff4f75434 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Converting VIF {"id": "13f9f606-3317-4760-b79b-39199222f706", "address": "fa:16:3e:8e:ba:2a", "network": {"id": "df52f039-d434-4640-8224-5bb1d10a7ad6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2084034119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5682e8d440c343039dc2baf1d2687863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f9f606-33", "ovs_interfaceid": "13f9f606-3317-4760-b79b-39199222f706", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-df31411f-3628-4f13-9d2d-fefff4f75434 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:ba:2a,bridge_name='br-int',has_traffic_filtering=True,id=13f9f606-3317-4760-b79b-39199222f706,network=Network(df52f039-d434-4640-8224-5bb1d10a7ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13f9f606-33') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG os_vif [None req-df31411f-3628-4f13-9d2d-fefff4f75434 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:ba:2a,bridge_name='br-int',has_traffic_filtering=True,id=13f9f606-3317-4760-b79b-39199222f706,network=Network(df52f039-d434-4640-8224-5bb1d10a7ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13f9f606-33') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13f9f606-33, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c03f5c3c-4ef3-4134-bdd3-073dec96a35b) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:44:38 user nova-compute[75391]: INFO os_vif [None req-df31411f-3628-4f13-9d2d-fefff4f75434 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:ba:2a,bridge_name='br-int',has_traffic_filtering=True,id=13f9f606-3317-4760-b79b-39199222f706,network=Network(df52f039-d434-4640-8224-5bb1d10a7ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13f9f606-33')
Nov 15 02:44:38 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-df31411f-3628-4f13-9d2d-fefff4f75434 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Deleting instance files /opt/stack/data/nova/instances/f5586645-063f-463f-b03a-16e783b1c2d5_del
Nov 15 02:44:38 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-df31411f-3628-4f13-9d2d-fefff4f75434 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Deletion of /opt/stack/data/nova/instances/f5586645-063f-463f-b03a-16e783b1c2d5_del complete
Nov 15 02:44:38 user nova-compute[75391]: INFO nova.compute.manager [None req-df31411f-3628-4f13-9d2d-fefff4f75434 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 02:44:38 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-df31411f-3628-4f13-9d2d-fefff4f75434 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:44:38 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:44:39 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:44:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sgwDFGfo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:44:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23437383761346563', 'path': '/dev/sdb'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437383761346563', 'path': '/dev/sdb'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:44:39 user nova-compute[75391]: DEBUG nova.objects.instance [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Lazy-loading 'flavor' on Instance uuid 1fc39b27-762e-4bc8-90ba-0215d65710ec {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:44:39 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:44:39 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Took 0.77 seconds to deallocate network for instance.
Nov 15 02:44:39 user nova-compute[75391]: DEBUG nova.compute.manager [req-6945be4b-a213-4f40-aa5d-91e781f24149 req-9ce53aa5-614f-4d45-b46d-631af5a3b681 service nova] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Received event network-vif-deleted-13f9f606-3317-4760-b79b-39199222f706 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-df31411f-3628-4f13-9d2d-fefff4f75434 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-df31411f-3628-4f13-9d2d-fefff4f75434 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 02:44:39 user nova-compute[75391]: DEBUG nova.compute.manager [req-bb3f99a1-3249-454d-9af5-243e4f2a9d9b req-1151d247-58aa-411e-8f11-ef5a6d1b292d service nova] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Received event network-vif-unplugged-13f9f606-3317-4760-b79b-39199222f706 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bb3f99a1-3249-454d-9af5-243e4f2a9d9b req-1151d247-58aa-411e-8f11-ef5a6d1b292d service nova] Acquiring lock "f5586645-063f-463f-b03a-16e783b1c2d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bb3f99a1-3249-454d-9af5-243e4f2a9d9b req-1151d247-58aa-411e-8f11-ef5a6d1b292d service nova] Lock "f5586645-063f-463f-b03a-16e783b1c2d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bb3f99a1-3249-454d-9af5-243e4f2a9d9b req-1151d247-58aa-411e-8f11-ef5a6d1b292d service nova] Lock "f5586645-063f-463f-b03a-16e783b1c2d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:39 user nova-compute[75391]: DEBUG nova.compute.manager [req-bb3f99a1-3249-454d-9af5-243e4f2a9d9b req-1151d247-58aa-411e-8f11-ef5a6d1b292d service nova] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] No waiting events found dispatching network-vif-unplugged-13f9f606-3317-4760-b79b-39199222f706 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:44:39 user nova-compute[75391]: WARNING nova.compute.manager [req-bb3f99a1-3249-454d-9af5-243e4f2a9d9b req-1151d247-58aa-411e-8f11-ef5a6d1b292d service nova] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Received unexpected event network-vif-unplugged-13f9f606-3317-4760-b79b-39199222f706 for instance with vm_state deleted and task_state None.
Nov 15 02:44:39 user nova-compute[75391]: DEBUG nova.compute.manager [req-bb3f99a1-3249-454d-9af5-243e4f2a9d9b req-1151d247-58aa-411e-8f11-ef5a6d1b292d service nova] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Received event network-vif-plugged-13f9f606-3317-4760-b79b-39199222f706 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bb3f99a1-3249-454d-9af5-243e4f2a9d9b req-1151d247-58aa-411e-8f11-ef5a6d1b292d service nova] Acquiring lock "f5586645-063f-463f-b03a-16e783b1c2d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bb3f99a1-3249-454d-9af5-243e4f2a9d9b req-1151d247-58aa-411e-8f11-ef5a6d1b292d service nova] Lock "f5586645-063f-463f-b03a-16e783b1c2d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bb3f99a1-3249-454d-9af5-243e4f2a9d9b req-1151d247-58aa-411e-8f11-ef5a6d1b292d service nova] Lock "f5586645-063f-463f-b03a-16e783b1c2d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:39 user nova-compute[75391]: DEBUG nova.compute.manager [req-bb3f99a1-3249-454d-9af5-243e4f2a9d9b req-1151d247-58aa-411e-8f11-ef5a6d1b292d service nova] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] No waiting events found dispatching network-vif-plugged-13f9f606-3317-4760-b79b-39199222f706 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:44:39 user nova-compute[75391]: WARNING nova.compute.manager [req-bb3f99a1-3249-454d-9af5-243e4f2a9d9b req-1151d247-58aa-411e-8f11-ef5a6d1b292d service nova] [instance: f5586645-063f-463f-b03a-16e783b1c2d5] Received unexpected event network-vif-plugged-13f9f606-3317-4760-b79b-39199222f706 for instance with vm_state deleted and task_state None.
Nov 15 02:44:39 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bb472aa5-47dd-48d6-8e9f-e179afd1d8ec is timed out.
Nov 15 02:44:39 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Successfully detached device vdb from instance bb472aa5-47dd-48d6-8e9f-e179afd1d8ec from the live domain config.
Nov 15 02:44:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:44:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'brYDTgXO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:39 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[553e44c8-ed40-4b07-a4ad-87702064007c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:44:40 user nova-compute[75391]: No targets found.
Nov 15 02:44:40 user nova-compute[75391]: iSNS:
Nov 15 02:44:40 user nova-compute[75391]: No targets found.
Nov 15 02:44:40 user nova-compute[75391]: STATIC:
Nov 15 02:44:40 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769
Nov 15 02:44:40 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:40 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:40 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40
Nov 15 02:44:40 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:40 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:40 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8
Nov 15 02:44:40 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:40 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:40 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a
Nov 15 02:44:40 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:40 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:40 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b
Nov 15 02:44:40 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:40 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:40 user nova-compute[75391]: FIRMWARE:
Nov 15 02:44:40 user nova-compute[75391]: No targets found.
Nov 15 02:44:40 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:44:40 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:44:40 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-df31411f-3628-4f13-9d2d-fefff4f75434 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b940644-674e-4ce1-8066-419114eb4f6e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-df31411f-3628-4f13-9d2d-fefff4f75434 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc3cf10-c6d7-4924-9a26-09ee32603ec1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:40 user nova-compute[75391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:40 user nova-compute[75391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)
Nov 15 02:44:40 user nova-compute[75391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:40 user nova-compute[75391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:40 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a (non-flash)
Nov 15 02:44:40 user nova-compute[75391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:40 user nova-compute[75391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)
Nov 15 02:44:40 user nova-compute[75391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:40 user nova-compute[75391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:40 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6224791ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a'): ({'sdi'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Removing single pathed devices sdi {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1daac2ea-9e86-4758-a771-0264d0733106]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-df31411f-3628-4f13-9d2d-fefff4f75434 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.481s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[be356bfb-1296-499b-9224-3c400789fb86]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Flushing IO for device /dev/sdi {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab46e50-fba8-4ab9-9927-458261daa9ee]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:40 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-df31411f-3628-4f13-9d2d-fefff4f75434 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Deleted allocations for instance f5586645-063f-463f-b03a-16e783b1c2d5
Nov 15 02:44:40 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] COPY block job progress, current cursor: 122683392 final cursor: 1073741824 {{(pid=75391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.046s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70a3032-7290-4d55-88af-faf8e84ed224]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] SCSI volumes sdi have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77eb1ba-5a00-49b3-8320-dc347f433655]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-df31411f-3628-4f13-9d2d-fefff4f75434 tempest-AttachSCSIVolumeTestJSON-1522481192 tempest-AttachSCSIVolumeTestJSON-1522481192-project-member] Lock "f5586645-063f-463f-b03a-16e783b1c2d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.524s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96a96dc-f415-4549-b793-5dd15a5d19f5]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a, portal: 172.16.0.220,3260]
Nov 15 02:44:40 user nova-compute[75391]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a, portal: 172.16.0.220,3260] successful.
Nov 15 02:44:40 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d0c9f6-98ce-4e4b-8253-20830022185a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bef4159-f04b-490d-a232-e290310722f0]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.451s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] <== disconnect_volume: return (454ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:44:40 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] COPY block job progress, current cursor: 285212672 final cursor: 1073741824 {{(pid=75391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 02:44:41 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bc5c2514-d819-4792-afde-dfedc85e8e88 is timed out.
Nov 15 02:44:41 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Successfully detached device vdb from instance bc5c2514-d819-4792-afde-dfedc85e8e88 from the live domain config.
Nov 15 02:44:41 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BkLIuMEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:41 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aec3ab3-7df3-4026-806d-dad06507eb75]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:44:41 user nova-compute[75391]: No targets found.
Nov 15 02:44:41 user nova-compute[75391]: iSNS:
Nov 15 02:44:41 user nova-compute[75391]: No targets found.
Nov 15 02:44:41 user nova-compute[75391]: STATIC:
Nov 15 02:44:41 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769
Nov 15 02:44:41 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:41 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:41 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40
Nov 15 02:44:41 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:41 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:41 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8
Nov 15 02:44:41 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:41 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:41 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b
Nov 15 02:44:41 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:41 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:41 user nova-compute[75391]: FIRMWARE:
Nov 15 02:44:41 user nova-compute[75391]: No targets found.
Nov 15 02:44:41 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:44:41 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:44:41 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b3d77f-856b-4072-9ed5-bf339e706790]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f45797-8dd3-46c5-ad2d-77fbb42804b8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:41 user nova-compute[75391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)
Nov 15 02:44:41 user nova-compute[75391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:41 user nova-compute[75391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:41 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 (non-flash)
Nov 15 02:44:41 user nova-compute[75391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)
Nov 15 02:44:41 user nova-compute[75391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:41 user nova-compute[75391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:41 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6224790820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769'): ({'sdj'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Removing single pathed devices sdj {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] COPY block job progress, current cursor: 417333248 final cursor: 1073741824 {{(pid=75391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ab2d13-da69-4651-80e6-441f01fcf723]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcf9668-d297-4f2a-9cf4-2c3371ff39a3]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Flushing IO for device /dev/sdj {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.012s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d573f544-7b5c-4136-a0b0-3dcd5b8e5611]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.055s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b96b89a-a52c-4194-98d6-c0b3e6d79980]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] SCSI volumes sdj have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f711eb91-8955-425b-b065-847675e0ba2e]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b927b0-947c-4dbf-903e-0b2ab1fcbae2]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769, portal: 172.16.0.220,3260]
Nov 15 02:44:41 user nova-compute[75391]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769, portal: 172.16.0.220,3260] successful.
Nov 15 02:44:41 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4704b25d-7971-4b70-b39b-ce9bfe07f769 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f007823c-2bbe-4c66-a5e2-158cab79fcb5]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] <== disconnect_volume: return (340ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] COPY block job progress, current cursor: 487587840 final cursor: 1073741824 {{(pid=75391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 02:44:41 user nova-compute[75391]: DEBUG nova.objects.instance [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lazy-loading 'flavor' on Instance uuid bb472aa5-47dd-48d6-8e9f-e179afd1d8ec {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:44:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-55c800c0-e33c-40d8-9d72-14c2f810fa75 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.673s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] COPY block job progress, current cursor: 610271232 final cursor: 1073741824 {{(pid=75391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 02:44:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Acquiring lock "interface-bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-34633d4d-5212-4738-847f-25acca40b074" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "interface-bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-34633d4d-5212-4738-847f-25acca40b074" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:42 user nova-compute[75391]: DEBUG nova.objects.instance [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lazy-loading 'flavor' on Instance uuid bb472aa5-47dd-48d6-8e9f-e179afd1d8ec {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:44:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-84898992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-84898992',id=7,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjGjAlXtIFwyK48Tn0rWDvwO+CMiqK5nwES7Ozr0xqfWpvP+GLtsNTghKrGqtv5RFJtUL1Xov3deHDY6XnlkjWriT5bcxPdE96duFESi6cETl7FauYVa7ChUe8ZPLW7IQ==',key_name='tempest-keypair-1251809303',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:42:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68070c12bf9f4c45a8c12165d571fa41',ramdisk_id='',reservation_id='r-j0qi94j3',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-382223691',owner_user_name='tempest-TaggedAttachmentsTest-382223691-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:42:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1727eae8986646508dbb022ae69ab573',uuid=bb472aa5-47dd-48d6-8e9f-e179afd1d8ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34633d4d-5212-4738-847f-25acca40b074", "address": "fa:16:3e:64:fc:ab", "network": {"id": "1a6d6e24-345d-40d3-badd-a60f9ec9373e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1185402927", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "68070c12bf9f4c45a8c12165d571fa41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34633d4d-52", "ovs_interfaceid": "34633d4d-5212-4738-847f-25acca40b074", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:44:42 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Converting VIF {"id": "34633d4d-5212-4738-847f-25acca40b074", "address": "fa:16:3e:64:fc:ab", "network": {"id": "1a6d6e24-345d-40d3-badd-a60f9ec9373e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1185402927", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "68070c12bf9f4c45a8c12165d571fa41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34633d4d-52", "ovs_interfaceid": "34633d4d-5212-4738-847f-25acca40b074", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:44:42 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:fc:ab,bridge_name='br-int',has_traffic_filtering=True,id=34633d4d-5212-4738-847f-25acca40b074,network=Network(1a6d6e24-345d-40d3-badd-a60f9ec9373e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34633d4d-52') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:44:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:64:fc:ab"/><model type="virtio"/><mtu size="1442"/><target dev="tap34633d4d-52"/></interface> {{(pid=75391) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 02:44:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:64:fc:ab"/><model type="virtio"/><mtu size="1442"/><target dev="tap34633d4d-52"/></interface> {{(pid=75391) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 02:44:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Attempting to detach device tap34633d4d-52 from instance bb472aa5-47dd-48d6-8e9f-e179afd1d8ec from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:44:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] detach device xml: <interface type="ethernet">
Nov 15 02:44:42 user nova-compute[75391]:   <mac address="fa:16:3e:64:fc:ab"/>
Nov 15 02:44:42 user nova-compute[75391]:   <model type="virtio"/>
Nov 15 02:44:42 user nova-compute[75391]:   <mtu size="1442"/>
Nov 15 02:44:42 user nova-compute[75391]:   <target dev="tap34633d4d-52"/>
Nov 15 02:44:42 user nova-compute[75391]: </interface>
Nov 15 02:44:42 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:44:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:64:fc:ab"/><model type="virtio"/><mtu size="1442"/><target dev="tap34633d4d-52"/></interface> {{(pid=75391) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 02:44:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:64:fc:ab"/><model type="virtio"/><mtu size="1442"/><target dev="tap34633d4d-52"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 15 02:44:42 user nova-compute[75391]:   <name>instance-00000007</name>
Nov 15 02:44:42 user nova-compute[75391]:   <uuid>bb472aa5-47dd-48d6-8e9f-e179afd1d8ec</uuid>
Nov 15 02:44:42 user nova-compute[75391]:   <metadata>
Nov 15 02:44:42 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:44:42 user nova-compute[75391]:   <nova:package version="0.0.0"/>
Nov 15 02:44:42 user nova-compute[75391]:   <nova:name>tempest-device-tagging-server-84898992</nova:name>
Nov 15 02:44:42 user nova-compute[75391]:   <nova:creationTime>2023-11-15 02:44:06</nova:creationTime>
Nov 15 02:44:42 user nova-compute[75391]:   <nova:flavor name="m1.tiny">
Nov 15 02:44:42 user nova-compute[75391]:     <nova:memory>512</nova:memory>
Nov 15 02:44:42 user nova-compute[75391]:     <nova:disk>1</nova:disk>
Nov 15 02:44:42 user nova-compute[75391]:     <nova:swap>0</nova:swap>
Nov 15 02:44:42 user nova-compute[75391]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:44:42 user nova-compute[75391]:     <nova:vcpus>1</nova:vcpus>
Nov 15 02:44:42 user nova-compute[75391]:   </nova:flavor>
Nov 15 02:44:42 user nova-compute[75391]:   <nova:owner>
Nov 15 02:44:42 user nova-compute[75391]:     <nova:user uuid="1727eae8986646508dbb022ae69ab573">tempest-TaggedAttachmentsTest-382223691-project-member</nova:user>
Nov 15 02:44:42 user nova-compute[75391]:     <nova:project uuid="68070c12bf9f4c45a8c12165d571fa41">tempest-TaggedAttachmentsTest-382223691</nova:project>
Nov 15 02:44:42 user nova-compute[75391]:   </nova:owner>
Nov 15 02:44:42 user nova-compute[75391]:   <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:44:42 user nova-compute[75391]:   <nova:ports>
Nov 15 02:44:42 user nova-compute[75391]:     <nova:port uuid="86eacc9d-8245-4fa1-9a0a-a0a9f396872b">
Nov 15 02:44:42 user nova-compute[75391]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 02:44:42 user nova-compute[75391]:     </nova:port>
Nov 15 02:44:42 user nova-compute[75391]:     <nova:port uuid="34633d4d-5212-4738-847f-25acca40b074">
Nov 15 02:44:42 user nova-compute[75391]:       <nova:ip type="fixed" address="10.10.10.161" ipVersion="4"/>
Nov 15 02:44:42 user nova-compute[75391]:     </nova:port>
Nov 15 02:44:42 user nova-compute[75391]:   </nova:ports>
Nov 15 02:44:42 user nova-compute[75391]: </nova:instance>
Nov 15 02:44:42 user nova-compute[75391]:   </metadata>
Nov 15 02:44:42 user nova-compute[75391]:   <memory unit='KiB'>524288</memory>
Nov 15 02:44:42 user nova-compute[75391]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 02:44:42 user nova-compute[75391]:   <vcpu placement='static'>1</vcpu>
Nov 15 02:44:42 user nova-compute[75391]:   <resource>
Nov 15 02:44:42 user nova-compute[75391]:     <partition>/machine</partition>
Nov 15 02:44:42 user nova-compute[75391]:   </resource>
Nov 15 02:44:42 user nova-compute[75391]:   <sysinfo type='smbios'>
Nov 15 02:44:42 user nova-compute[75391]:     <system>
Nov 15 02:44:42 user nova-compute[75391]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 02:44:42 user nova-compute[75391]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 02:44:42 user nova-compute[75391]:       <entry name='version'>0.0.0</entry>
Nov 15 02:44:42 user nova-compute[75391]:       <entry name='serial'>bb472aa5-47dd-48d6-8e9f-e179afd1d8ec</entry>
Nov 15 02:44:42 user nova-compute[75391]:       <entry name='uuid'>bb472aa5-47dd-48d6-8e9f-e179afd1d8ec</entry>
Nov 15 02:44:42 user nova-compute[75391]:       <entry name='family'>Virtual Machine</entry>
Nov 15 02:44:42 user nova-compute[75391]:     </system>
Nov 15 02:44:42 user nova-compute[75391]:   </sysinfo>
Nov 15 02:44:42 user nova-compute[75391]:   <os>
Nov 15 02:44:42 user nova-compute[75391]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 02:44:42 user nova-compute[75391]:     <boot dev='hd'/>
Nov 15 02:44:42 user nova-compute[75391]:     <smbios mode='sysinfo'/>
Nov 15 02:44:42 user nova-compute[75391]:   </os>
Nov 15 02:44:42 user nova-compute[75391]:   <features>
Nov 15 02:44:42 user nova-compute[75391]:     <acpi/>
Nov 15 02:44:42 user nova-compute[75391]:     <apic/>
Nov 15 02:44:42 user nova-compute[75391]:     <vmcoreinfo state='on'/>
Nov 15 02:44:42 user nova-compute[75391]:   </features>
Nov 15 02:44:42 user nova-compute[75391]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 02:44:42 user nova-compute[75391]:     <model fallback='forbid'>Nehalem</model>
Nov 15 02:44:42 user nova-compute[75391]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 02:44:42 user nova-compute[75391]:     <feature policy='require' name='vme'/>
Nov 15 02:44:42 user nova-compute[75391]:     <feature policy='require' name='x2apic'/>
Nov 15 02:44:42 user nova-compute[75391]:     <feature policy='require' name='hypervisor'/>
Nov 15 02:44:42 user nova-compute[75391]:   </cpu>
Nov 15 02:44:42 user nova-compute[75391]:   <clock offset='utc'>
Nov 15 02:44:42 user nova-compute[75391]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 02:44:42 user nova-compute[75391]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 02:44:42 user nova-compute[75391]:     <timer name='hpet' present='no'/>
Nov 15 02:44:42 user nova-compute[75391]:   </clock>
Nov 15 02:44:42 user nova-compute[75391]:   <on_poweroff>destroy</on_poweroff>
Nov 15 02:44:42 user nova-compute[75391]:   <on_reboot>restart</on_reboot>
Nov 15 02:44:42 user nova-compute[75391]:   <on_crash>destroy</on_crash>
Nov 15 02:44:42 user nova-compute[75391]:   <devices>
Nov 15 02:44:42 user nova-compute[75391]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 02:44:42 user nova-compute[75391]:     <disk type='file' device='disk'>
Nov 15 02:44:42 user nova-compute[75391]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 02:44:42 user nova-compute[75391]:       <source file='/opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk' index='2'/>
Nov 15 02:44:42 user nova-compute[75391]:       <backingStore type='file' index='3'>
Nov 15 02:44:42 user nova-compute[75391]:         <format type='raw'/>
Nov 15 02:44:42 user nova-compute[75391]:         <source file='/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a'/>
Nov 15 02:44:42 user nova-compute[75391]:         <backingStore/>
Nov 15 02:44:42 user nova-compute[75391]:       </backingStore>
Nov 15 02:44:42 user nova-compute[75391]:       <target dev='vda' bus='virtio'/>
Nov 15 02:44:42 user nova-compute[75391]:       <alias name='virtio-disk0'/>
Nov 15 02:44:42 user nova-compute[75391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 02:44:42 user nova-compute[75391]:     </disk>
Nov 15 02:44:42 user nova-compute[75391]:     <disk type='file' device='cdrom'>
Nov 15 02:44:42 user nova-compute[75391]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 02:44:42 user nova-compute[75391]:       <source file='/opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk.config' index='1'/>
Nov 15 02:44:42 user nova-compute[75391]:       <backingStore/>
Nov 15 02:44:42 user nova-compute[75391]:       <target dev='hda' bus='ide'/>
Nov 15 02:44:42 user nova-compute[75391]:       <readonly/>
Nov 15 02:44:42 user nova-compute[75391]:       <alias name='ide0-0-0'/>
Nov 15 02:44:42 user nova-compute[75391]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 02:44:42 user nova-compute[75391]:     </disk>
Nov 15 02:44:42 user nova-compute[75391]:     <controller type='usb' index='0' model='none'>
Nov 15 02:44:42 user nova-compute[75391]:       <alias name='usb'/>
Nov 15 02:44:42 user nova-compute[75391]:     </controller>
Nov 15 02:44:42 user nova-compute[75391]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 02:44:42 user nova-compute[75391]:       <alias name='pci.0'/>
Nov 15 02:44:42 user nova-compute[75391]:     </controller>
Nov 15 02:44:42 user nova-compute[75391]:     <controller type='ide' index='0'>
Nov 15 02:44:42 user nova-compute[75391]:       <alias name='ide'/>
Nov 15 02:44:42 user nova-compute[75391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 02:44:42 user nova-compute[75391]:     </controller>
Nov 15 02:44:42 user nova-compute[75391]:     <interface type='ethernet'>
Nov 15 02:44:42 user nova-compute[75391]:       <mac address='fa:16:3e:08:66:14'/>
Nov 15 02:44:42 user nova-compute[75391]:       <target dev='tap86eacc9d-82'/>
Nov 15 02:44:42 user nova-compute[75391]:       <model type='virtio'/>
Nov 15 02:44:42 user nova-compute[75391]:       <mtu size='1442'/>
Nov 15 02:44:42 user nova-compute[75391]:       <alias name='net0'/>
Nov 15 02:44:42 user nova-compute[75391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 02:44:42 user nova-compute[75391]:     </interface>
Nov 15 02:44:42 user nova-compute[75391]:     <interface type='ethernet'>
Nov 15 02:44:42 user nova-compute[75391]:       <mac address='fa:16:3e:64:fc:ab'/>
Nov 15 02:44:42 user nova-compute[75391]:       <target dev='tap34633d4d-52'/>
Nov 15 02:44:42 user nova-compute[75391]:       <model type='virtio'/>
Nov 15 02:44:42 user nova-compute[75391]:       <mtu size='1442'/>
Nov 15 02:44:42 user nova-compute[75391]:       <alias name='net1'/>
Nov 15 02:44:42 user nova-compute[75391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 15 02:44:42 user nova-compute[75391]:     </interface>
Nov 15 02:44:42 user nova-compute[75391]:     <serial type='pty'>
Nov 15 02:44:42 user nova-compute[75391]:       <source path='/dev/pts/6'/>
Nov 15 02:44:42 user nova-compute[75391]:       <log file='/opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/console.log' append='off'/>
Nov 15 02:44:42 user nova-compute[75391]:       <target type='isa-serial' port='0'>
Nov 15 02:44:42 user nova-compute[75391]:         <model name='isa-serial'/>
Nov 15 02:44:42 user nova-compute[75391]:       </target>
Nov 15 02:44:42 user nova-compute[75391]:       <alias name='serial0'/>
Nov 15 02:44:42 user nova-compute[75391]:     </serial>
Nov 15 02:44:42 user nova-compute[75391]:     <console type='pty' tty='/dev/pts/6'>
Nov 15 02:44:42 user nova-compute[75391]:       <source path='/dev/pts/6'/>
Nov 15 02:44:42 user nova-compute[75391]:       <log file='/opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/console.log' append='off'/>
Nov 15 02:44:42 user nova-compute[75391]:       <target type='serial' port='0'/>
Nov 15 02:44:42 user nova-compute[75391]:       <alias name='serial0'/>
Nov 15 02:44:42 user nova-compute[75391]:     </console>
Nov 15 02:44:42 user nova-compute[75391]:     <input type='mouse' bus='ps2'>
Nov 15 02:44:42 user nova-compute[75391]:       <alias name='input0'/>
Nov 15 02:44:42 user nova-compute[75391]:     </input>
Nov 15 02:44:42 user nova-compute[75391]:     <input type='keyboard' bus='ps2'>
Nov 15 02:44:42 user nova-compute[75391]:       <alias name='input1'/>
Nov 15 02:44:42 user nova-compute[75391]:     </input>
Nov 15 02:44:42 user nova-compute[75391]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 15 02:44:42 user nova-compute[75391]:       <listen type='address' address='0.0.0.0'/>
Nov 15 02:44:42 user nova-compute[75391]:     </graphics>
Nov 15 02:44:42 user nova-compute[75391]:     <audio id='1' type='none'/>
Nov 15 02:44:42 user nova-compute[75391]:     <video>
Nov 15 02:44:42 user nova-compute[75391]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 02:44:42 user nova-compute[75391]:       <alias name='video0'/>
Nov 15 02:44:42 user nova-compute[75391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 02:44:42 user nova-compute[75391]:     </video>
Nov 15 02:44:42 user nova-compute[75391]:     <memballoon model='virtio'>
Nov 15 02:44:42 user nova-compute[75391]:       <stats period='10'/>
Nov 15 02:44:42 user nova-compute[75391]:       <alias name='balloon0'/>
Nov 15 02:44:42 user nova-compute[75391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 02:44:42 user nova-compute[75391]:     </memballoon>
Nov 15 02:44:42 user nova-compute[75391]:     <rng model='virtio'>
Nov 15 02:44:42 user nova-compute[75391]:       <backend model='random'>/dev/urandom</backend>
Nov 15 02:44:42 user nova-compute[75391]:       <alias name='rng0'/>
Nov 15 02:44:42 user nova-compute[75391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 02:44:42 user nova-compute[75391]:     </rng>
Nov 15 02:44:42 user nova-compute[75391]:   </devices>
Nov 15 02:44:42 user nova-compute[75391]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 02:44:42 user nova-compute[75391]:     <label>libvirt-bb472aa5-47dd-48d6-8e9f-e179afd1d8ec</label>
Nov 15 02:44:42 user nova-compute[75391]:     <imagelabel>libvirt-bb472aa5-47dd-48d6-8e9f-e179afd1d8ec</imagelabel>
Nov 15 02:44:42 user nova-compute[75391]:   </seclabel>
Nov 15 02:44:42 user nova-compute[75391]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 02:44:42 user nova-compute[75391]:     <label>+64055:+108</label>
Nov 15 02:44:42 user nova-compute[75391]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 02:44:42 user nova-compute[75391]:   </seclabel>
Nov 15 02:44:42 user nova-compute[75391]: </domain>
Nov 15 02:44:42 user nova-compute[75391]:  {{(pid=75391) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 02:44:42 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Successfully detached device tap34633d4d-52 from instance bb472aa5-47dd-48d6-8e9f-e179afd1d8ec from the persistent domain config.
Nov 15 02:44:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] (1/8): Attempting to detach device tap34633d4d-52 with device alias net1 from instance bb472aa5-47dd-48d6-8e9f-e179afd1d8ec from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 02:44:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] detach device xml: <interface type="ethernet">
Nov 15 02:44:42 user nova-compute[75391]:   <mac address="fa:16:3e:64:fc:ab"/>
Nov 15 02:44:42 user nova-compute[75391]:   <model type="virtio"/>
Nov 15 02:44:42 user nova-compute[75391]:   <mtu size="1442"/>
Nov 15 02:44:42 user nova-compute[75391]:   <target dev="tap34633d4d-52"/>
Nov 15 02:44:42 user nova-compute[75391]: </interface>
Nov 15 02:44:42 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:44:42 user nova-compute[75391]: DEBUG nova.objects.instance [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Lazy-loading 'flavor' on Instance uuid bc5c2514-d819-4792-afde-dfedc85e8e88 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:44:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-84681cd3-dcd4-4e80-8f5c-20a19c867cb9 tempest-VolumesAssistedSnapshotsTest-451939637 tempest-VolumesAssistedSnapshotsTest-451939637-project-admin] Lock "bc5c2514-d819-4792-afde-dfedc85e8e88" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.226s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] COPY block job progress, current cursor: 748683264 final cursor: 1073741824 {{(pid=75391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 02:44:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Start waiting for the detach event from libvirt for device tap34633d4d-52 with device alias net1 for instance bb472aa5-47dd-48d6-8e9f-e179afd1d8ec {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 02:44:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:43 user nova-compute[75391]: DEBUG nova.compute.manager [req-aba5b59d-d1d2-4a91-ba65-758696390ff0 req-8aec62f8-db48-4f63-933f-57d966908d6f service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Received event network-vif-unplugged-34633d4d-5212-4738-847f-25acca40b074 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-aba5b59d-d1d2-4a91-ba65-758696390ff0 req-8aec62f8-db48-4f63-933f-57d966908d6f service nova] Acquiring lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-aba5b59d-d1d2-4a91-ba65-758696390ff0 req-8aec62f8-db48-4f63-933f-57d966908d6f service nova] Lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-aba5b59d-d1d2-4a91-ba65-758696390ff0 req-8aec62f8-db48-4f63-933f-57d966908d6f service nova] Lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:43 user nova-compute[75391]: DEBUG nova.compute.manager [req-aba5b59d-d1d2-4a91-ba65-758696390ff0 req-8aec62f8-db48-4f63-933f-57d966908d6f service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] No waiting events found dispatching network-vif-unplugged-34633d4d-5212-4738-847f-25acca40b074 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:44:43 user nova-compute[75391]: WARNING nova.compute.manager [req-aba5b59d-d1d2-4a91-ba65-758696390ff0 req-8aec62f8-db48-4f63-933f-57d966908d6f service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Received unexpected event network-vif-unplugged-34633d4d-5212-4738-847f-25acca40b074 for instance with vm_state active and task_state None.
Nov 15 02:44:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] COPY block job progress, current cursor: 918552576 final cursor: 1073741824 {{(pid=75391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 02:44:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NkKUSbzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '5c1fa670-5821-477b-947b-717e4f3a25d8'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:44 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b470c34b-58ea-4e57-b49e-e26cab3a7e07]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:44:44 user nova-compute[75391]: No targets found.
Nov 15 02:44:44 user nova-compute[75391]: iSNS:
Nov 15 02:44:44 user nova-compute[75391]: No targets found.
Nov 15 02:44:44 user nova-compute[75391]: STATIC:
Nov 15 02:44:44 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40
Nov 15 02:44:44 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:44 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:44 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8
Nov 15 02:44:44 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:44 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:44 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b
Nov 15 02:44:44 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:44:44 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:44:44 user nova-compute[75391]: FIRMWARE:
Nov 15 02:44:44 user nova-compute[75391]: No targets found.
Nov 15 02:44:44 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:44:44 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:44:44 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[379e97ea-e8ca-46cf-9367-41a1044f97b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f11b05-13d4-4589-a563-fcfe86442344]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)
Nov 15 02:44:44 user nova-compute[75391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:44 user nova-compute[75391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:44 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 (non-flash)
Nov 15 02:44:44 user nova-compute[75391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:44 user nova-compute[75391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:44 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f624475a050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8'): ({'sdk'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Removing single pathed devices sdk {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d546c4cb-1ac6-4819-9573-d5d38c57b938]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2967b47c-0575-40ac-bf03-1a5d07646d92]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Flushing IO for device /dev/sdk {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.013s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1220c7f-01c4-4252-b2f0-20be9dc8131d]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.044s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f725a71-f764-49b0-8920-1271e07e805c]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] SCSI volumes sdk have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c1e92c-df76-43e5-86f4-678f35719d97]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a666d5d-d07b-41b8-b7d5-ca1771871376]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8, portal: 172.16.0.220,3260]
Nov 15 02:44:44 user nova-compute[75391]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8, portal: 172.16.0.220,3260] successful.
Nov 15 02:44:44 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1fa670-5821-477b-947b-717e4f3a25d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[de55894c-2c40-4124-98b7-8a832d7d7247]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] <== disconnect_volume: return (322ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG nova.compute.manager [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sgwDFGfo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '1fc39b27-762e-4bc8-90ba-0215d65710ec', 'attached_at': '', 'detached_at': '', 'volume_id': 'f76e360b-eb5e-47bb-ae1a-9acd86e55d1b', 'serial'} {{(pid=75391) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 15 02:44:44 user nova-compute[75391]: DEBUG nova.compute.manager [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] swap_volume: removing Cinder connection for volume 5c1fa670-5821-477b-947b-717e4f3a25d8 {{(pid=75391) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 15 02:44:45 user nova-compute[75391]: DEBUG nova.compute.manager [req-c7a460d1-bbd5-4fc5-ad80-a64fd70a0924 req-9936f384-47ac-4863-a12d-2bf2f983c729 service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Received event network-vif-plugged-34633d4d-5212-4738-847f-25acca40b074 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c7a460d1-bbd5-4fc5-ad80-a64fd70a0924 req-9936f384-47ac-4863-a12d-2bf2f983c729 service nova] Acquiring lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c7a460d1-bbd5-4fc5-ad80-a64fd70a0924 req-9936f384-47ac-4863-a12d-2bf2f983c729 service nova] Lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c7a460d1-bbd5-4fc5-ad80-a64fd70a0924 req-9936f384-47ac-4863-a12d-2bf2f983c729 service nova] Lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:45 user nova-compute[75391]: DEBUG nova.compute.manager [req-c7a460d1-bbd5-4fc5-ad80-a64fd70a0924 req-9936f384-47ac-4863-a12d-2bf2f983c729 service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] No waiting events found dispatching network-vif-plugged-34633d4d-5212-4738-847f-25acca40b074 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:44:45 user nova-compute[75391]: WARNING nova.compute.manager [req-c7a460d1-bbd5-4fc5-ad80-a64fd70a0924 req-9936f384-47ac-4863-a12d-2bf2f983c729 service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Received unexpected event network-vif-plugged-34633d4d-5212-4738-847f-25acca40b074 for instance with vm_state active and task_state None.
Nov 15 02:44:45 user nova-compute[75391]: DEBUG nova.compute.manager [req-3b0f5ae1-f7ce-417d-84b4-216f29d61a17 req-663bad19-fcf2-4270-b79c-bcefca2672bd service nova] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Received event network-changed-b89e475f-2d05-4427-81aa-64a19c9664ee {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:45 user nova-compute[75391]: DEBUG nova.compute.manager [req-3b0f5ae1-f7ce-417d-84b4-216f29d61a17 req-663bad19-fcf2-4270-b79c-bcefca2672bd service nova] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Refreshing instance network info cache due to event network-changed-b89e475f-2d05-4427-81aa-64a19c9664ee. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:44:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3b0f5ae1-f7ce-417d-84b4-216f29d61a17 req-663bad19-fcf2-4270-b79c-bcefca2672bd service nova] Acquiring lock "refresh_cache-38a63a30-a3bc-4556-9fb6-53522dbf2c68" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:44:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3b0f5ae1-f7ce-417d-84b4-216f29d61a17 req-663bad19-fcf2-4270-b79c-bcefca2672bd service nova] Acquired lock "refresh_cache-38a63a30-a3bc-4556-9fb6-53522dbf2c68" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:44:45 user nova-compute[75391]: DEBUG nova.network.neutron [req-3b0f5ae1-f7ce-417d-84b4-216f29d61a17 req-663bad19-fcf2-4270-b79c-bcefca2672bd service nova] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Refreshing network info cache for port b89e475f-2d05-4427-81aa-64a19c9664ee {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:44:45 user nova-compute[75391]: DEBUG nova.compute.manager [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] swap_volume: Updating volume 5c1fa670-5821-477b-947b-717e4f3a25d8 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "sgwDFGfo", "auth_password": "ivyBfeFZCATNgn", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "f76e360b-eb5e-47bb-ae1a-9acd86e55d1b"}, "status": "reserved", "instance": "1fc39b27-762e-4bc8-90ba-0215d65710ec", "attached_at": "", "detached_at": "", "volume_id": "f76e360b-eb5e-47bb-ae1a-9acd86e55d1b", "serial": "f76e360b-eb5e-47bb-ae1a-9acd86e55d1b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'f76e360b-eb5e-47bb-ae1a-9acd86e55d1b', 'no_device': None, 'attachment_id': 'b5865303-6752-4a64-90f0-81c5a7ac13ee'} {{(pid=75391) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 15 02:44:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1e6e5ad1-da49-46f9-bc26-8699e34d1f12 tempest-TestVolumeSwap-1704223832 tempest-TestVolumeSwap-1704223832-project-admin] Lock "1fc39b27-762e-4bc8-90ba-0215d65710ec" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.651s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG nova.objects.instance [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lazy-loading 'flavor' on Instance uuid 38a63a30-a3bc-4556-9fb6-53522dbf2c68 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG nova.network.neutron [req-3b0f5ae1-f7ce-417d-84b4-216f29d61a17 req-663bad19-fcf2-4270-b79c-bcefca2672bd service nova] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Updated VIF entry in instance network info cache for port b89e475f-2d05-4427-81aa-64a19c9664ee. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG nova.network.neutron [req-3b0f5ae1-f7ce-417d-84b4-216f29d61a17 req-663bad19-fcf2-4270-b79c-bcefca2672bd service nova] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Updating instance_info_cache with network_info: [{"id": "b89e475f-2d05-4427-81aa-64a19c9664ee", "address": "fa:16:3e:8f:aa:98", "network": {"id": "5567560c-b3c5-4802-b758-92d672458351", "bridge": "br-int", "label": "tempest-TestStampPattern-268456575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e0ca1f6ce542a482164410c5e67e13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89e475f-2d", "ovs_interfaceid": "b89e475f-2d05-4427-81aa-64a19c9664ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3b0f5ae1-f7ce-417d-84b4-216f29d61a17 req-663bad19-fcf2-4270-b79c-bcefca2672bd service nova] Releasing lock "refresh_cache-38a63a30-a3bc-4556-9fb6-53522dbf2c68" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:46 user nova-compute[75391]: INFO nova.compute.manager [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Attaching volume 7803467e-bc05-49f4-9a9f-3b48ce2b0502 to /dev/vdb
Nov 15 02:44:46 user nova-compute[75391]: DEBUG os_brick.utils [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b099ac0-7e98-40bf-9e92-89399846e65f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4f36b5-1d29-4528-8526-9b61a95f6146]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a35fbb-6ebc-4fa0-9aed-124accc3702a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[93391c9b-c25e-425d-a081-fb62594d01f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:44:46 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:44:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbb99c5-5677-4ac4-b19a-23075c0ca1b1]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG os_brick.utils [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Updating existing volume attachment record: ebd04e0d-fdaf-4c6a-ae2a-e91167135ab0 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Acquiring lock "1fc39b27-762e-4bc8-90ba-0215d65710ec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lock "1fc39b27-762e-4bc8-90ba-0215d65710ec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:46 user nova-compute[75391]: INFO nova.compute.manager [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Detaching volume f76e360b-eb5e-47bb-ae1a-9acd86e55d1b
Nov 15 02:44:46 user nova-compute[75391]: INFO nova.virt.block_device [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Attempting to driver detach volume f76e360b-eb5e-47bb-ae1a-9acd86e55d1b from mountpoint /dev/vdb
Nov 15 02:44:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Attempting to detach device vdb from instance 1fc39b27-762e-4bc8-90ba-0215d65710ec from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:44:46 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:44:46 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 02:44:46 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:44:46 user nova-compute[75391]:   <serial>f76e360b-eb5e-47bb-ae1a-9acd86e55d1b</serial>
Nov 15 02:44:46 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:44:46 user nova-compute[75391]: </disk>
Nov 15 02:44:46 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:44:46 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Successfully detached device vdb from instance 1fc39b27-762e-4bc8-90ba-0215d65710ec from the persistent domain config.
Nov 15 02:44:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1fc39b27-762e-4bc8-90ba-0215d65710ec from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:44:46 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:44:46 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 02:44:46 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:44:46 user nova-compute[75391]:   <serial>f76e360b-eb5e-47bb-ae1a-9acd86e55d1b</serial>
Nov 15 02:44:46 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:44:46 user nova-compute[75391]: </disk>
Nov 15 02:44:46 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "6400a5f3-0ec9-4484-930c-1f5061ae5374" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG nova.compute.manager [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:46 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:44:46 user nova-compute[75391]: INFO nova.compute.claims [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Claim successful on node user
Nov 15 02:44:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1fc39b27-762e-4bc8-90ba-0215d65710ec {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 02:44:47 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:44:47 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:44:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:47 user nova-compute[75391]: DEBUG nova.compute.manager [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:44:47 user nova-compute[75391]: DEBUG nova.compute.manager [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:44:47 user nova-compute[75391]: DEBUG nova.network.neutron [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:44:47 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:44:47 user nova-compute[75391]: DEBUG nova.compute.manager [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:44:47 user nova-compute[75391]: DEBUG nova.policy [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0aa106a59c374dde99b7697f94407339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63a88a9fe824c3e9c0807a50b569d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:44:47 user nova-compute[75391]: INFO nova.virt.block_device [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Booting with blank volume at /dev/vda
Nov 15 02:44:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:47 user nova-compute[75391]: DEBUG nova.network.neutron [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Successfully created port: 95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:44:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:48 user nova-compute[75391]: DEBUG nova.network.neutron [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Successfully updated port: 95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:44:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "refresh_cache-6400a5f3-0ec9-4484-930c-1f5061ae5374" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:44:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquired lock "refresh_cache-6400a5f3-0ec9-4484-930c-1f5061ae5374" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:44:48 user nova-compute[75391]: DEBUG nova.network.neutron [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:44:48 user nova-compute[75391]: DEBUG nova.compute.manager [req-bdd42c68-a5a7-40c4-b385-99fd9fc5e3e3 req-612c0d96-7d75-480c-95a7-7dd51ed2890b service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Received event network-changed-95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:44:48 user nova-compute[75391]: DEBUG nova.compute.manager [req-bdd42c68-a5a7-40c4-b385-99fd9fc5e3e3 req-612c0d96-7d75-480c-95a7-7dd51ed2890b service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Refreshing instance network info cache due to event network-changed-95f803b5-4e7b-4463-aca1-39b54dbc7de9. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:44:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bdd42c68-a5a7-40c4-b385-99fd9fc5e3e3 req-612c0d96-7d75-480c-95a7-7dd51ed2890b service nova] Acquiring lock "refresh_cache-6400a5f3-0ec9-4484-930c-1f5061ae5374" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:44:48 user nova-compute[75391]: DEBUG nova.network.neutron [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:44:49 user nova-compute[75391]: DEBUG nova.network.neutron [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Updating instance_info_cache with network_info: [{"id": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "address": "fa:16:3e:84:8e:2f", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f803b5-4e", "ovs_interfaceid": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:44:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Releasing lock "refresh_cache-6400a5f3-0ec9-4484-930c-1f5061ae5374" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:44:49 user nova-compute[75391]: DEBUG nova.compute.manager [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Instance network_info: |[{"id": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "address": "fa:16:3e:84:8e:2f", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f803b5-4e", "ovs_interfaceid": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:44:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bdd42c68-a5a7-40c4-b385-99fd9fc5e3e3 req-612c0d96-7d75-480c-95a7-7dd51ed2890b service nova] Acquired lock "refresh_cache-6400a5f3-0ec9-4484-930c-1f5061ae5374" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:44:49 user nova-compute[75391]: DEBUG nova.network.neutron [req-bdd42c68-a5a7-40c4-b385-99fd9fc5e3e3 req-612c0d96-7d75-480c-95a7-7dd51ed2890b service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Refreshing network info cache for port 95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:44:49 user nova-compute[75391]: DEBUG nova.network.neutron [req-bdd42c68-a5a7-40c4-b385-99fd9fc5e3e3 req-612c0d96-7d75-480c-95a7-7dd51ed2890b service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Updated VIF entry in instance network info cache for port 95f803b5-4e7b-4463-aca1-39b54dbc7de9. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:44:49 user nova-compute[75391]: DEBUG nova.network.neutron [req-bdd42c68-a5a7-40c4-b385-99fd9fc5e3e3 req-612c0d96-7d75-480c-95a7-7dd51ed2890b service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Updating instance_info_cache with network_info: [{"id": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "address": "fa:16:3e:84:8e:2f", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f803b5-4e", "ovs_interfaceid": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:44:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bdd42c68-a5a7-40c4-b385-99fd9fc5e3e3 req-612c0d96-7d75-480c-95a7-7dd51ed2890b service nova] Releasing lock "refresh_cache-6400a5f3-0ec9-4484-930c-1f5061ae5374" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hEBPTxco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:51 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:51 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:51 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4e406b-5fb0-4c83-8d03-ec58158b5dc1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:44:51 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ef2411-2af6-496d-8375-b19e5205e4e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502] added
Nov 15 02:44:51 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7766a068-e349-42fd-b811-5a68467cc16e]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d4490d-2417-4392-8167-8ed2e2cec886]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hEBPTxco {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hEBPTxco" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7767522a-e3f7-48e7-a5a7-7c9f7be022d5]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hEBPTxco'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5b56fa-42dd-45c5-9843-0edfd9e1c0c5]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[604ffd61-1cc4-4f58-8432-882888433ab7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:51 user nova-compute[75391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:51 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:51 user nova-compute[75391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:51 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[022920f5-8580-4b44-97d6-c69205fa7e80]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502, portal: 172.16.0.220,3260]
Nov 15 02:44:51 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502, portal: 172.16.0.220,3260] successful.
Nov 15 02:44:51 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adaca13-a13f-4827-b8b2-0a908201a719]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-fc9484c0-9083-4797-8ab1-2ad392822ce8" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-fc9484c0-9083-4797-8ab1-2ad392822ce8" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[329a9567-d449-429b-8f24-9967567127e4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:51 user nova-compute[75391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:51 user nova-compute[75391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)
Nov 15 02:44:51 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:51 user nova-compute[75391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:51 user nova-compute[75391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)
Nov 15 02:44:51 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d66ec52-04eb-48a3-9327-ecb297d0244b]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: None {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "25884e14-afa3-4e5d-8154-a9e9eb455b94" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG nova.objects.instance [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lazy-loading 'flavor' on Instance uuid 25884e14-afa3-4e5d-8154-a9e9eb455b94 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "25884e14-afa3-4e5d-8154-a9e9eb455b94" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:51 user nova-compute[75391]: INFO nova.compute.manager [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Attaching volume ecf120b3-e9f4-444f-9a88-9284f626152b to /dev/vdb
Nov 15 02:44:51 user nova-compute[75391]: DEBUG os_brick.utils [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6249e0b7-aa21-454f-adc4-83170794a1f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac4dd6a-2ee2-4a53-a29c-022f938a8da3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[70397acd-3d87-4ad8-a79f-ad45c69d062e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dd775e-b92e-41f7-a059-679531d270fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:44:52 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:44:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[843f7ce5-ee76-422c-88f6-42726806071b]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG os_brick.utils [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Updating existing volume attachment record: f4525567-94f6-436a-b4cc-d6172620210c {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Updating instance_info_cache with network_info: [{"id": "d8f34e4c-5c99-45eb-a282-a721a2019209", "address": "fa:16:3e:ca:58:46", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f34e4c-5c", "ovs_interfaceid": "d8f34e4c-5c99-45eb-a282-a721a2019209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-fc9484c0-9083-4797-8ab1-2ad392822ce8" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hEBPTxco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26234343565656633', 'path': '/dev/sdd'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234343565656633', 'path': '/dev/sdd'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG nova.objects.instance [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lazy-loading 'flavor' on Instance uuid 38a63a30-a3bc-4556-9fb6-53522dbf2c68 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 02:44:52 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:44:52 user nova-compute[75391]:   <source dev="/dev/sdd"/>
Nov 15 02:44:52 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:44:52 user nova-compute[75391]:   <serial>7803467e-bc05-49f4-9a9f-3b48ce2b0502</serial>
Nov 15 02:44:52 user nova-compute[75391]: </disk>
Nov 15 02:44:52 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5c2514-d819-4792-afde-dfedc85e8e88/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG os_brick.utils [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[46170988-8d81-408f-8b93-acef65d44e5f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[073b546b-3bc6-4deb-86da-5b4323d35d3c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb215b0f-8b1e-40d1-9899-17284f36611e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db345b3-c18c-4276-85a7-d804744c3de9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:44:53 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:44:53 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afdc09b-f258-43f3-ab70-9e0a0389c8a3]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG os_brick.utils [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Updating existing volume attachment record: 87928730-295b-45e8-8654-fe5ae57d474e {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5c2514-d819-4792-afde-dfedc85e8e88/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5c2514-d819-4792-afde-dfedc85e8e88/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc5c2514-d819-4792-afde-dfedc85e8e88/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc39b27-762e-4bc8-90ba-0215d65710ec/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] No VIF found with MAC fa:16:3e:8f:aa:98, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc39b27-762e-4bc8-90ba-0215d65710ec/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc39b27-762e-4bc8-90ba-0215d65710ec/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc39b27-762e-4bc8-90ba-0215d65710ec/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-18e3484f-41a2-4da1-8df6-83712206d77e tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.857s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:44:56 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:44:56 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:44:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=7282MB free_disk=25.2896728515625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:44:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9744c8a1-046e-4a00-92e0-92ebb3275ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:44:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance ebb7e616-3c05-4d99-a0b3-76dc1723e82d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:44:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance fc9484c0-9083-4797-8ab1-2ad392822ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:44:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:44:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 60093cdf-015e-4c39-a514-1818a6e55385 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:44:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance bb472aa5-47dd-48d6-8e9f-e179afd1d8ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:44:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 1fc39b27-762e-4bc8-90ba-0215d65710ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:44:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance bc5c2514-d819-4792-afde-dfedc85e8e88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:44:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 38a63a30-a3bc-4556-9fb6-53522dbf2c68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:44:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 25884e14-afa3-4e5d-8154-a9e9eb455b94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:44:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6400a5f3-0ec9-4484-930c-1f5061ae5374 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:44:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:44:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:44:56 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:44:56 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:44:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:44:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.533s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:57 user nova-compute[75391]: INFO nova.compute.manager [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Detaching volume 7803467e-bc05-49f4-9a9f-3b48ce2b0502
Nov 15 02:44:57 user nova-compute[75391]: INFO nova.virt.block_device [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Attempting to driver detach volume 7803467e-bc05-49f4-9a9f-3b48ce2b0502 from mountpoint /dev/vdb
Nov 15 02:44:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Attempting to detach device vdb from instance 38a63a30-a3bc-4556-9fb6-53522dbf2c68 from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:44:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:44:57 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:44:57 user nova-compute[75391]:   <source dev="/dev/sdd"/>
Nov 15 02:44:57 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:44:57 user nova-compute[75391]:   <serial>7803467e-bc05-49f4-9a9f-3b48ce2b0502</serial>
Nov 15 02:44:57 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:44:57 user nova-compute[75391]: </disk>
Nov 15 02:44:57 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:44:57 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Successfully detached device vdb from instance 38a63a30-a3bc-4556-9fb6-53522dbf2c68 from the persistent domain config.
Nov 15 02:44:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 38a63a30-a3bc-4556-9fb6-53522dbf2c68 from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 02:44:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:44:57 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:44:57 user nova-compute[75391]:   <source dev="/dev/sdd"/>
Nov 15 02:44:57 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:44:57 user nova-compute[75391]:   <serial>7803467e-bc05-49f4-9a9f-3b48ce2b0502</serial>
Nov 15 02:44:57 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:44:57 user nova-compute[75391]: </disk>
Nov 15 02:44:57 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:44:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 38a63a30-a3bc-4556-9fb6-53522dbf2c68 {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 02:44:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JMOTbEVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:58 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:58 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:58 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4120662-ad67-4ebb-b4bd-a5bffcec78e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:44:58 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0155b23d-573e-4f58-ad79-e3212b17d675]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b] added
Nov 15 02:44:58 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f64d15-32d0-4fb4-9979-b27702c793b7]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42605a1-a9b4-46bd-82d1-68c46509b364]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JMOTbEVU {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JMOTbEVU" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2b0bad-c9bd-4b59-b78c-6c9c10ffb405]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JMOTbEVU'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3288eed7-75ed-49d8-9108-f1622ad22276]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de1ccf7-fa19-414d-ab9b-75e70e633a5b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:58 user nova-compute[75391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:58 user nova-compute[75391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)
Nov 15 02:44:58 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:58 user nova-compute[75391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:58 user nova-compute[75391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)
Nov 15 02:44:58 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3f0ff7-55c4-4553-ba2e-b0977ec2ae05]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b, portal: 172.16.0.220,3260]
Nov 15 02:44:58 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b, portal: 172.16.0.220,3260] successful.
Nov 15 02:44:58 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b049c7c2-6051-4ce6-8b24-2b48f8524407]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cdc5e1-ea26-4c72-9fc8-bbf57ff6dcf0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:58 user nova-compute[75391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:58 user nova-compute[75391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)
Nov 15 02:44:58 user nova-compute[75391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:44:58 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:58 user nova-compute[75391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:58 user nova-compute[75391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)
Nov 15 02:44:58 user nova-compute[75391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:44:58 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[83db3207-6d36-4308-8d43-e73ea850f19b]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JMOTbEVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:44:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG nova.compute.manager [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:44:59 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Creating image(s)
Nov 15 02:44:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Did not create local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Ensure instance console log exists: /opt/stack/data/nova/instances/6400a5f3-0ec9-4484-930c-1f5061ae5374/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Start _get_guest_xml network_info=[{"id": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "address": "fa:16:3e:84:8e:2f", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f803b5-4e", "ovs_interfaceid": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '87928730-295b-45e8-8654-fe5ae57d474e', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gjWowTAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6400a5f3-0ec9-4484-930c-1f5061ae5374', 'attached_at': '', 'detached_at': '', 'volume_id': 'af618bdf-b151-451b-a7a8-62f1a5270a1f', 'serial': 'af618bdf-b151-451b-a7a8-62f1a5270a1f'}, 'volume_type': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:44:59 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:44:59 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:44:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gjWowTAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:44:59 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26461663636646466', 'path': '/dev/sde'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461663636646466', 'path': '/dev/sde'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.181s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:59 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:44:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:44:59 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:44:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG nova.objects.instance [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lazy-loading 'flavor' on Instance uuid 25884e14-afa3-4e5d-8154-a9e9eb455b94 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[373e8795-7a14-498a-847c-89530a6565a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:44:59 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 02:44:59 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:44:59 user nova-compute[75391]:   <source dev="/dev/sde"/>
Nov 15 02:44:59 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:44:59 user nova-compute[75391]:   <serial>ecf120b3-e9f4-444f-9a88-9284f626152b</serial>
Nov 15 02:44:59 user nova-compute[75391]: </disk>
Nov 15 02:44:59 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbbc5f4-7eed-4382-b6e1-d775e3794762]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f] added
Nov 15 02:44:59 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.112s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c863fdbf-6a52-4f9b-a47f-7e08063c9c3b]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[745af5e6-7aaa-4541-90f3-0b7db9b31277]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gjWowTAY {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gjWowTAY" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eea5e2a-d957-4afd-94e4-90534f81206c]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gjWowTAY'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d540486-2077-4b86-bcef-1b56ba0bb5de]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5718b9-9a40-45b0-b2d2-a825e013456e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:59 user nova-compute[75391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:59 user nova-compute[75391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)
Nov 15 02:44:59 user nova-compute[75391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:44:59 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:44:59 user nova-compute[75391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:44:59 user nova-compute[75391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)
Nov 15 02:44:59 user nova-compute[75391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:44:59 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:44:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[654dfc44-baeb-49ca-99fe-d678eecead41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f, portal: 172.16.0.220,3260]
Nov 15 02:45:00 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f, portal: 172.16.0.220,3260] successful.
Nov 15 02:45:00 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac444256-b5b1-48a3-afcf-679a2e385cbd]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ccf22c-a067-48a6-a38a-5b3b1a8a5107]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:45:00 user nova-compute[75391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:45:00 user nova-compute[75391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)
Nov 15 02:45:00 user nova-compute[75391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:45:00 user nova-compute[75391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:45:00 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:45:00 user nova-compute[75391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:45:00 user nova-compute[75391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)
Nov 15 02:45:00 user nova-compute[75391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:45:00 user nova-compute[75391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:45:00 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.397s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] HCTL ('37', '-', '-', 0) found on session 17 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1652856b-be8d-4238-a411-d1dc92b4eecd]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Searching for a device in session 17 and hctl ['37', '*', '*', 0] yield: None {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] No VIF found with MAC fa:16:3e:6b:28:6d, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-95c14739-bb0e-4802-b7fb-f24a90af74ca tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.491s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Acquiring lock "6a3cee20-521e-4998-8744-f8bf83586176" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "6a3cee20-521e-4998-8744-f8bf83586176" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG nova.compute.manager [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:45:01 user nova-compute[75391]: INFO nova.compute.claims [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Claim successful on node user
Nov 15 02:45:01 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Searching for a device in session 17 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gjWowTAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.429s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] <== connect_volume: return (1611ms) {'type': 'block', 'scsi_wwn': '23639303833396362', 'path': '/dev/sdf'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639303833396362', 'path': '/dev/sdf'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2096192783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2096192783',id=13,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e63a88a9fe824c3e9c0807a50b569d54',ramdisk_id='',reservation_id='r-spxo8j0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-141063167',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:44:47Z,user_data=None,user_id='0aa106a59c374dde99b7697f94407339',uuid=6400a5f3-0ec9-4484-930c-1f5061ae5374,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "address": "fa:16:3e:84:8e:2f", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f803b5-4e", "ovs_interfaceid": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Converting VIF {"id": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "address": "fa:16:3e:84:8e:2f", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f803b5-4e", "ovs_interfaceid": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:8e:2f,bridge_name='br-int',has_traffic_filtering=True,id=95f803b5-4e7b-4463-aca1-39b54dbc7de9,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f803b5-4e') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG nova.objects.instance [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lazy-loading 'pci_devices' on Instance uuid 6400a5f3-0ec9-4484-930c-1f5061ae5374 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:45:01 user nova-compute[75391]:   <uuid>6400a5f3-0ec9-4484-930c-1f5061ae5374</uuid>
Nov 15 02:45:01 user nova-compute[75391]:   <name>instance-0000000d</name>
Nov 15 02:45:01 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:45:01 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:45:01 user nova-compute[75391]:   <metadata>
Nov 15 02:45:01 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:45:01 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:45:01 user nova-compute[75391]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2096192783</nova:name>
Nov 15 02:45:01 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:44:59</nova:creationTime>
Nov 15 02:45:01 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:45:01 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:45:01 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:45:01 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:45:01 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:45:01 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:45:01 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:45:01 user nova-compute[75391]:       <nova:owner>
Nov 15 02:45:01 user nova-compute[75391]:         <nova:user uuid="0aa106a59c374dde99b7697f94407339">tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member</nova:user>
Nov 15 02:45:01 user nova-compute[75391]:         <nova:project uuid="e63a88a9fe824c3e9c0807a50b569d54">tempest-ServerBootFromVolumeStableRescueTest-141063167</nova:project>
Nov 15 02:45:01 user nova-compute[75391]:       </nova:owner>
Nov 15 02:45:01 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:45:01 user nova-compute[75391]:       <nova:ports>
Nov 15 02:45:01 user nova-compute[75391]:         <nova:port uuid="95f803b5-4e7b-4463-aca1-39b54dbc7de9">
Nov 15 02:45:01 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 02:45:01 user nova-compute[75391]:         </nova:port>
Nov 15 02:45:01 user nova-compute[75391]:       </nova:ports>
Nov 15 02:45:01 user nova-compute[75391]:     </nova:instance>
Nov 15 02:45:01 user nova-compute[75391]:   </metadata>
Nov 15 02:45:01 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:45:01 user nova-compute[75391]:     <system>
Nov 15 02:45:01 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:45:01 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:45:01 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:45:01 user nova-compute[75391]:       <entry name="serial">6400a5f3-0ec9-4484-930c-1f5061ae5374</entry>
Nov 15 02:45:01 user nova-compute[75391]:       <entry name="uuid">6400a5f3-0ec9-4484-930c-1f5061ae5374</entry>
Nov 15 02:45:01 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:45:01 user nova-compute[75391]:     </system>
Nov 15 02:45:01 user nova-compute[75391]:   </sysinfo>
Nov 15 02:45:01 user nova-compute[75391]:   <os>
Nov 15 02:45:01 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:45:01 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:45:01 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:45:01 user nova-compute[75391]:   </os>
Nov 15 02:45:01 user nova-compute[75391]:   <features>
Nov 15 02:45:01 user nova-compute[75391]:     <acpi/>
Nov 15 02:45:01 user nova-compute[75391]:     <apic/>
Nov 15 02:45:01 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:45:01 user nova-compute[75391]:   </features>
Nov 15 02:45:01 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:45:01 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:45:01 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:45:01 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:45:01 user nova-compute[75391]:   </clock>
Nov 15 02:45:01 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:45:01 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:45:01 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:45:01 user nova-compute[75391]:   </cpu>
Nov 15 02:45:01 user nova-compute[75391]:   <devices>
Nov 15 02:45:01 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 02:45:01 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:45:01 user nova-compute[75391]:       <source dev="/dev/sdf"/>
Nov 15 02:45:01 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:45:01 user nova-compute[75391]:       <serial>af618bdf-b151-451b-a7a8-62f1a5270a1f</serial>
Nov 15 02:45:01 user nova-compute[75391]:     </disk>
Nov 15 02:45:01 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:45:01 user nova-compute[75391]:       <mac address="fa:16:3e:84:8e:2f"/>
Nov 15 02:45:01 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:45:01 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:45:01 user nova-compute[75391]:       <target dev="tap95f803b5-4e"/>
Nov 15 02:45:01 user nova-compute[75391]:     </interface>
Nov 15 02:45:01 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:45:01 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/6400a5f3-0ec9-4484-930c-1f5061ae5374/console.log" append="off"/>
Nov 15 02:45:01 user nova-compute[75391]:     </serial>
Nov 15 02:45:01 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:45:01 user nova-compute[75391]:     <video>
Nov 15 02:45:01 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:45:01 user nova-compute[75391]:     </video>
Nov 15 02:45:01 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:45:01 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:45:01 user nova-compute[75391]:     </rng>
Nov 15 02:45:01 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:45:01 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:45:01 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:45:01 user nova-compute[75391]:     </memballoon>
Nov 15 02:45:01 user nova-compute[75391]:   </devices>
Nov 15 02:45:01 user nova-compute[75391]: </domain>
Nov 15 02:45:01 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2096192783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2096192783',id=13,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e63a88a9fe824c3e9c0807a50b569d54',ramdisk_id='',reservation_id='r-spxo8j0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-141063167',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:44:47Z,user_data=None,user_id='0aa106a59c374dde99b7697f94407339',uuid=6400a5f3-0ec9-4484-930c-1f5061ae5374,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "address": "fa:16:3e:84:8e:2f", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f803b5-4e", "ovs_interfaceid": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Converting VIF {"id": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "address": "fa:16:3e:84:8e:2f", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f803b5-4e", "ovs_interfaceid": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:8e:2f,bridge_name='br-int',has_traffic_filtering=True,id=95f803b5-4e7b-4463-aca1-39b54dbc7de9,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f803b5-4e') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG os_vif [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:8e:2f,bridge_name='br-int',has_traffic_filtering=True,id=95f803b5-4e7b-4463-aca1-39b54dbc7de9,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f803b5-4e') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9bd6009e-2aa5-5e52-a197-8e7e0248823d', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95f803b5-4e, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap95f803b5-4e, col_values=(('qos', UUID('e7667068-d3fe-4207-bde4-78eb8809b658')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap95f803b5-4e, col_values=(('external_ids', {'iface-id': '95f803b5-4e7b-4463-aca1-39b54dbc7de9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:8e:2f', 'vm-uuid': '6400a5f3-0ec9-4484-930c-1f5061ae5374'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:01 user nova-compute[75391]: INFO os_vif [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:8e:2f,bridge_name='br-int',has_traffic_filtering=True,id=95f803b5-4e7b-4463-aca1-39b54dbc7de9,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f803b5-4e')
Nov 15 02:45:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] No VIF found with MAC fa:16:3e:84:8e:2f, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.576s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG nova.compute.manager [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG nova.compute.manager [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG nova.network.neutron [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:45:01 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:45:01 user nova-compute[75391]: DEBUG nova.compute.manager [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG nova.policy [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f67781b1c37f4b7dbabdfa16d7b891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9265d1e4bccb467fbf0c738844d8735b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG nova.compute.manager [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:45:01 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Creating image(s)
Nov 15 02:45:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a3cee20-521e-4998-8744-f8bf83586176/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "/opt/stack/data/nova/instances/6a3cee20-521e-4998-8744-f8bf83586176/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "/opt/stack/data/nova/instances/6a3cee20-521e-4998-8744-f8bf83586176/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.176s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.184s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/6a3cee20-521e-4998-8744-f8bf83586176/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/6a3cee20-521e-4998-8744-f8bf83586176/disk 1073741824" returned: 0 in 0.059s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG nova.network.neutron [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Successfully created port: 162c733f-2235-48db-b812-5ad67decada5 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.173s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a3cee20-521e-4998-8744-f8bf83586176/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a3cee20-521e-4998-8744-f8bf83586176/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a3cee20-521e-4998-8744-f8bf83586176/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Cannot resize image /opt/stack/data/nova/instances/6a3cee20-521e-4998-8744-f8bf83586176/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Ensure instance console log exists: /opt/stack/data/nova/instances/6a3cee20-521e-4998-8744-f8bf83586176/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:02 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Waiting for libvirt event about the detach of device tap34633d4d-52 with device alias net1 from instance bb472aa5-47dd-48d6-8e9f-e179afd1d8ec is timed out.
Nov 15 02:45:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:64:fc:ab"/><model type="virtio"/><mtu size="1442"/><target dev="tap34633d4d-52"/></interface> {{(pid=75391) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:64:fc:ab"/><model type="virtio"/><mtu size="1442"/><target dev="tap34633d4d-52"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 15 02:45:02 user nova-compute[75391]:   <name>instance-00000007</name>
Nov 15 02:45:02 user nova-compute[75391]:   <uuid>bb472aa5-47dd-48d6-8e9f-e179afd1d8ec</uuid>
Nov 15 02:45:02 user nova-compute[75391]:   <metadata>
Nov 15 02:45:02 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:45:02 user nova-compute[75391]:   <nova:package version="0.0.0"/>
Nov 15 02:45:02 user nova-compute[75391]:   <nova:name>tempest-device-tagging-server-84898992</nova:name>
Nov 15 02:45:02 user nova-compute[75391]:   <nova:creationTime>2023-11-15 02:44:06</nova:creationTime>
Nov 15 02:45:02 user nova-compute[75391]:   <nova:flavor name="m1.tiny">
Nov 15 02:45:02 user nova-compute[75391]:     <nova:memory>512</nova:memory>
Nov 15 02:45:02 user nova-compute[75391]:     <nova:disk>1</nova:disk>
Nov 15 02:45:02 user nova-compute[75391]:     <nova:swap>0</nova:swap>
Nov 15 02:45:02 user nova-compute[75391]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:45:02 user nova-compute[75391]:     <nova:vcpus>1</nova:vcpus>
Nov 15 02:45:02 user nova-compute[75391]:   </nova:flavor>
Nov 15 02:45:02 user nova-compute[75391]:   <nova:owner>
Nov 15 02:45:02 user nova-compute[75391]:     <nova:user uuid="1727eae8986646508dbb022ae69ab573">tempest-TaggedAttachmentsTest-382223691-project-member</nova:user>
Nov 15 02:45:02 user nova-compute[75391]:     <nova:project uuid="68070c12bf9f4c45a8c12165d571fa41">tempest-TaggedAttachmentsTest-382223691</nova:project>
Nov 15 02:45:02 user nova-compute[75391]:   </nova:owner>
Nov 15 02:45:02 user nova-compute[75391]:   <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:45:02 user nova-compute[75391]:   <nova:ports>
Nov 15 02:45:02 user nova-compute[75391]:     <nova:port uuid="86eacc9d-8245-4fa1-9a0a-a0a9f396872b">
Nov 15 02:45:02 user nova-compute[75391]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 02:45:02 user nova-compute[75391]:     </nova:port>
Nov 15 02:45:02 user nova-compute[75391]:     <nova:port uuid="34633d4d-5212-4738-847f-25acca40b074">
Nov 15 02:45:02 user nova-compute[75391]:       <nova:ip type="fixed" address="10.10.10.161" ipVersion="4"/>
Nov 15 02:45:02 user nova-compute[75391]:     </nova:port>
Nov 15 02:45:02 user nova-compute[75391]:   </nova:ports>
Nov 15 02:45:02 user nova-compute[75391]: </nova:instance>
Nov 15 02:45:02 user nova-compute[75391]:   </metadata>
Nov 15 02:45:02 user nova-compute[75391]:   <memory unit='KiB'>524288</memory>
Nov 15 02:45:02 user nova-compute[75391]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 02:45:02 user nova-compute[75391]:   <vcpu placement='static'>1</vcpu>
Nov 15 02:45:02 user nova-compute[75391]:   <resource>
Nov 15 02:45:02 user nova-compute[75391]:     <partition>/machine</partition>
Nov 15 02:45:02 user nova-compute[75391]:   </resource>
Nov 15 02:45:02 user nova-compute[75391]:   <sysinfo type='smbios'>
Nov 15 02:45:02 user nova-compute[75391]:     <system>
Nov 15 02:45:02 user nova-compute[75391]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 02:45:02 user nova-compute[75391]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 02:45:02 user nova-compute[75391]:       <entry name='version'>0.0.0</entry>
Nov 15 02:45:02 user nova-compute[75391]:       <entry name='serial'>bb472aa5-47dd-48d6-8e9f-e179afd1d8ec</entry>
Nov 15 02:45:02 user nova-compute[75391]:       <entry name='uuid'>bb472aa5-47dd-48d6-8e9f-e179afd1d8ec</entry>
Nov 15 02:45:02 user nova-compute[75391]:       <entry name='family'>Virtual Machine</entry>
Nov 15 02:45:02 user nova-compute[75391]:     </system>
Nov 15 02:45:02 user nova-compute[75391]:   </sysinfo>
Nov 15 02:45:02 user nova-compute[75391]:   <os>
Nov 15 02:45:02 user nova-compute[75391]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 02:45:02 user nova-compute[75391]:     <boot dev='hd'/>
Nov 15 02:45:02 user nova-compute[75391]:     <smbios mode='sysinfo'/>
Nov 15 02:45:02 user nova-compute[75391]:   </os>
Nov 15 02:45:02 user nova-compute[75391]:   <features>
Nov 15 02:45:02 user nova-compute[75391]:     <acpi/>
Nov 15 02:45:02 user nova-compute[75391]:     <apic/>
Nov 15 02:45:02 user nova-compute[75391]:     <vmcoreinfo state='on'/>
Nov 15 02:45:02 user nova-compute[75391]:   </features>
Nov 15 02:45:02 user nova-compute[75391]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 02:45:02 user nova-compute[75391]:     <model fallback='forbid'>Nehalem</model>
Nov 15 02:45:02 user nova-compute[75391]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 02:45:02 user nova-compute[75391]:     <feature policy='require' name='vme'/>
Nov 15 02:45:02 user nova-compute[75391]:     <feature policy='require' name='x2apic'/>
Nov 15 02:45:02 user nova-compute[75391]:     <feature policy='require' name='hypervisor'/>
Nov 15 02:45:02 user nova-compute[75391]:   </cpu>
Nov 15 02:45:02 user nova-compute[75391]:   <clock offset='utc'>
Nov 15 02:45:02 user nova-compute[75391]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 02:45:02 user nova-compute[75391]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 02:45:02 user nova-compute[75391]:     <timer name='hpet' present='no'/>
Nov 15 02:45:02 user nova-compute[75391]:   </clock>
Nov 15 02:45:02 user nova-compute[75391]:   <on_poweroff>destroy</on_poweroff>
Nov 15 02:45:02 user nova-compute[75391]:   <on_reboot>restart</on_reboot>
Nov 15 02:45:02 user nova-compute[75391]:   <on_crash>destroy</on_crash>
Nov 15 02:45:02 user nova-compute[75391]:   <devices>
Nov 15 02:45:02 user nova-compute[75391]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 02:45:02 user nova-compute[75391]:     <disk type='file' device='disk'>
Nov 15 02:45:02 user nova-compute[75391]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 02:45:02 user nova-compute[75391]:       <source file='/opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk' index='2'/>
Nov 15 02:45:02 user nova-compute[75391]:       <backingStore type='file' index='3'>
Nov 15 02:45:02 user nova-compute[75391]:         <format type='raw'/>
Nov 15 02:45:02 user nova-compute[75391]:         <source file='/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a'/>
Nov 15 02:45:02 user nova-compute[75391]:         <backingStore/>
Nov 15 02:45:02 user nova-compute[75391]:       </backingStore>
Nov 15 02:45:02 user nova-compute[75391]:       <target dev='vda' bus='virtio'/>
Nov 15 02:45:02 user nova-compute[75391]:       <alias name='virtio-disk0'/>
Nov 15 02:45:02 user nova-compute[75391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 02:45:02 user nova-compute[75391]:     </disk>
Nov 15 02:45:02 user nova-compute[75391]:     <disk type='file' device='cdrom'>
Nov 15 02:45:02 user nova-compute[75391]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 02:45:02 user nova-compute[75391]:       <source file='/opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/disk.config' index='1'/>
Nov 15 02:45:02 user nova-compute[75391]:       <backingStore/>
Nov 15 02:45:02 user nova-compute[75391]:       <target dev='hda' bus='ide'/>
Nov 15 02:45:02 user nova-compute[75391]:       <readonly/>
Nov 15 02:45:02 user nova-compute[75391]:       <alias name='ide0-0-0'/>
Nov 15 02:45:02 user nova-compute[75391]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 02:45:02 user nova-compute[75391]:     </disk>
Nov 15 02:45:02 user nova-compute[75391]:     <controller type='usb' index='0' model='none'>
Nov 15 02:45:02 user nova-compute[75391]:       <alias name='usb'/>
Nov 15 02:45:02 user nova-compute[75391]:     </controller>
Nov 15 02:45:02 user nova-compute[75391]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 02:45:02 user nova-compute[75391]:       <alias name='pci.0'/>
Nov 15 02:45:02 user nova-compute[75391]:     </controller>
Nov 15 02:45:02 user nova-compute[75391]:     <controller type='ide' index='0'>
Nov 15 02:45:02 user nova-compute[75391]:       <alias name='ide'/>
Nov 15 02:45:02 user nova-compute[75391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 02:45:02 user nova-compute[75391]:     </controller>
Nov 15 02:45:02 user nova-compute[75391]:     <interface type='ethernet'>
Nov 15 02:45:02 user nova-compute[75391]:       <mac address='fa:16:3e:08:66:14'/>
Nov 15 02:45:02 user nova-compute[75391]:       <target dev='tap86eacc9d-82'/>
Nov 15 02:45:02 user nova-compute[75391]:       <model type='virtio'/>
Nov 15 02:45:02 user nova-compute[75391]:       <mtu size='1442'/>
Nov 15 02:45:02 user nova-compute[75391]:       <alias name='net0'/>
Nov 15 02:45:02 user nova-compute[75391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 02:45:02 user nova-compute[75391]:     </interface>
Nov 15 02:45:02 user nova-compute[75391]:     <serial type='pty'>
Nov 15 02:45:02 user nova-compute[75391]:       <source path='/dev/pts/6'/>
Nov 15 02:45:02 user nova-compute[75391]:       <log file='/opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/console.log' append='off'/>
Nov 15 02:45:02 user nova-compute[75391]:       <target type='isa-serial' port='0'>
Nov 15 02:45:02 user nova-compute[75391]:         <model name='isa-serial'/>
Nov 15 02:45:02 user nova-compute[75391]:       </target>
Nov 15 02:45:02 user nova-compute[75391]:       <alias name='serial0'/>
Nov 15 02:45:02 user nova-compute[75391]:     </serial>
Nov 15 02:45:02 user nova-compute[75391]:     <console type='pty' tty='/dev/pts/6'>
Nov 15 02:45:02 user nova-compute[75391]:       <source path='/dev/pts/6'/>
Nov 15 02:45:02 user nova-compute[75391]:       <log file='/opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec/console.log' append='off'/>
Nov 15 02:45:02 user nova-compute[75391]:       <target type='serial' port='0'/>
Nov 15 02:45:02 user nova-compute[75391]:       <alias name='serial0'/>
Nov 15 02:45:02 user nova-compute[75391]:     </console>
Nov 15 02:45:02 user nova-compute[75391]:     <input type='mouse' bus='ps2'>
Nov 15 02:45:02 user nova-compute[75391]:       <alias name='input0'/>
Nov 15 02:45:02 user nova-compute[75391]:     </input>
Nov 15 02:45:02 user nova-compute[75391]:     <input type='keyboard' bus='ps2'>
Nov 15 02:45:02 user nova-compute[75391]:       <alias name='input1'/>
Nov 15 02:45:02 user nova-compute[75391]:     </input>
Nov 15 02:45:02 user nova-compute[75391]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 15 02:45:02 user nova-compute[75391]:       <listen type='address' address='0.0.0.0'/>
Nov 15 02:45:02 user nova-compute[75391]:     </graphics>
Nov 15 02:45:02 user nova-compute[75391]:     <audio id='1' type='none'/>
Nov 15 02:45:02 user nova-compute[75391]:     <video>
Nov 15 02:45:02 user nova-compute[75391]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 02:45:02 user nova-compute[75391]:       <alias name='video0'/>
Nov 15 02:45:02 user nova-compute[75391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 02:45:02 user nova-compute[75391]:     </video>
Nov 15 02:45:02 user nova-compute[75391]:     <memballoon model='virtio'>
Nov 15 02:45:02 user nova-compute[75391]:       <stats period='10'/>
Nov 15 02:45:02 user nova-compute[75391]:       <alias name='balloon0'/>
Nov 15 02:45:02 user nova-compute[75391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 02:45:02 user nova-compute[75391]:     </memballoon>
Nov 15 02:45:02 user nova-compute[75391]:     <rng model='virtio'>
Nov 15 02:45:02 user nova-compute[75391]:       <backend model='random'>/dev/urandom</backend>
Nov 15 02:45:02 user nova-compute[75391]:       <alias name='rng0'/>
Nov 15 02:45:02 user nova-compute[75391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 02:45:02 user nova-compute[75391]:     </rng>
Nov 15 02:45:02 user nova-compute[75391]:   </devices>
Nov 15 02:45:02 user nova-compute[75391]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 02:45:02 user nova-compute[75391]:     <label>libvirt-bb472aa5-47dd-48d6-8e9f-e179afd1d8ec</label>
Nov 15 02:45:02 user nova-compute[75391]:     <imagelabel>libvirt-bb472aa5-47dd-48d6-8e9f-e179afd1d8ec</imagelabel>
Nov 15 02:45:02 user nova-compute[75391]:   </seclabel>
Nov 15 02:45:02 user nova-compute[75391]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 02:45:02 user nova-compute[75391]:     <label>+64055:+108</label>
Nov 15 02:45:02 user nova-compute[75391]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 02:45:02 user nova-compute[75391]:   </seclabel>
Nov 15 02:45:02 user nova-compute[75391]: </domain>
Nov 15 02:45:02 user nova-compute[75391]:  {{(pid=75391) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 02:45:02 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Successfully detached device tap34633d4d-52 from instance bb472aa5-47dd-48d6-8e9f-e179afd1d8ec from the live domain config.
Nov 15 02:45:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-84898992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-84898992',id=7,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjGjAlXtIFwyK48Tn0rWDvwO+CMiqK5nwES7Ozr0xqfWpvP+GLtsNTghKrGqtv5RFJtUL1Xov3deHDY6XnlkjWriT5bcxPdE96duFESi6cETl7FauYVa7ChUe8ZPLW7IQ==',key_name='tempest-keypair-1251809303',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:42:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68070c12bf9f4c45a8c12165d571fa41',ramdisk_id='',reservation_id='r-j0qi94j3',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-382223691',owner_user_name='tempest-TaggedAttachmentsTest-382223691-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:42:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1727eae8986646508dbb022ae69ab573',uuid=bb472aa5-47dd-48d6-8e9f-e179afd1d8ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34633d4d-5212-4738-847f-25acca40b074", "address": "fa:16:3e:64:fc:ab", "network": {"id": "1a6d6e24-345d-40d3-badd-a60f9ec9373e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1185402927", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "68070c12bf9f4c45a8c12165d571fa41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34633d4d-52", "ovs_interfaceid": "34633d4d-5212-4738-847f-25acca40b074", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Converting VIF {"id": "34633d4d-5212-4738-847f-25acca40b074", "address": "fa:16:3e:64:fc:ab", "network": {"id": "1a6d6e24-345d-40d3-badd-a60f9ec9373e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1185402927", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "68070c12bf9f4c45a8c12165d571fa41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34633d4d-52", "ovs_interfaceid": "34633d4d-5212-4738-847f-25acca40b074", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:fc:ab,bridge_name='br-int',has_traffic_filtering=True,id=34633d4d-5212-4738-847f-25acca40b074,network=Network(1a6d6e24-345d-40d3-badd-a60f9ec9373e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34633d4d-52') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG os_vif [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:fc:ab,bridge_name='br-int',has_traffic_filtering=True,id=34633d4d-5212-4738-847f-25acca40b074,network=Network(1a6d6e24-345d-40d3-badd-a60f9ec9373e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34633d4d-52') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34633d4d-52, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38bc0663-b4f2-464a-85ac-474d5076f722) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:45:02 user nova-compute[75391]: INFO os_vif [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:fc:ab,bridge_name='br-int',has_traffic_filtering=True,id=34633d4d-5212-4738-847f-25acca40b074,network=Network(1a6d6e24-345d-40d3-badd-a60f9ec9373e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34633d4d-52')
Nov 15 02:45:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:45:02 user nova-compute[75391]:   <nova:package version="0.0.0"/>
Nov 15 02:45:02 user nova-compute[75391]:   <nova:name>tempest-device-tagging-server-84898992</nova:name>
Nov 15 02:45:02 user nova-compute[75391]:   <nova:creationTime>2023-11-15 02:45:02</nova:creationTime>
Nov 15 02:45:02 user nova-compute[75391]:   <nova:flavor name="m1.tiny">
Nov 15 02:45:02 user nova-compute[75391]:     <nova:memory>512</nova:memory>
Nov 15 02:45:02 user nova-compute[75391]:     <nova:disk>1</nova:disk>
Nov 15 02:45:02 user nova-compute[75391]:     <nova:swap>0</nova:swap>
Nov 15 02:45:02 user nova-compute[75391]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:45:02 user nova-compute[75391]:     <nova:vcpus>1</nova:vcpus>
Nov 15 02:45:02 user nova-compute[75391]:   </nova:flavor>
Nov 15 02:45:02 user nova-compute[75391]:   <nova:owner>
Nov 15 02:45:02 user nova-compute[75391]:     <nova:user uuid="1727eae8986646508dbb022ae69ab573">tempest-TaggedAttachmentsTest-382223691-project-member</nova:user>
Nov 15 02:45:02 user nova-compute[75391]:     <nova:project uuid="68070c12bf9f4c45a8c12165d571fa41">tempest-TaggedAttachmentsTest-382223691</nova:project>
Nov 15 02:45:02 user nova-compute[75391]:   </nova:owner>
Nov 15 02:45:02 user nova-compute[75391]:   <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:45:02 user nova-compute[75391]:   <nova:ports>
Nov 15 02:45:02 user nova-compute[75391]:     <nova:port uuid="86eacc9d-8245-4fa1-9a0a-a0a9f396872b">
Nov 15 02:45:02 user nova-compute[75391]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 02:45:02 user nova-compute[75391]:     </nova:port>
Nov 15 02:45:02 user nova-compute[75391]:   </nova:ports>
Nov 15 02:45:02 user nova-compute[75391]: </nova:instance>
Nov 15 02:45:02 user nova-compute[75391]:  {{(pid=75391) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-223cfd41-2030-4d07-b203-adade9e41191 req-a5a17d82-206d-4b73-8f94-db118e0e7332 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Received event network-vif-plugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-223cfd41-2030-4d07-b203-adade9e41191 req-a5a17d82-206d-4b73-8f94-db118e0e7332 service nova] Acquiring lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-223cfd41-2030-4d07-b203-adade9e41191 req-a5a17d82-206d-4b73-8f94-db118e0e7332 service nova] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-223cfd41-2030-4d07-b203-adade9e41191 req-a5a17d82-206d-4b73-8f94-db118e0e7332 service nova] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-223cfd41-2030-4d07-b203-adade9e41191 req-a5a17d82-206d-4b73-8f94-db118e0e7332 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] No waiting events found dispatching network-vif-plugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:45:02 user nova-compute[75391]: WARNING nova.compute.manager [req-223cfd41-2030-4d07-b203-adade9e41191 req-a5a17d82-206d-4b73-8f94-db118e0e7332 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Received unexpected event network-vif-plugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 for instance with vm_state building and task_state spawning.
Nov 15 02:45:03 user nova-compute[75391]: DEBUG nova.network.neutron [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Successfully updated port: 162c733f-2235-48db-b812-5ad67decada5 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:45:03 user nova-compute[75391]: DEBUG nova.compute.manager [req-e1cdf783-98b5-4d86-8677-93ac4c3fc414 req-f0897e47-3df8-40b5-a2d3-0f77a1d780b6 service nova] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Received event network-changed-162c733f-2235-48db-b812-5ad67decada5 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:03 user nova-compute[75391]: DEBUG nova.compute.manager [req-e1cdf783-98b5-4d86-8677-93ac4c3fc414 req-f0897e47-3df8-40b5-a2d3-0f77a1d780b6 service nova] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Refreshing instance network info cache due to event network-changed-162c733f-2235-48db-b812-5ad67decada5. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:45:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e1cdf783-98b5-4d86-8677-93ac4c3fc414 req-f0897e47-3df8-40b5-a2d3-0f77a1d780b6 service nova] Acquiring lock "refresh_cache-6a3cee20-521e-4998-8744-f8bf83586176" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:45:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e1cdf783-98b5-4d86-8677-93ac4c3fc414 req-f0897e47-3df8-40b5-a2d3-0f77a1d780b6 service nova] Acquired lock "refresh_cache-6a3cee20-521e-4998-8744-f8bf83586176" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:45:03 user nova-compute[75391]: DEBUG nova.network.neutron [req-e1cdf783-98b5-4d86-8677-93ac4c3fc414 req-f0897e47-3df8-40b5-a2d3-0f77a1d780b6 service nova] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Refreshing network info cache for port 162c733f-2235-48db-b812-5ad67decada5 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:45:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Acquiring lock "refresh_cache-6a3cee20-521e-4998-8744-f8bf83586176" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:45:03 user nova-compute[75391]: DEBUG nova.network.neutron [req-e1cdf783-98b5-4d86-8677-93ac4c3fc414 req-f0897e47-3df8-40b5-a2d3-0f77a1d780b6 service nova] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:45:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:03 user nova-compute[75391]: DEBUG nova.network.neutron [req-e1cdf783-98b5-4d86-8677-93ac4c3fc414 req-f0897e47-3df8-40b5-a2d3-0f77a1d780b6 service nova] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:45:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e1cdf783-98b5-4d86-8677-93ac4c3fc414 req-f0897e47-3df8-40b5-a2d3-0f77a1d780b6 service nova] Releasing lock "refresh_cache-6a3cee20-521e-4998-8744-f8bf83586176" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:45:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Acquired lock "refresh_cache-6a3cee20-521e-4998-8744-f8bf83586176" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:45:03 user nova-compute[75391]: DEBUG nova.network.neutron [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:45:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Acquiring lock "refresh_cache-bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:45:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Acquired lock "refresh_cache-bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:45:03 user nova-compute[75391]: DEBUG nova.network.neutron [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:45:03 user nova-compute[75391]: DEBUG nova.network.neutron [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.network.neutron [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Updating instance_info_cache with network_info: [{"id": "162c733f-2235-48db-b812-5ad67decada5", "address": "fa:16:3e:05:cd:70", "network": {"id": "cb1a9e37-451d-43be-ab84-a0ebe7ab264b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500424491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9265d1e4bccb467fbf0c738844d8735b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162c733f-22", "ovs_interfaceid": "162c733f-2235-48db-b812-5ad67decada5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Releasing lock "refresh_cache-6a3cee20-521e-4998-8744-f8bf83586176" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.compute.manager [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Instance network_info: |[{"id": "162c733f-2235-48db-b812-5ad67decada5", "address": "fa:16:3e:05:cd:70", "network": {"id": "cb1a9e37-451d-43be-ab84-a0ebe7ab264b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500424491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9265d1e4bccb467fbf0c738844d8735b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162c733f-22", "ovs_interfaceid": "162c733f-2235-48db-b812-5ad67decada5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Start _get_guest_xml network_info=[{"id": "162c733f-2235-48db-b812-5ad67decada5", "address": "fa:16:3e:05:cd:70", "network": {"id": "cb1a9e37-451d-43be-ab84-a0ebe7ab264b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500424491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9265d1e4bccb467fbf0c738844d8735b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162c733f-22", "ovs_interfaceid": "162c733f-2235-48db-b812-5ad67decada5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:45:04 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:45:04 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:45:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1674493006',display_name='tempest-VolumesAdminNegativeTest-server-1674493006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1674493006',id=14,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9265d1e4bccb467fbf0c738844d8735b',ramdisk_id='',reservation_id='r-cl73ocy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1405215089',owner_user_name='tempest-VolumesAdminNegativeTest-1405215089-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:45:02Z,user_data=None,user_id='f67781b1c37f4b7dbabdfa16d7b891d0',uuid=6a3cee20-521e-4998-8744-f8bf83586176,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "162c733f-2235-48db-b812-5ad67decada5", "address": "fa:16:3e:05:cd:70", "network": {"id": "cb1a9e37-451d-43be-ab84-a0ebe7ab264b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500424491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9265d1e4bccb467fbf0c738844d8735b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162c733f-22", "ovs_interfaceid": "162c733f-2235-48db-b812-5ad67decada5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Converting VIF {"id": "162c733f-2235-48db-b812-5ad67decada5", "address": "fa:16:3e:05:cd:70", "network": {"id": "cb1a9e37-451d-43be-ab84-a0ebe7ab264b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500424491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9265d1e4bccb467fbf0c738844d8735b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162c733f-22", "ovs_interfaceid": "162c733f-2235-48db-b812-5ad67decada5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:cd:70,bridge_name='br-int',has_traffic_filtering=True,id=162c733f-2235-48db-b812-5ad67decada5,network=Network(cb1a9e37-451d-43be-ab84-a0ebe7ab264b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162c733f-22') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.objects.instance [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a3cee20-521e-4998-8744-f8bf83586176 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:45:04 user nova-compute[75391]:   <uuid>6a3cee20-521e-4998-8744-f8bf83586176</uuid>
Nov 15 02:45:04 user nova-compute[75391]:   <name>instance-0000000e</name>
Nov 15 02:45:04 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:45:04 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:45:04 user nova-compute[75391]:   <metadata>
Nov 15 02:45:04 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:45:04 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:45:04 user nova-compute[75391]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1674493006</nova:name>
Nov 15 02:45:04 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:45:04</nova:creationTime>
Nov 15 02:45:04 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:45:04 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:45:04 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:45:04 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:45:04 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:45:04 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:45:04 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:45:04 user nova-compute[75391]:       <nova:owner>
Nov 15 02:45:04 user nova-compute[75391]:         <nova:user uuid="f67781b1c37f4b7dbabdfa16d7b891d0">tempest-VolumesAdminNegativeTest-1405215089-project-member</nova:user>
Nov 15 02:45:04 user nova-compute[75391]:         <nova:project uuid="9265d1e4bccb467fbf0c738844d8735b">tempest-VolumesAdminNegativeTest-1405215089</nova:project>
Nov 15 02:45:04 user nova-compute[75391]:       </nova:owner>
Nov 15 02:45:04 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:45:04 user nova-compute[75391]:       <nova:ports>
Nov 15 02:45:04 user nova-compute[75391]:         <nova:port uuid="162c733f-2235-48db-b812-5ad67decada5">
Nov 15 02:45:04 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 02:45:04 user nova-compute[75391]:         </nova:port>
Nov 15 02:45:04 user nova-compute[75391]:       </nova:ports>
Nov 15 02:45:04 user nova-compute[75391]:     </nova:instance>
Nov 15 02:45:04 user nova-compute[75391]:   </metadata>
Nov 15 02:45:04 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:45:04 user nova-compute[75391]:     <system>
Nov 15 02:45:04 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:45:04 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:45:04 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:45:04 user nova-compute[75391]:       <entry name="serial">6a3cee20-521e-4998-8744-f8bf83586176</entry>
Nov 15 02:45:04 user nova-compute[75391]:       <entry name="uuid">6a3cee20-521e-4998-8744-f8bf83586176</entry>
Nov 15 02:45:04 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:45:04 user nova-compute[75391]:     </system>
Nov 15 02:45:04 user nova-compute[75391]:   </sysinfo>
Nov 15 02:45:04 user nova-compute[75391]:   <os>
Nov 15 02:45:04 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:45:04 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:45:04 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:45:04 user nova-compute[75391]:   </os>
Nov 15 02:45:04 user nova-compute[75391]:   <features>
Nov 15 02:45:04 user nova-compute[75391]:     <acpi/>
Nov 15 02:45:04 user nova-compute[75391]:     <apic/>
Nov 15 02:45:04 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:45:04 user nova-compute[75391]:   </features>
Nov 15 02:45:04 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:45:04 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:45:04 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:45:04 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:45:04 user nova-compute[75391]:   </clock>
Nov 15 02:45:04 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:45:04 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:45:04 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:45:04 user nova-compute[75391]:   </cpu>
Nov 15 02:45:04 user nova-compute[75391]:   <devices>
Nov 15 02:45:04 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:45:04 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:45:04 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/6a3cee20-521e-4998-8744-f8bf83586176/disk"/>
Nov 15 02:45:04 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:45:04 user nova-compute[75391]:     </disk>
Nov 15 02:45:04 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:45:04 user nova-compute[75391]:       <mac address="fa:16:3e:05:cd:70"/>
Nov 15 02:45:04 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:45:04 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:45:04 user nova-compute[75391]:       <target dev="tap162c733f-22"/>
Nov 15 02:45:04 user nova-compute[75391]:     </interface>
Nov 15 02:45:04 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:45:04 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/6a3cee20-521e-4998-8744-f8bf83586176/console.log" append="off"/>
Nov 15 02:45:04 user nova-compute[75391]:     </serial>
Nov 15 02:45:04 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:45:04 user nova-compute[75391]:     <video>
Nov 15 02:45:04 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:45:04 user nova-compute[75391]:     </video>
Nov 15 02:45:04 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:45:04 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:45:04 user nova-compute[75391]:     </rng>
Nov 15 02:45:04 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:45:04 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:45:04 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:45:04 user nova-compute[75391]:     </memballoon>
Nov 15 02:45:04 user nova-compute[75391]:   </devices>
Nov 15 02:45:04 user nova-compute[75391]: </domain>
Nov 15 02:45:04 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:45:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1674493006',display_name='tempest-VolumesAdminNegativeTest-server-1674493006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1674493006',id=14,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9265d1e4bccb467fbf0c738844d8735b',ramdisk_id='',reservation_id='r-cl73ocy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1405215089',owner_user_name='tempest-VolumesAdminNegativeTest-1405215089-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:45:02Z,user_data=None,user_id='f67781b1c37f4b7dbabdfa16d7b891d0',uuid=6a3cee20-521e-4998-8744-f8bf83586176,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "162c733f-2235-48db-b812-5ad67decada5", "address": "fa:16:3e:05:cd:70", "network": {"id": "cb1a9e37-451d-43be-ab84-a0ebe7ab264b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500424491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9265d1e4bccb467fbf0c738844d8735b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162c733f-22", "ovs_interfaceid": "162c733f-2235-48db-b812-5ad67decada5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Converting VIF {"id": "162c733f-2235-48db-b812-5ad67decada5", "address": "fa:16:3e:05:cd:70", "network": {"id": "cb1a9e37-451d-43be-ab84-a0ebe7ab264b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500424491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9265d1e4bccb467fbf0c738844d8735b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162c733f-22", "ovs_interfaceid": "162c733f-2235-48db-b812-5ad67decada5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:cd:70,bridge_name='br-int',has_traffic_filtering=True,id=162c733f-2235-48db-b812-5ad67decada5,network=Network(cb1a9e37-451d-43be-ab84-a0ebe7ab264b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162c733f-22') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG os_vif [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:cd:70,bridge_name='br-int',has_traffic_filtering=True,id=162c733f-2235-48db-b812-5ad67decada5,network=Network(cb1a9e37-451d-43be-ab84-a0ebe7ab264b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162c733f-22') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '75f8d3f4-1490-5427-8810-6dcdb9393e38', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap162c733f-22, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap162c733f-22, col_values=(('qos', UUID('1e7d9ee2-c70f-4daf-8e25-98140979a6b3')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap162c733f-22, col_values=(('external_ids', {'iface-id': '162c733f-2235-48db-b812-5ad67decada5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:cd:70', 'vm-uuid': '6a3cee20-521e-4998-8744-f8bf83586176'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:04 user nova-compute[75391]: INFO os_vif [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:cd:70,bridge_name='br-int',has_traffic_filtering=True,id=162c733f-2235-48db-b812-5ad67decada5,network=Network(cb1a9e37-451d-43be-ab84-a0ebe7ab264b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162c733f-22')
Nov 15 02:45:04 user nova-compute[75391]: INFO nova.network.neutron [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Port 34633d4d-5212-4738-847f-25acca40b074 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.network.neutron [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Updating instance_info_cache with network_info: [{"id": "86eacc9d-8245-4fa1-9a0a-a0a9f396872b", "address": "fa:16:3e:08:66:14", "network": {"id": "c36f20d0-0398-4c34-b593-d9610a7b5fc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-689770940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68070c12bf9f4c45a8c12165d571fa41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eacc9d-82", "ovs_interfaceid": "86eacc9d-8245-4fa1-9a0a-a0a9f396872b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] No VIF found with MAC fa:16:3e:05:cd:70, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Releasing lock "refresh_cache-bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6192013d-35c5-4e64-aee2-15ea9723bab7 tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "interface-bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-34633d4d-5212-4738-847f-25acca40b074" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.911s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.compute.manager [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:45:04 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Instance spawned successfully.
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:45:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:45:05 user nova-compute[75391]: INFO nova.compute.manager [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Took 5.57 seconds to spawn the instance on the hypervisor.
Nov 15 02:45:05 user nova-compute[75391]: DEBUG nova.compute.manager [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:45:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-b3a507c7-e3d4-4f00-bc0a-e0633f12dc82 req-e179028f-6afa-457f-ba5e-7d60d1d16597 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Received event network-vif-plugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b3a507c7-e3d4-4f00-bc0a-e0633f12dc82 req-e179028f-6afa-457f-ba5e-7d60d1d16597 service nova] Acquiring lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b3a507c7-e3d4-4f00-bc0a-e0633f12dc82 req-e179028f-6afa-457f-ba5e-7d60d1d16597 service nova] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b3a507c7-e3d4-4f00-bc0a-e0633f12dc82 req-e179028f-6afa-457f-ba5e-7d60d1d16597 service nova] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-b3a507c7-e3d4-4f00-bc0a-e0633f12dc82 req-e179028f-6afa-457f-ba5e-7d60d1d16597 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] No waiting events found dispatching network-vif-plugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:45:05 user nova-compute[75391]: WARNING nova.compute.manager [req-b3a507c7-e3d4-4f00-bc0a-e0633f12dc82 req-e179028f-6afa-457f-ba5e-7d60d1d16597 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Received unexpected event network-vif-plugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 for instance with vm_state building and task_state spawning.
Nov 15 02:45:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-b3a507c7-e3d4-4f00-bc0a-e0633f12dc82 req-e179028f-6afa-457f-ba5e-7d60d1d16597 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Received event network-changed-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-b3a507c7-e3d4-4f00-bc0a-e0633f12dc82 req-e179028f-6afa-457f-ba5e-7d60d1d16597 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Refreshing instance network info cache due to event network-changed-6b8f74f5-6f5f-4946-afdb-80269c0d03b1. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:45:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b3a507c7-e3d4-4f00-bc0a-e0633f12dc82 req-e179028f-6afa-457f-ba5e-7d60d1d16597 service nova] Acquiring lock "refresh_cache-25884e14-afa3-4e5d-8154-a9e9eb455b94" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:45:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b3a507c7-e3d4-4f00-bc0a-e0633f12dc82 req-e179028f-6afa-457f-ba5e-7d60d1d16597 service nova] Acquired lock "refresh_cache-25884e14-afa3-4e5d-8154-a9e9eb455b94" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:45:05 user nova-compute[75391]: DEBUG nova.network.neutron [req-b3a507c7-e3d4-4f00-bc0a-e0633f12dc82 req-e179028f-6afa-457f-ba5e-7d60d1d16597 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Refreshing network info cache for port 6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:45:05 user nova-compute[75391]: INFO nova.compute.manager [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Took 18.26 seconds to build instance.
Nov 15 02:45:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2e452027-fe07-4f6a-8856-015ff730df8c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.363s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-804e9b87-9948-4e22-9acb-7f3716692423 req-087c27ae-eb48-4e84-86c6-2c431e08ff70 service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Received event network-vif-deleted-34633d4d-5212-4738-847f-25acca40b074 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:05 user nova-compute[75391]: DEBUG nova.network.neutron [req-b3a507c7-e3d4-4f00-bc0a-e0633f12dc82 req-e179028f-6afa-457f-ba5e-7d60d1d16597 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Updated VIF entry in instance network info cache for port 6b8f74f5-6f5f-4946-afdb-80269c0d03b1. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:45:05 user nova-compute[75391]: DEBUG nova.network.neutron [req-b3a507c7-e3d4-4f00-bc0a-e0633f12dc82 req-e179028f-6afa-457f-ba5e-7d60d1d16597 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Updating instance_info_cache with network_info: [{"id": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "address": "fa:16:3e:6b:28:6d", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b8f74f5-6f", "ovs_interfaceid": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:45:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b3a507c7-e3d4-4f00-bc0a-e0633f12dc82 req-e179028f-6afa-457f-ba5e-7d60d1d16597 service nova] Releasing lock "refresh_cache-25884e14-afa3-4e5d-8154-a9e9eb455b94" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:45:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:06 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1fc39b27-762e-4bc8-90ba-0215d65710ec is timed out.
Nov 15 02:45:06 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Successfully detached device vdb from instance 1fc39b27-762e-4bc8-90ba-0215d65710ec from the live domain config.
Nov 15 02:45:06 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:45:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sgwDFGfo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'f76e360b-eb5e-47bb-ae1a-9acd86e55d1b'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:45:06 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:45:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:45:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:45:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f85045-a91a-47e4-a1dc-dd352badc326]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:45:07 user nova-compute[75391]: No targets found.
Nov 15 02:45:07 user nova-compute[75391]: iSNS:
Nov 15 02:45:07 user nova-compute[75391]: No targets found.
Nov 15 02:45:07 user nova-compute[75391]: STATIC:
Nov 15 02:45:07 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40
Nov 15 02:45:07 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:45:07 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:45:07 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b
Nov 15 02:45:07 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:45:07 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:45:07 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502
Nov 15 02:45:07 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:45:07 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:45:07 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b
Nov 15 02:45:07 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:45:07 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:45:07 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:45:07 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:45:07 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:45:07 user nova-compute[75391]: FIRMWARE:
Nov 15 02:45:07 user nova-compute[75391]: No targets found.
Nov 15 02:45:07 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:45:07 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:45:07 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-e396a547-2bad-437f-bae1-2d2d20005a8e req-1834547d-f6d4-42e4-a663-cba635de6bc4 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Received event network-changed-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-e396a547-2bad-437f-bae1-2d2d20005a8e req-1834547d-f6d4-42e4-a663-cba635de6bc4 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Refreshing instance network info cache due to event network-changed-6b8f74f5-6f5f-4946-afdb-80269c0d03b1. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e396a547-2bad-437f-bae1-2d2d20005a8e req-1834547d-f6d4-42e4-a663-cba635de6bc4 service nova] Acquiring lock "refresh_cache-25884e14-afa3-4e5d-8154-a9e9eb455b94" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e396a547-2bad-437f-bae1-2d2d20005a8e req-1834547d-f6d4-42e4-a663-cba635de6bc4 service nova] Acquired lock "refresh_cache-25884e14-afa3-4e5d-8154-a9e9eb455b94" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG nova.network.neutron [req-e396a547-2bad-437f-bae1-2d2d20005a8e req-1834547d-f6d4-42e4-a663-cba635de6bc4 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Refreshing network info cache for port 6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96dc470-26b4-4738-b835-fdfedc1be0a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8773d34-9d41-4570-a817-43504805be96]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:45:07 user nova-compute[75391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:45:07 user nova-compute[75391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)
Nov 15 02:45:07 user nova-compute[75391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:45:07 user nova-compute[75391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:45:07 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:45:07 user nova-compute[75391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b (non-flash)
Nov 15 02:45:07 user nova-compute[75391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)
Nov 15 02:45:07 user nova-compute[75391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:45:07 user nova-compute[75391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:45:07 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f623c0ff7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b'): ({'sdb'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Removing single pathed devices sdb {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[03775c32-998b-4f74-922a-5974d524b5e5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f8aad5-6395-492b-a0a2-0e36085e275a]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Flushing IO for device /dev/sdb {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c8e69d-e1ba-437f-b78e-072b684aaaad]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-6e497008-c28f-4874-b35d-d0e197921458 req-c32cebd6-08fa-48bb-be81-226e614a6fc2 service nova] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Received event network-vif-plugged-162c733f-2235-48db-b812-5ad67decada5 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6e497008-c28f-4874-b35d-d0e197921458 req-c32cebd6-08fa-48bb-be81-226e614a6fc2 service nova] Acquiring lock "6a3cee20-521e-4998-8744-f8bf83586176-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6e497008-c28f-4874-b35d-d0e197921458 req-c32cebd6-08fa-48bb-be81-226e614a6fc2 service nova] Lock "6a3cee20-521e-4998-8744-f8bf83586176-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6e497008-c28f-4874-b35d-d0e197921458 req-c32cebd6-08fa-48bb-be81-226e614a6fc2 service nova] Lock "6a3cee20-521e-4998-8744-f8bf83586176-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-6e497008-c28f-4874-b35d-d0e197921458 req-c32cebd6-08fa-48bb-be81-226e614a6fc2 service nova] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] No waiting events found dispatching network-vif-plugged-162c733f-2235-48db-b812-5ad67decada5 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:45:07 user nova-compute[75391]: WARNING nova.compute.manager [req-6e497008-c28f-4874-b35d-d0e197921458 req-c32cebd6-08fa-48bb-be81-226e614a6fc2 service nova] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Received unexpected event network-vif-plugged-162c733f-2235-48db-b812-5ad67decada5 for instance with vm_state building and task_state spawning.
Nov 15 02:45:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-6e497008-c28f-4874-b35d-d0e197921458 req-c32cebd6-08fa-48bb-be81-226e614a6fc2 service nova] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Received event network-vif-plugged-162c733f-2235-48db-b812-5ad67decada5 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6e497008-c28f-4874-b35d-d0e197921458 req-c32cebd6-08fa-48bb-be81-226e614a6fc2 service nova] Acquiring lock "6a3cee20-521e-4998-8744-f8bf83586176-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6e497008-c28f-4874-b35d-d0e197921458 req-c32cebd6-08fa-48bb-be81-226e614a6fc2 service nova] Lock "6a3cee20-521e-4998-8744-f8bf83586176-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6e497008-c28f-4874-b35d-d0e197921458 req-c32cebd6-08fa-48bb-be81-226e614a6fc2 service nova] Lock "6a3cee20-521e-4998-8744-f8bf83586176-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-6e497008-c28f-4874-b35d-d0e197921458 req-c32cebd6-08fa-48bb-be81-226e614a6fc2 service nova] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] No waiting events found dispatching network-vif-plugged-162c733f-2235-48db-b812-5ad67decada5 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:45:07 user nova-compute[75391]: WARNING nova.compute.manager [req-6e497008-c28f-4874-b35d-d0e197921458 req-c32cebd6-08fa-48bb-be81-226e614a6fc2 service nova] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Received unexpected event network-vif-plugged-162c733f-2235-48db-b812-5ad67decada5 for instance with vm_state building and task_state spawning.
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cffa43-a4de-4215-8fcb-7796e5d09433]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[295826e3-27e4-499d-acee-ff873ce35cda]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f881cc6d-009f-4fd4-a10f-848e37d598bb]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b, portal: 172.16.0.220,3260]
Nov 15 02:45:07 user nova-compute[75391]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b, portal: 172.16.0.220,3260] successful.
Nov 15 02:45:07 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f76e360b-eb5e-47bb-ae1a-9acd86e55d1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce46cfd-6492-4d97-8e95-52a28b94619a]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] <== disconnect_volume: return (343ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG nova.network.neutron [req-e396a547-2bad-437f-bae1-2d2d20005a8e req-1834547d-f6d4-42e4-a663-cba635de6bc4 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Updated VIF entry in instance network info cache for port 6b8f74f5-6f5f-4946-afdb-80269c0d03b1. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG nova.network.neutron [req-e396a547-2bad-437f-bae1-2d2d20005a8e req-1834547d-f6d4-42e4-a663-cba635de6bc4 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Updating instance_info_cache with network_info: [{"id": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "address": "fa:16:3e:6b:28:6d", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b8f74f5-6f", "ovs_interfaceid": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e396a547-2bad-437f-bae1-2d2d20005a8e req-1834547d-f6d4-42e4-a663-cba635de6bc4 service nova] Releasing lock "refresh_cache-25884e14-afa3-4e5d-8154-a9e9eb455b94" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:45:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:08 user nova-compute[75391]: DEBUG nova.compute.manager [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:45:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:45:08 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Instance spawned successfully.
Nov 15 02:45:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:45:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:45:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:45:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:45:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:45:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:45:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:45:08 user nova-compute[75391]: INFO nova.compute.manager [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Took 6.33 seconds to spawn the instance on the hypervisor.
Nov 15 02:45:08 user nova-compute[75391]: DEBUG nova.compute.manager [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:45:08 user nova-compute[75391]: INFO nova.compute.manager [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Took 7.35 seconds to build instance.
Nov 15 02:45:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e37b1c1a-982c-44d1-b98d-ee6a10a2d3c4 tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "6a3cee20-521e-4998-8744-f8bf83586176" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.612s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:09 user nova-compute[75391]: DEBUG nova.objects.instance [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lazy-loading 'flavor' on Instance uuid 1fc39b27-762e-4bc8-90ba-0215d65710ec {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:45:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-33470b20-ae83-4400-8743-bb7051bfc360 tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lock "1fc39b27-762e-4bc8-90ba-0215d65710ec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.762s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "25884e14-afa3-4e5d-8154-a9e9eb455b94" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:09 user nova-compute[75391]: INFO nova.compute.manager [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Rebooting instance
Nov 15 02:45:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "refresh_cache-25884e14-afa3-4e5d-8154-a9e9eb455b94" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:45:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquired lock "refresh_cache-25884e14-afa3-4e5d-8154-a9e9eb455b94" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:45:09 user nova-compute[75391]: DEBUG nova.network.neutron [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:45:10 user nova-compute[75391]: DEBUG nova.network.neutron [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Updating instance_info_cache with network_info: [{"id": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "address": "fa:16:3e:6b:28:6d", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b8f74f5-6f", "ovs_interfaceid": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:45:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Releasing lock "refresh_cache-25884e14-afa3-4e5d-8154-a9e9eb455b94" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:45:10 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:45:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:10 user nova-compute[75391]: DEBUG nova.compute.manager [req-bf0142b4-61d9-4f00-afe9-11aabd9096a0 req-01fccc81-7a38-4655-8162-0be84d6eb7a9 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Received event network-vif-unplugged-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bf0142b4-61d9-4f00-afe9-11aabd9096a0 req-01fccc81-7a38-4655-8162-0be84d6eb7a9 service nova] Acquiring lock "25884e14-afa3-4e5d-8154-a9e9eb455b94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bf0142b4-61d9-4f00-afe9-11aabd9096a0 req-01fccc81-7a38-4655-8162-0be84d6eb7a9 service nova] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bf0142b4-61d9-4f00-afe9-11aabd9096a0 req-01fccc81-7a38-4655-8162-0be84d6eb7a9 service nova] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:10 user nova-compute[75391]: DEBUG nova.compute.manager [req-bf0142b4-61d9-4f00-afe9-11aabd9096a0 req-01fccc81-7a38-4655-8162-0be84d6eb7a9 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] No waiting events found dispatching network-vif-unplugged-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:45:10 user nova-compute[75391]: WARNING nova.compute.manager [req-bf0142b4-61d9-4f00-afe9-11aabd9096a0 req-01fccc81-7a38-4655-8162-0be84d6eb7a9 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Received unexpected event network-vif-unplugged-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 02:45:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:11 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Instance destroyed successfully.
Nov 15 02:45:11 user nova-compute[75391]: DEBUG nova.objects.instance [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lazy-loading 'resources' on Instance uuid 25884e14-afa3-4e5d-8154-a9e9eb455b94 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:42:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-228689750',display_name='tempest-TestMinimumBasicScenario-server-228689750',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-228689750',id=12,image_ref='143f1837-4d6a-4e72-b7f3-8571cb18b9e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwK3j8HHIRg419cIoS1FnvOd+dER4MDrZCMWVzQif1BmXlSl8hZBKvaJ6w8P2cNF/xp+wN/TK/t6oiz+7Ge/xo4VPAisWnTlayJP8UXoEhk3eR07YIFuG12GEzrT+Hxxw==',key_name='tempest-TestMinimumBasicScenario-1293343834',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:43:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41caf593c4994c5c86570e1216c01337',ramdisk_id='',reservation_id='r-gxn3d76p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='143f1837-4d6a-4e72-b7f3-8571cb18b9e3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1859352909',owner_user_name='tempest-TestMinimumBasicScenario-1859352909-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:45:10Z,user_data=None,user_id='409532d98aae4e5b962d3b142981c79a',uuid=25884e14-afa3-4e5d-8154-a9e9eb455b94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "address": "fa:16:3e:6b:28:6d", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b8f74f5-6f", "ovs_interfaceid": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Converting VIF {"id": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "address": "fa:16:3e:6b:28:6d", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b8f74f5-6f", "ovs_interfaceid": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:28:6d,bridge_name='br-int',has_traffic_filtering=True,id=6b8f74f5-6f5f-4946-afdb-80269c0d03b1,network=Network(ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b8f74f5-6f') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG os_vif [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:28:6d,bridge_name='br-int',has_traffic_filtering=True,id=6b8f74f5-6f5f-4946-afdb-80269c0d03b1,network=Network(ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b8f74f5-6f') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b8f74f5-6f, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=04808d7b-0a2b-44fe-8343-e311af3b0fc7) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:45:11 user nova-compute[75391]: INFO os_vif [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:28:6d,bridge_name='br-int',has_traffic_filtering=True,id=6b8f74f5-6f5f-4946-afdb-80269c0d03b1,network=Network(ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b8f74f5-6f')
Nov 15 02:45:11 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JMOTbEVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:45:11 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:45:11 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac687749-0537-42f4-bc25-68c9ed50ebfd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:45:11 user nova-compute[75391]: No targets found.
Nov 15 02:45:11 user nova-compute[75391]: iSNS:
Nov 15 02:45:11 user nova-compute[75391]: No targets found.
Nov 15 02:45:11 user nova-compute[75391]: STATIC:
Nov 15 02:45:11 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40
Nov 15 02:45:11 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:45:11 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:45:11 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b
Nov 15 02:45:11 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:45:11 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:45:11 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502
Nov 15 02:45:11 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:45:11 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:45:11 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:45:11 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:45:11 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:45:11 user nova-compute[75391]: FIRMWARE:
Nov 15 02:45:11 user nova-compute[75391]: No targets found.
Nov 15 02:45:11 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:45:11 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:45:11 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a45e19-98e9-4115-b7f3-882a6f91667d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06d2942-6c02-42bf-8155-d9ada385f89c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:45:11 user nova-compute[75391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)
Nov 15 02:45:11 user nova-compute[75391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:45:11 user nova-compute[75391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:45:11 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:45:11 user nova-compute[75391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)
Nov 15 02:45:11 user nova-compute[75391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:45:11 user nova-compute[75391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:45:11 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f622460f5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b'): ({'sde'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Removing single pathed devices sde {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f9cd30-7baf-4705-9159-ae83756c10c2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e55e22-cc5b-4a1d-8ce0-fcb98f4f73dc]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Flushing IO for device /dev/sde {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a726641f-b339-4551-9455-7f8c7225d42f]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a97c1c-38da-4680-80ce-e46749464679]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] SCSI volumes sde have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[78782170-05c1-4c57-948f-b8176e1293a1]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5013be-1be5-4479-a7ca-27842c58e9f4]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b, portal: 172.16.0.220,3260]
Nov 15 02:45:11 user nova-compute[75391]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b, portal: 172.16.0.220,3260] successful.
Nov 15 02:45:11 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fa841a-2f25-42e8-9e6b-ba2e2c6921ce]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] <== disconnect_volume: return (317ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Start _get_guest_xml network_info=[{"id": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "address": "fa:16:3e:6b:28:6d", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b8f74f5-6f", "ovs_interfaceid": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=143f1837-4d6a-4e72-b7f3-8571cb18b9e3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '143f1837-4d6a-4e72-b7f3-8571cb18b9e3'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'f4525567-94f6-436a-b4cc-d6172620210c', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JMOTbEVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '25884e14-afa3-4e5d-8154-a9e9eb455b94', 'attached_at': '', 'detached_at': '', 'volume_id': 'ecf120b3-e9f4-444f-9a88-9284f626152b', 'serial': 'ecf120b3-e9f4-444f-9a88-9284f626152b'}, 'volume_type': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:45:11 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:45:11 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:45:11 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=143f1837-4d6a-4e72-b7f3-8571cb18b9e3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG nova.objects.instance [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lazy-loading 'vcpu_model' on Instance uuid 25884e14-afa3-4e5d-8154-a9e9eb455b94 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:45:11 user nova-compute[75391]: DEBUG nova.objects.base [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Object Instance<25884e14-afa3-4e5d-8154-a9e9eb455b94> lazy-loaded attributes: resources,vcpu_model {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JMOTbEVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:45:12 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:45:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:45:12 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:45:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:45:12 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a405963e-ecdb-4ac7-8a69-4ec91d3fc603]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:45:12 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c90e1f0-0417-4f1e-9e04-80ec004669ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b] added
Nov 15 02:45:12 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a52630a-ea4f-49c2-96c7-d8984ec3e6ff]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[db159422-b0ff-4592-9dfb-1c312372be0f]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JMOTbEVU {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JMOTbEVU" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d757bb-fcf3-4129-acdb-4a5b8aa6a470]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JMOTbEVU'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d6c86a-c6b2-4402-a9c9-260fb9eeb4fc]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[88794ab9-a21c-455a-9800-ff0baf275328]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:45:12 user nova-compute[75391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)
Nov 15 02:45:12 user nova-compute[75391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:45:12 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:45:12 user nova-compute[75391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)
Nov 15 02:45:12 user nova-compute[75391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:45:12 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9291065c-bb52-46dd-b1b6-3204ead4fed8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b, portal: 172.16.0.220,3260]
Nov 15 02:45:12 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b, portal: 172.16.0.220,3260] successful.
Nov 15 02:45:12 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[054fca22-dcc5-4d7a-8337-fe1fcdc33742]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3751ed-fd8f-414a-a4e3-17f94cd8aa33]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:45:12 user nova-compute[75391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)
Nov 15 02:45:12 user nova-compute[75391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:45:12 user nova-compute[75391]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:45:12 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:45:12 user nova-compute[75391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)
Nov 15 02:45:12 user nova-compute[75391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:45:12 user nova-compute[75391]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:45:12 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4a007e-c88c-4fbf-8d3e-862f9cebd632]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JMOTbEVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-ded13d26-34ab-4ae5-bcdd-17f47bc23afb req-57ae13aa-d58a-459c-83d3-871a608e90da service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Received event network-vif-plugged-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ded13d26-34ab-4ae5-bcdd-17f47bc23afb req-57ae13aa-d58a-459c-83d3-871a608e90da service nova] Acquiring lock "25884e14-afa3-4e5d-8154-a9e9eb455b94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ded13d26-34ab-4ae5-bcdd-17f47bc23afb req-57ae13aa-d58a-459c-83d3-871a608e90da service nova] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ded13d26-34ab-4ae5-bcdd-17f47bc23afb req-57ae13aa-d58a-459c-83d3-871a608e90da service nova] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-ded13d26-34ab-4ae5-bcdd-17f47bc23afb req-57ae13aa-d58a-459c-83d3-871a608e90da service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] No waiting events found dispatching network-vif-plugged-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:45:12 user nova-compute[75391]: WARNING nova.compute.manager [req-ded13d26-34ab-4ae5-bcdd-17f47bc23afb req-57ae13aa-d58a-459c-83d3-871a608e90da service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Received unexpected event network-vif-plugged-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 02:45:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2dfadd75-a76d-4caf-94d5-f3620b834228 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Acquiring lock "bc5c2514-d819-4792-afde-dfedc85e8e88" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2dfadd75-a76d-4caf-94d5-f3620b834228 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Lock "bc5c2514-d819-4792-afde-dfedc85e8e88" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2dfadd75-a76d-4caf-94d5-f3620b834228 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Acquiring lock "bc5c2514-d819-4792-afde-dfedc85e8e88-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2dfadd75-a76d-4caf-94d5-f3620b834228 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Lock "bc5c2514-d819-4792-afde-dfedc85e8e88-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2dfadd75-a76d-4caf-94d5-f3620b834228 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Lock "bc5c2514-d819-4792-afde-dfedc85e8e88-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:13 user nova-compute[75391]: INFO nova.compute.manager [None req-2dfadd75-a76d-4caf-94d5-f3620b834228 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Terminating instance
Nov 15 02:45:13 user nova-compute[75391]: DEBUG nova.compute.manager [None req-2dfadd75-a76d-4caf-94d5-f3620b834228 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26461663636646466', 'path': '/dev/sdb'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461663636646466', 'path': '/dev/sdb'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:42:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-228689750',display_name='tempest-TestMinimumBasicScenario-server-228689750',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-228689750',id=12,image_ref='143f1837-4d6a-4e72-b7f3-8571cb18b9e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwK3j8HHIRg419cIoS1FnvOd+dER4MDrZCMWVzQif1BmXlSl8hZBKvaJ6w8P2cNF/xp+wN/TK/t6oiz+7Ge/xo4VPAisWnTlayJP8UXoEhk3eR07YIFuG12GEzrT+Hxxw==',key_name='tempest-TestMinimumBasicScenario-1293343834',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:43:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41caf593c4994c5c86570e1216c01337',ramdisk_id='',reservation_id='r-gxn3d76p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='143f1837-4d6a-4e72-b7f3-8571cb18b9e3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1859352909',owner_user_name='tempest-TestMinimumBasicScenario-1859352909-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:45:10Z,user_data=None,user_id='409532d98aae4e5b962d3b142981c79a',uuid=25884e14-afa3-4e5d-8154-a9e9eb455b94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "address": "fa:16:3e:6b:28:6d", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b8f74f5-6f", "ovs_interfaceid": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Converting VIF {"id": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "address": "fa:16:3e:6b:28:6d", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b8f74f5-6f", "ovs_interfaceid": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:28:6d,bridge_name='br-int',has_traffic_filtering=True,id=6b8f74f5-6f5f-4946-afdb-80269c0d03b1,network=Network(ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b8f74f5-6f') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG nova.objects.instance [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lazy-loading 'pci_devices' on Instance uuid 25884e14-afa3-4e5d-8154-a9e9eb455b94 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG nova.objects.base [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Object Instance<25884e14-afa3-4e5d-8154-a9e9eb455b94> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:45:13 user nova-compute[75391]:   <uuid>25884e14-afa3-4e5d-8154-a9e9eb455b94</uuid>
Nov 15 02:45:13 user nova-compute[75391]:   <name>instance-0000000c</name>
Nov 15 02:45:13 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:45:13 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:45:13 user nova-compute[75391]:   <metadata>
Nov 15 02:45:13 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:45:13 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:45:13 user nova-compute[75391]:       <nova:name>tempest-TestMinimumBasicScenario-server-228689750</nova:name>
Nov 15 02:45:13 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:45:11</nova:creationTime>
Nov 15 02:45:13 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:45:13 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:45:13 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:45:13 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:45:13 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:45:13 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:45:13 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:45:13 user nova-compute[75391]:       <nova:owner>
Nov 15 02:45:13 user nova-compute[75391]:         <nova:user uuid="409532d98aae4e5b962d3b142981c79a">tempest-TestMinimumBasicScenario-1859352909-project-member</nova:user>
Nov 15 02:45:13 user nova-compute[75391]:         <nova:project uuid="41caf593c4994c5c86570e1216c01337">tempest-TestMinimumBasicScenario-1859352909</nova:project>
Nov 15 02:45:13 user nova-compute[75391]:       </nova:owner>
Nov 15 02:45:13 user nova-compute[75391]:       <nova:root type="image" uuid="143f1837-4d6a-4e72-b7f3-8571cb18b9e3"/>
Nov 15 02:45:13 user nova-compute[75391]:       <nova:ports>
Nov 15 02:45:13 user nova-compute[75391]:         <nova:port uuid="6b8f74f5-6f5f-4946-afdb-80269c0d03b1">
Nov 15 02:45:13 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 02:45:13 user nova-compute[75391]:         </nova:port>
Nov 15 02:45:13 user nova-compute[75391]:       </nova:ports>
Nov 15 02:45:13 user nova-compute[75391]:     </nova:instance>
Nov 15 02:45:13 user nova-compute[75391]:   </metadata>
Nov 15 02:45:13 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:45:13 user nova-compute[75391]:     <system>
Nov 15 02:45:13 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:45:13 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:45:13 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:45:13 user nova-compute[75391]:       <entry name="serial">25884e14-afa3-4e5d-8154-a9e9eb455b94</entry>
Nov 15 02:45:13 user nova-compute[75391]:       <entry name="uuid">25884e14-afa3-4e5d-8154-a9e9eb455b94</entry>
Nov 15 02:45:13 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:45:13 user nova-compute[75391]:     </system>
Nov 15 02:45:13 user nova-compute[75391]:   </sysinfo>
Nov 15 02:45:13 user nova-compute[75391]:   <os>
Nov 15 02:45:13 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:45:13 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:45:13 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:45:13 user nova-compute[75391]:   </os>
Nov 15 02:45:13 user nova-compute[75391]:   <features>
Nov 15 02:45:13 user nova-compute[75391]:     <acpi/>
Nov 15 02:45:13 user nova-compute[75391]:     <apic/>
Nov 15 02:45:13 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:45:13 user nova-compute[75391]:   </features>
Nov 15 02:45:13 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:45:13 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:45:13 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:45:13 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:45:13 user nova-compute[75391]:   </clock>
Nov 15 02:45:13 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:45:13 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:45:13 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:45:13 user nova-compute[75391]:   </cpu>
Nov 15 02:45:13 user nova-compute[75391]:   <devices>
Nov 15 02:45:13 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:45:13 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:45:13 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk"/>
Nov 15 02:45:13 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:45:13 user nova-compute[75391]:     </disk>
Nov 15 02:45:13 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 02:45:13 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:45:13 user nova-compute[75391]:       <source dev="/dev/sdb"/>
Nov 15 02:45:13 user nova-compute[75391]:       <target dev="vdb" bus="virtio"/>
Nov 15 02:45:13 user nova-compute[75391]:       <serial>ecf120b3-e9f4-444f-9a88-9284f626152b</serial>
Nov 15 02:45:13 user nova-compute[75391]:     </disk>
Nov 15 02:45:13 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:45:13 user nova-compute[75391]:       <mac address="fa:16:3e:6b:28:6d"/>
Nov 15 02:45:13 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:45:13 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:45:13 user nova-compute[75391]:       <target dev="tap6b8f74f5-6f"/>
Nov 15 02:45:13 user nova-compute[75391]:     </interface>
Nov 15 02:45:13 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:45:13 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/console.log" append="off"/>
Nov 15 02:45:13 user nova-compute[75391]:     </serial>
Nov 15 02:45:13 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:45:13 user nova-compute[75391]:     <video>
Nov 15 02:45:13 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:45:13 user nova-compute[75391]:     </video>
Nov 15 02:45:13 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:45:13 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:45:13 user nova-compute[75391]:     </rng>
Nov 15 02:45:13 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:45:13 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:45:13 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:45:13 user nova-compute[75391]:     </memballoon>
Nov 15 02:45:13 user nova-compute[75391]:   </devices>
Nov 15 02:45:13 user nova-compute[75391]: </domain>
Nov 15 02:45:13 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG nova.compute.manager [req-3330dcf8-fd70-4234-9c49-177ab1b845af req-f2a70f57-94ab-420a-97e4-c7a37612b157 service nova] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Received event network-vif-unplugged-499cebaa-a6e6-4908-b5c5-1bc2b199b439 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3330dcf8-fd70-4234-9c49-177ab1b845af req-f2a70f57-94ab-420a-97e4-c7a37612b157 service nova] Acquiring lock "bc5c2514-d819-4792-afde-dfedc85e8e88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3330dcf8-fd70-4234-9c49-177ab1b845af req-f2a70f57-94ab-420a-97e4-c7a37612b157 service nova] Lock "bc5c2514-d819-4792-afde-dfedc85e8e88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3330dcf8-fd70-4234-9c49-177ab1b845af req-f2a70f57-94ab-420a-97e4-c7a37612b157 service nova] Lock "bc5c2514-d819-4792-afde-dfedc85e8e88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG nova.compute.manager [req-3330dcf8-fd70-4234-9c49-177ab1b845af req-f2a70f57-94ab-420a-97e4-c7a37612b157 service nova] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] No waiting events found dispatching network-vif-unplugged-499cebaa-a6e6-4908-b5c5-1bc2b199b439 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG nova.compute.manager [req-3330dcf8-fd70-4234-9c49-177ab1b845af req-f2a70f57-94ab-420a-97e4-c7a37612b157 service nova] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Received event network-vif-unplugged-499cebaa-a6e6-4908-b5c5-1bc2b199b439 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG nova.objects.instance [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lazy-loading 'trusted_certs' on Instance uuid 25884e14-afa3-4e5d-8154-a9e9eb455b94 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG nova.objects.base [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Object Instance<25884e14-afa3-4e5d-8154-a9e9eb455b94> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:45:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96c3e94aea325c0be9d564670108914ecea7194e --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:13 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Instance destroyed successfully.
Nov 15 02:45:13 user nova-compute[75391]: DEBUG nova.objects.instance [None req-2dfadd75-a76d-4caf-94d5-f3620b834228 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Lazy-loading 'resources' on Instance uuid bc5c2514-d819-4792-afde-dfedc85e8e88 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-2dfadd75-a76d-4caf-94d5-f3620b834228 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:42:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1703782390',display_name='tempest-VolumesAssistedSnapshotsTest-server-1703782390',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1703782390',id=9,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL43LfUGl6vbc4UW7yXYL9EaIAOW1TrytVHY0WnlQcK0XSjkNsjLpCvv3kPBkYYxfQ3UirJhkOuwc+KcXtO/claGU1k1Lc4jXxmmZhXjvWAVGKeiOti7vah5OCEeJkdI5g==',key_name='tempest-keypair-560516658',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:42:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09abd2ac842143d59109cf7bcccb9dc5',ramdisk_id='',reservation_id='r-zl4p4p5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1119885311',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1119885311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:42:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d752791054974d108ceabe28f5db090b',uuid=bc5c2514-d819-4792-afde-dfedc85e8e88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "499cebaa-a6e6-4908-b5c5-1bc2b199b439", "address": "fa:16:3e:57:1b:52", "network": {"id": "d15ab552-8cb5-4ee5-b029-f7149258b103", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-788844379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09abd2ac842143d59109cf7bcccb9dc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499cebaa-a6", "ovs_interfaceid": "499cebaa-a6e6-4908-b5c5-1bc2b199b439", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-2dfadd75-a76d-4caf-94d5-f3620b834228 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Converting VIF {"id": "499cebaa-a6e6-4908-b5c5-1bc2b199b439", "address": "fa:16:3e:57:1b:52", "network": {"id": "d15ab552-8cb5-4ee5-b029-f7149258b103", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-788844379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09abd2ac842143d59109cf7bcccb9dc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499cebaa-a6", "ovs_interfaceid": "499cebaa-a6e6-4908-b5c5-1bc2b199b439", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-2dfadd75-a76d-4caf-94d5-f3620b834228 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:1b:52,bridge_name='br-int',has_traffic_filtering=True,id=499cebaa-a6e6-4908-b5c5-1bc2b199b439,network=Network(d15ab552-8cb5-4ee5-b029-f7149258b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap499cebaa-a6') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG os_vif [None req-2dfadd75-a76d-4caf-94d5-f3620b834228 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:1b:52,bridge_name='br-int',has_traffic_filtering=True,id=499cebaa-a6e6-4908-b5c5-1bc2b199b439,network=Network(d15ab552-8cb5-4ee5-b029-f7149258b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap499cebaa-a6') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap499cebaa-a6, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96c3e94aea325c0be9d564670108914ecea7194e --force-share --output=json" returned: 0 in 0.184s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=18eb9f06-6177-4b09-8a9c-2baa6264896c) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:14 user nova-compute[75391]: INFO os_vif [None req-2dfadd75-a76d-4caf-94d5-f3620b834228 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:1b:52,bridge_name='br-int',has_traffic_filtering=True,id=499cebaa-a6e6-4908-b5c5-1bc2b199b439,network=Network(d15ab552-8cb5-4ee5-b029-f7149258b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap499cebaa-a6')
Nov 15 02:45:14 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-2dfadd75-a76d-4caf-94d5-f3620b834228 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Deleting instance files /opt/stack/data/nova/instances/bc5c2514-d819-4792-afde-dfedc85e8e88_del
Nov 15 02:45:14 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-2dfadd75-a76d-4caf-94d5-f3620b834228 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Deletion of /opt/stack/data/nova/instances/bc5c2514-d819-4792-afde-dfedc85e8e88_del complete
Nov 15 02:45:14 user nova-compute[75391]: INFO nova.compute.manager [None req-2dfadd75-a76d-4caf-94d5-f3620b834228 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 15 02:45:14 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-2dfadd75-a76d-4caf-94d5-f3620b834228 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Cannot resize image /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG nova.objects.instance [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lazy-loading 'migration_context' on Instance uuid 25884e14-afa3-4e5d-8154-a9e9eb455b94 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG nova.objects.base [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Object Instance<25884e14-afa3-4e5d-8154-a9e9eb455b94> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:42:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-228689750',display_name='tempest-TestMinimumBasicScenario-server-228689750',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-228689750',id=12,image_ref='143f1837-4d6a-4e72-b7f3-8571cb18b9e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwK3j8HHIRg419cIoS1FnvOd+dER4MDrZCMWVzQif1BmXlSl8hZBKvaJ6w8P2cNF/xp+wN/TK/t6oiz+7Ge/xo4VPAisWnTlayJP8UXoEhk3eR07YIFuG12GEzrT+Hxxw==',key_name='tempest-TestMinimumBasicScenario-1293343834',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:43:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='41caf593c4994c5c86570e1216c01337',ramdisk_id='',reservation_id='r-gxn3d76p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='143f1837-4d6a-4e72-b7f3-8571cb18b9e3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1859352909',owner_user_name='tempest-TestMinimumBasicScenario-1859352909-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:45:10Z,user_data=None,user_id='409532d98aae4e5b962d3b142981c79a',uuid=25884e14-afa3-4e5d-8154-a9e9eb455b94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "address": "fa:16:3e:6b:28:6d", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b8f74f5-6f", "ovs_interfaceid": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Converting VIF {"id": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "address": "fa:16:3e:6b:28:6d", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b8f74f5-6f", "ovs_interfaceid": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:28:6d,bridge_name='br-int',has_traffic_filtering=True,id=6b8f74f5-6f5f-4946-afdb-80269c0d03b1,network=Network(ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b8f74f5-6f') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG os_vif [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:28:6d,bridge_name='br-int',has_traffic_filtering=True,id=6b8f74f5-6f5f-4946-afdb-80269c0d03b1,network=Network(ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b8f74f5-6f') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd4229937-8fbf-5e31-a202-900d6be50ace', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b8f74f5-6f, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b8f74f5-6f, col_values=(('qos', UUID('4ead4424-aab6-4a8a-aff2-dbba3e510b97')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b8f74f5-6f, col_values=(('external_ids', {'iface-id': '6b8f74f5-6f5f-4946-afdb-80269c0d03b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:28:6d', 'vm-uuid': '25884e14-afa3-4e5d-8154-a9e9eb455b94'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:14 user nova-compute[75391]: INFO os_vif [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:28:6d,bridge_name='br-int',has_traffic_filtering=True,id=6b8f74f5-6f5f-4946-afdb-80269c0d03b1,network=Network(ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b8f74f5-6f')
Nov 15 02:45:14 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG nova.compute.manager [req-b92f0db4-d3a4-4602-8c0e-8495bd9e0d6c req-60cf8a67-b062-48bd-8fd3-7694323a9ab5 service nova] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Received event network-vif-deleted-499cebaa-a6e6-4908-b5c5-1bc2b199b439 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:14 user nova-compute[75391]: INFO nova.compute.manager [req-b92f0db4-d3a4-4602-8c0e-8495bd9e0d6c req-60cf8a67-b062-48bd-8fd3-7694323a9ab5 service nova] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Neutron deleted interface 499cebaa-a6e6-4908-b5c5-1bc2b199b439; detaching it from the instance and deleting it from the info cache
Nov 15 02:45:14 user nova-compute[75391]: DEBUG nova.network.neutron [req-b92f0db4-d3a4-4602-8c0e-8495bd9e0d6c req-60cf8a67-b062-48bd-8fd3-7694323a9ab5 service nova] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:45:14 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Took 0.72 seconds to deallocate network for instance.
Nov 15 02:45:14 user nova-compute[75391]: DEBUG nova.compute.manager [req-b92f0db4-d3a4-4602-8c0e-8495bd9e0d6c req-60cf8a67-b062-48bd-8fd3-7694323a9ab5 service nova] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Detach interface failed, port_id=499cebaa-a6e6-4908-b5c5-1bc2b199b439, reason: Instance bc5c2514-d819-4792-afde-dfedc85e8e88 could not be found. {{(pid=75391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2dfadd75-a76d-4caf-94d5-f3620b834228 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2dfadd75-a76d-4caf-94d5-f3620b834228 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:15 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-2dfadd75-a76d-4caf-94d5-f3620b834228 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:45:15 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-2dfadd75-a76d-4caf-94d5-f3620b834228 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:45:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2dfadd75-a76d-4caf-94d5-f3620b834228 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:15 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-2dfadd75-a76d-4caf-94d5-f3620b834228 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Deleted allocations for instance bc5c2514-d819-4792-afde-dfedc85e8e88
Nov 15 02:45:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2dfadd75-a76d-4caf-94d5-f3620b834228 tempest-VolumesAssistedSnapshotsTest-1119885311 tempest-VolumesAssistedSnapshotsTest-1119885311-project-member] Lock "bc5c2514-d819-4792-afde-dfedc85e8e88" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.295s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:15 user nova-compute[75391]: DEBUG nova.compute.manager [req-fc914c91-11ab-415d-8a76-7c39a7af9338 req-6e3e17c6-eb1f-47f6-889c-989450baed2d service nova] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Received event network-vif-plugged-499cebaa-a6e6-4908-b5c5-1bc2b199b439 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-fc914c91-11ab-415d-8a76-7c39a7af9338 req-6e3e17c6-eb1f-47f6-889c-989450baed2d service nova] Acquiring lock "bc5c2514-d819-4792-afde-dfedc85e8e88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-fc914c91-11ab-415d-8a76-7c39a7af9338 req-6e3e17c6-eb1f-47f6-889c-989450baed2d service nova] Lock "bc5c2514-d819-4792-afde-dfedc85e8e88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-fc914c91-11ab-415d-8a76-7c39a7af9338 req-6e3e17c6-eb1f-47f6-889c-989450baed2d service nova] Lock "bc5c2514-d819-4792-afde-dfedc85e8e88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:15 user nova-compute[75391]: DEBUG nova.compute.manager [req-fc914c91-11ab-415d-8a76-7c39a7af9338 req-6e3e17c6-eb1f-47f6-889c-989450baed2d service nova] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] No waiting events found dispatching network-vif-plugged-499cebaa-a6e6-4908-b5c5-1bc2b199b439 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:45:15 user nova-compute[75391]: WARNING nova.compute.manager [req-fc914c91-11ab-415d-8a76-7c39a7af9338 req-6e3e17c6-eb1f-47f6-889c-989450baed2d service nova] [instance: bc5c2514-d819-4792-afde-dfedc85e8e88] Received unexpected event network-vif-plugged-499cebaa-a6e6-4908-b5c5-1bc2b199b439 for instance with vm_state deleted and task_state None.
Nov 15 02:45:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:16 user nova-compute[75391]: DEBUG nova.compute.manager [req-99269253-bb6b-4bbd-a2cc-c1249fe5eddc req-3e41f219-77b4-49f7-8226-1ecc3fad8a7b service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Received event network-vif-plugged-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-99269253-bb6b-4bbd-a2cc-c1249fe5eddc req-3e41f219-77b4-49f7-8226-1ecc3fad8a7b service nova] Acquiring lock "25884e14-afa3-4e5d-8154-a9e9eb455b94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-99269253-bb6b-4bbd-a2cc-c1249fe5eddc req-3e41f219-77b4-49f7-8226-1ecc3fad8a7b service nova] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-99269253-bb6b-4bbd-a2cc-c1249fe5eddc req-3e41f219-77b4-49f7-8226-1ecc3fad8a7b service nova] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:16 user nova-compute[75391]: DEBUG nova.compute.manager [req-99269253-bb6b-4bbd-a2cc-c1249fe5eddc req-3e41f219-77b4-49f7-8226-1ecc3fad8a7b service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] No waiting events found dispatching network-vif-plugged-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:45:16 user nova-compute[75391]: WARNING nova.compute.manager [req-99269253-bb6b-4bbd-a2cc-c1249fe5eddc req-3e41f219-77b4-49f7-8226-1ecc3fad8a7b service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Received unexpected event network-vif-plugged-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 02:45:16 user nova-compute[75391]: DEBUG nova.compute.manager [req-99269253-bb6b-4bbd-a2cc-c1249fe5eddc req-3e41f219-77b4-49f7-8226-1ecc3fad8a7b service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Received event network-vif-plugged-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-99269253-bb6b-4bbd-a2cc-c1249fe5eddc req-3e41f219-77b4-49f7-8226-1ecc3fad8a7b service nova] Acquiring lock "25884e14-afa3-4e5d-8154-a9e9eb455b94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-99269253-bb6b-4bbd-a2cc-c1249fe5eddc req-3e41f219-77b4-49f7-8226-1ecc3fad8a7b service nova] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-99269253-bb6b-4bbd-a2cc-c1249fe5eddc req-3e41f219-77b4-49f7-8226-1ecc3fad8a7b service nova] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:16 user nova-compute[75391]: DEBUG nova.compute.manager [req-99269253-bb6b-4bbd-a2cc-c1249fe5eddc req-3e41f219-77b4-49f7-8226-1ecc3fad8a7b service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] No waiting events found dispatching network-vif-plugged-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:45:16 user nova-compute[75391]: WARNING nova.compute.manager [req-99269253-bb6b-4bbd-a2cc-c1249fe5eddc req-3e41f219-77b4-49f7-8226-1ecc3fad8a7b service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Received unexpected event network-vif-plugged-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 02:45:17 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:17 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 38a63a30-a3bc-4556-9fb6-53522dbf2c68 is timed out.
Nov 15 02:45:17 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Successfully detached device vdb from instance 38a63a30-a3bc-4556-9fb6-53522dbf2c68 from the live domain config.
Nov 15 02:45:17 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hEBPTxco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:45:17 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:45:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae12c110-2594-4037-bb2f-6a962e79edc6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:45:17 user nova-compute[75391]: No targets found.
Nov 15 02:45:17 user nova-compute[75391]: iSNS:
Nov 15 02:45:17 user nova-compute[75391]: No targets found.
Nov 15 02:45:17 user nova-compute[75391]: STATIC:
Nov 15 02:45:17 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40
Nov 15 02:45:17 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:45:17 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:45:17 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b
Nov 15 02:45:17 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:45:17 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:45:17 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502
Nov 15 02:45:17 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:45:17 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:45:17 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:45:17 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:45:17 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:45:17 user nova-compute[75391]: FIRMWARE:
Nov 15 02:45:17 user nova-compute[75391]: No targets found.
Nov 15 02:45:17 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:45:17 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:45:17 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd8db4d-e28b-4079-a2b4-11ce7438cd66]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c87a2d8-2ead-498f-91d0-d5fdc746aaff]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:45:17 user nova-compute[75391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)
Nov 15 02:45:17 user nova-compute[75391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:45:17 user nova-compute[75391]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:45:17 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:45:17 user nova-compute[75391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 (non-flash)
Nov 15 02:45:17 user nova-compute[75391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:45:17 user nova-compute[75391]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:45:17 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f622460f5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502'): ({'sdd'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Removing single pathed devices sdd {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb181ee-7bbd-4de4-94d0-55ae246bc7c9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[948887ea-6716-4e3a-bf38-419c596bd9b8]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Flushing IO for device /dev/sdd {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[24947417-da19-4c00-8dd8-b2b1cbb2612e]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[09492591-d27a-485c-ac1a-d7e8ac8967ac]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] SCSI volumes sdd have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f91373-4824-4f78-b253-a6a603950028]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadf5146-6699-42ec-9268-eac573859356]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502, portal: 172.16.0.220,3260]
Nov 15 02:45:17 user nova-compute[75391]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502, portal: 172.16.0.220,3260] successful.
Nov 15 02:45:17 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7803467e-bc05-49f4-9a9f-3b48ce2b0502 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[89681a9f-2d21-4458-bd6c-8088966f3147]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] <== disconnect_volume: return (306ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:45:17 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:45:18 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Instance rebooted successfully.
Nov 15 02:45:18 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:45:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5a9c423e-3602-43a5-a369-0707c66b37bc tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.343s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:18 user nova-compute[75391]: DEBUG nova.objects.instance [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lazy-loading 'flavor' on Instance uuid 38a63a30-a3bc-4556-9fb6-53522dbf2c68 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:45:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-57e8292b-fc44-4568-9b4f-13f0c3e50549 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.764s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:22 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8f21230f-6673-4513-975c-59cca845dccb tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Acquiring lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8f21230f-6673-4513-975c-59cca845dccb tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8f21230f-6673-4513-975c-59cca845dccb tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Acquiring lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8f21230f-6673-4513-975c-59cca845dccb tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8f21230f-6673-4513-975c-59cca845dccb tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:33 user nova-compute[75391]: INFO nova.compute.manager [None req-8f21230f-6673-4513-975c-59cca845dccb tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Terminating instance
Nov 15 02:45:33 user nova-compute[75391]: DEBUG nova.compute.manager [None req-8f21230f-6673-4513-975c-59cca845dccb tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:45:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-89888985-4b21-4573-be0b-b9d22227efe2 req-17393309-08e9-48ce-8b7d-d59928d13fe2 service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Received event network-vif-unplugged-86eacc9d-8245-4fa1-9a0a-a0a9f396872b {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-89888985-4b21-4573-be0b-b9d22227efe2 req-17393309-08e9-48ce-8b7d-d59928d13fe2 service nova] Acquiring lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-89888985-4b21-4573-be0b-b9d22227efe2 req-17393309-08e9-48ce-8b7d-d59928d13fe2 service nova] Lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-89888985-4b21-4573-be0b-b9d22227efe2 req-17393309-08e9-48ce-8b7d-d59928d13fe2 service nova] Lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-89888985-4b21-4573-be0b-b9d22227efe2 req-17393309-08e9-48ce-8b7d-d59928d13fe2 service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] No waiting events found dispatching network-vif-unplugged-86eacc9d-8245-4fa1-9a0a-a0a9f396872b {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:45:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-89888985-4b21-4573-be0b-b9d22227efe2 req-17393309-08e9-48ce-8b7d-d59928d13fe2 service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Received event network-vif-unplugged-86eacc9d-8245-4fa1-9a0a-a0a9f396872b for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:45:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:34 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Instance destroyed successfully.
Nov 15 02:45:34 user nova-compute[75391]: DEBUG nova.objects.instance [None req-8f21230f-6673-4513-975c-59cca845dccb tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lazy-loading 'resources' on Instance uuid bb472aa5-47dd-48d6-8e9f-e179afd1d8ec {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:45:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-8f21230f-6673-4513-975c-59cca845dccb tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:42:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-84898992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-84898992',id=7,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjGjAlXtIFwyK48Tn0rWDvwO+CMiqK5nwES7Ozr0xqfWpvP+GLtsNTghKrGqtv5RFJtUL1Xov3deHDY6XnlkjWriT5bcxPdE96duFESi6cETl7FauYVa7ChUe8ZPLW7IQ==',key_name='tempest-keypair-1251809303',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:42:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68070c12bf9f4c45a8c12165d571fa41',ramdisk_id='',reservation_id='r-j0qi94j3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-382223691',owner_user_name='tempest-TaggedAttachmentsTest-382223691-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:42:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1727eae8986646508dbb022ae69ab573',uuid=bb472aa5-47dd-48d6-8e9f-e179afd1d8ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86eacc9d-8245-4fa1-9a0a-a0a9f396872b", "address": "fa:16:3e:08:66:14", "network": {"id": "c36f20d0-0398-4c34-b593-d9610a7b5fc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-689770940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68070c12bf9f4c45a8c12165d571fa41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eacc9d-82", "ovs_interfaceid": "86eacc9d-8245-4fa1-9a0a-a0a9f396872b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:45:34 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-8f21230f-6673-4513-975c-59cca845dccb tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Converting VIF {"id": "86eacc9d-8245-4fa1-9a0a-a0a9f396872b", "address": "fa:16:3e:08:66:14", "network": {"id": "c36f20d0-0398-4c34-b593-d9610a7b5fc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-689770940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68070c12bf9f4c45a8c12165d571fa41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eacc9d-82", "ovs_interfaceid": "86eacc9d-8245-4fa1-9a0a-a0a9f396872b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:45:34 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-8f21230f-6673-4513-975c-59cca845dccb tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:66:14,bridge_name='br-int',has_traffic_filtering=True,id=86eacc9d-8245-4fa1-9a0a-a0a9f396872b,network=Network(c36f20d0-0398-4c34-b593-d9610a7b5fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86eacc9d-82') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:45:34 user nova-compute[75391]: DEBUG os_vif [None req-8f21230f-6673-4513-975c-59cca845dccb tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:66:14,bridge_name='br-int',has_traffic_filtering=True,id=86eacc9d-8245-4fa1-9a0a-a0a9f396872b,network=Network(c36f20d0-0398-4c34-b593-d9610a7b5fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86eacc9d-82') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:45:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86eacc9d-82, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b13614a8-c36c-4de6-959c-e592eabcaf52) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:45:34 user nova-compute[75391]: INFO os_vif [None req-8f21230f-6673-4513-975c-59cca845dccb tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:66:14,bridge_name='br-int',has_traffic_filtering=True,id=86eacc9d-8245-4fa1-9a0a-a0a9f396872b,network=Network(c36f20d0-0398-4c34-b593-d9610a7b5fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86eacc9d-82')
Nov 15 02:45:34 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-8f21230f-6673-4513-975c-59cca845dccb tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Deleting instance files /opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec_del
Nov 15 02:45:34 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-8f21230f-6673-4513-975c-59cca845dccb tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Deletion of /opt/stack/data/nova/instances/bb472aa5-47dd-48d6-8e9f-e179afd1d8ec_del complete
Nov 15 02:45:34 user nova-compute[75391]: INFO nova.compute.manager [None req-8f21230f-6673-4513-975c-59cca845dccb tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 15 02:45:34 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-8f21230f-6673-4513-975c-59cca845dccb tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:45:34 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:45:34 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:45:35 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:45:35 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Took 1.10 seconds to deallocate network for instance.
Nov 15 02:45:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-500d5eac-afbd-4d88-93bb-f3474a4c3dee req-2c126b5e-45d7-4da4-9262-6497e0250169 service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Received event network-vif-deleted-86eacc9d-8245-4fa1-9a0a-a0a9f396872b {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8f21230f-6673-4513-975c-59cca845dccb tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8f21230f-6673-4513-975c-59cca845dccb tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:35 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-8f21230f-6673-4513-975c-59cca845dccb tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:45:35 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-8f21230f-6673-4513-975c-59cca845dccb tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:45:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8f21230f-6673-4513-975c-59cca845dccb tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:35 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-8f21230f-6673-4513-975c-59cca845dccb tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Deleted allocations for instance bb472aa5-47dd-48d6-8e9f-e179afd1d8ec
Nov 15 02:45:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8f21230f-6673-4513-975c-59cca845dccb tempest-TaggedAttachmentsTest-382223691 tempest-TaggedAttachmentsTest-382223691-project-member] Lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.622s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:36 user nova-compute[75391]: DEBUG nova.compute.manager [req-09d59b30-622c-4b13-a592-bbf26bbefb0f req-fa3046ee-11ce-4acc-977b-d2854f821e46 service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Received event network-vif-plugged-86eacc9d-8245-4fa1-9a0a-a0a9f396872b {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-09d59b30-622c-4b13-a592-bbf26bbefb0f req-fa3046ee-11ce-4acc-977b-d2854f821e46 service nova] Acquiring lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-09d59b30-622c-4b13-a592-bbf26bbefb0f req-fa3046ee-11ce-4acc-977b-d2854f821e46 service nova] Lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-09d59b30-622c-4b13-a592-bbf26bbefb0f req-fa3046ee-11ce-4acc-977b-d2854f821e46 service nova] Lock "bb472aa5-47dd-48d6-8e9f-e179afd1d8ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:36 user nova-compute[75391]: DEBUG nova.compute.manager [req-09d59b30-622c-4b13-a592-bbf26bbefb0f req-fa3046ee-11ce-4acc-977b-d2854f821e46 service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] No waiting events found dispatching network-vif-plugged-86eacc9d-8245-4fa1-9a0a-a0a9f396872b {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:45:36 user nova-compute[75391]: WARNING nova.compute.manager [req-09d59b30-622c-4b13-a592-bbf26bbefb0f req-fa3046ee-11ce-4acc-977b-d2854f821e46 service nova] [instance: bb472aa5-47dd-48d6-8e9f-e179afd1d8ec] Received unexpected event network-vif-plugged-86eacc9d-8245-4fa1-9a0a-a0a9f396872b for instance with vm_state deleted and task_state None.
Nov 15 02:45:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-92117be5-a131-40b0-9dc7-7ba6e74b76ad tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Acquiring lock "1fc39b27-762e-4bc8-90ba-0215d65710ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-92117be5-a131-40b0-9dc7-7ba6e74b76ad tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lock "1fc39b27-762e-4bc8-90ba-0215d65710ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-92117be5-a131-40b0-9dc7-7ba6e74b76ad tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Acquiring lock "1fc39b27-762e-4bc8-90ba-0215d65710ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-92117be5-a131-40b0-9dc7-7ba6e74b76ad tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lock "1fc39b27-762e-4bc8-90ba-0215d65710ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-92117be5-a131-40b0-9dc7-7ba6e74b76ad tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lock "1fc39b27-762e-4bc8-90ba-0215d65710ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:36 user nova-compute[75391]: INFO nova.compute.manager [None req-92117be5-a131-40b0-9dc7-7ba6e74b76ad tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Terminating instance
Nov 15 02:45:36 user nova-compute[75391]: DEBUG nova.compute.manager [None req-92117be5-a131-40b0-9dc7-7ba6e74b76ad tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:45:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:37 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Instance destroyed successfully.
Nov 15 02:45:37 user nova-compute[75391]: DEBUG nova.objects.instance [None req-92117be5-a131-40b0-9dc7-7ba6e74b76ad tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lazy-loading 'resources' on Instance uuid 1fc39b27-762e-4bc8-90ba-0215d65710ec {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:45:37 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-92117be5-a131-40b0-9dc7-7ba6e74b76ad tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:42:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1818367107',display_name='tempest-TestVolumeSwap-server-1818367107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1818367107',id=8,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+1fld5RMq2vr/o5W+WlE9SaD04HzO69tfF9wsLsrNKbEFDCtJ3j4dPXhHiiZPeEbNzVGKrC9tPeaaVk1ukwfyJtz3qBt3ujZk6GTQA545wRDCgOfqs5gji9YE8diMoIw==',key_name='tempest-keypair-468908295',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:42:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed52241ecd1247e988041262db5831d8',ramdisk_id='',reservation_id='r-vtbaozql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1960139601',owner_user_name='tempest-TestVolumeSwap-1960139601-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:42:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f040e06581748f49c31157797514edd',uuid=1fc39b27-762e-4bc8-90ba-0215d65710ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bff8066-85b6-4359-88db-9d717d9a04f9", "address": "fa:16:3e:97:51:45", "network": {"id": "092f8c09-7149-4498-909e-88abbcd706c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-926291745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed52241ecd1247e988041262db5831d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bff8066-85", "ovs_interfaceid": "8bff8066-85b6-4359-88db-9d717d9a04f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:45:37 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-92117be5-a131-40b0-9dc7-7ba6e74b76ad tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Converting VIF {"id": "8bff8066-85b6-4359-88db-9d717d9a04f9", "address": "fa:16:3e:97:51:45", "network": {"id": "092f8c09-7149-4498-909e-88abbcd706c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-926291745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed52241ecd1247e988041262db5831d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bff8066-85", "ovs_interfaceid": "8bff8066-85b6-4359-88db-9d717d9a04f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:45:37 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-92117be5-a131-40b0-9dc7-7ba6e74b76ad tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:51:45,bridge_name='br-int',has_traffic_filtering=True,id=8bff8066-85b6-4359-88db-9d717d9a04f9,network=Network(092f8c09-7149-4498-909e-88abbcd706c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bff8066-85') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:45:37 user nova-compute[75391]: DEBUG os_vif [None req-92117be5-a131-40b0-9dc7-7ba6e74b76ad tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:51:45,bridge_name='br-int',has_traffic_filtering=True,id=8bff8066-85b6-4359-88db-9d717d9a04f9,network=Network(092f8c09-7149-4498-909e-88abbcd706c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bff8066-85') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:45:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8bff8066-85, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:45:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7fe6c12f-dff2-4ff2-8c51-ba27e11a82cc) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:37 user nova-compute[75391]: INFO os_vif [None req-92117be5-a131-40b0-9dc7-7ba6e74b76ad tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:51:45,bridge_name='br-int',has_traffic_filtering=True,id=8bff8066-85b6-4359-88db-9d717d9a04f9,network=Network(092f8c09-7149-4498-909e-88abbcd706c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bff8066-85')
Nov 15 02:45:37 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-92117be5-a131-40b0-9dc7-7ba6e74b76ad tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Deleting instance files /opt/stack/data/nova/instances/1fc39b27-762e-4bc8-90ba-0215d65710ec_del
Nov 15 02:45:37 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-92117be5-a131-40b0-9dc7-7ba6e74b76ad tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Deletion of /opt/stack/data/nova/instances/1fc39b27-762e-4bc8-90ba-0215d65710ec_del complete
Nov 15 02:45:37 user nova-compute[75391]: INFO nova.compute.manager [None req-92117be5-a131-40b0-9dc7-7ba6e74b76ad tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 15 02:45:37 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-92117be5-a131-40b0-9dc7-7ba6e74b76ad tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:45:37 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:45:37 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:45:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG nova.compute.manager [req-e7002827-abb8-4125-9c5f-c42a57461b5e req-0b4af812-704e-43f6-8ddc-9bcd55936ff2 service nova] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Received event network-vif-unplugged-8bff8066-85b6-4359-88db-9d717d9a04f9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e7002827-abb8-4125-9c5f-c42a57461b5e req-0b4af812-704e-43f6-8ddc-9bcd55936ff2 service nova] Acquiring lock "1fc39b27-762e-4bc8-90ba-0215d65710ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e7002827-abb8-4125-9c5f-c42a57461b5e req-0b4af812-704e-43f6-8ddc-9bcd55936ff2 service nova] Lock "1fc39b27-762e-4bc8-90ba-0215d65710ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e7002827-abb8-4125-9c5f-c42a57461b5e req-0b4af812-704e-43f6-8ddc-9bcd55936ff2 service nova] Lock "1fc39b27-762e-4bc8-90ba-0215d65710ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG nova.compute.manager [req-e7002827-abb8-4125-9c5f-c42a57461b5e req-0b4af812-704e-43f6-8ddc-9bcd55936ff2 service nova] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] No waiting events found dispatching network-vif-unplugged-8bff8066-85b6-4359-88db-9d717d9a04f9 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG nova.compute.manager [req-e7002827-abb8-4125-9c5f-c42a57461b5e req-0b4af812-704e-43f6-8ddc-9bcd55936ff2 service nova] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Received event network-vif-unplugged-8bff8066-85b6-4359-88db-9d717d9a04f9 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG nova.compute.manager [req-e7002827-abb8-4125-9c5f-c42a57461b5e req-0b4af812-704e-43f6-8ddc-9bcd55936ff2 service nova] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Received event network-vif-plugged-8bff8066-85b6-4359-88db-9d717d9a04f9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e7002827-abb8-4125-9c5f-c42a57461b5e req-0b4af812-704e-43f6-8ddc-9bcd55936ff2 service nova] Acquiring lock "1fc39b27-762e-4bc8-90ba-0215d65710ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e7002827-abb8-4125-9c5f-c42a57461b5e req-0b4af812-704e-43f6-8ddc-9bcd55936ff2 service nova] Lock "1fc39b27-762e-4bc8-90ba-0215d65710ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e7002827-abb8-4125-9c5f-c42a57461b5e req-0b4af812-704e-43f6-8ddc-9bcd55936ff2 service nova] Lock "1fc39b27-762e-4bc8-90ba-0215d65710ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG nova.compute.manager [req-e7002827-abb8-4125-9c5f-c42a57461b5e req-0b4af812-704e-43f6-8ddc-9bcd55936ff2 service nova] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] No waiting events found dispatching network-vif-plugged-8bff8066-85b6-4359-88db-9d717d9a04f9 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:45:38 user nova-compute[75391]: WARNING nova.compute.manager [req-e7002827-abb8-4125-9c5f-c42a57461b5e req-0b4af812-704e-43f6-8ddc-9bcd55936ff2 service nova] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Received unexpected event network-vif-plugged-8bff8066-85b6-4359-88db-9d717d9a04f9 for instance with vm_state active and task_state deleting.
Nov 15 02:45:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG nova.objects.instance [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lazy-loading 'flavor' on Instance uuid ebb7e616-3c05-4d99-a0b3-76dc1723e82d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:38 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Took 0.73 seconds to deallocate network for instance.
Nov 15 02:45:38 user nova-compute[75391]: DEBUG nova.compute.manager [req-1ba0057d-5f3f-4baf-8a08-9ffa2419ee9c req-b5fa244f-c645-4982-9594-5c78d8342276 service nova] [instance: 1fc39b27-762e-4bc8-90ba-0215d65710ec] Received event network-vif-deleted-8bff8066-85b6-4359-88db-9d717d9a04f9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-92117be5-a131-40b0-9dc7-7ba6e74b76ad tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-92117be5-a131-40b0-9dc7-7ba6e74b76ad tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:38 user nova-compute[75391]: INFO nova.compute.manager [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Attaching volume 223d22cc-ebb2-4b73-8103-54aacfd3b44a to /dev/vdb
Nov 15 02:45:38 user nova-compute[75391]: DEBUG os_brick.utils [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba53898f-90b6-48b6-a651-1851ea42221c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce52ff40-3b70-4217-a04b-e3ad8e469ca4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6f49f3-4027-4269-ba01-475442d30fcb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccc3e31-6073-4212-8161-1b95df835cf8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:45:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:45:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:45:39 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:45:39 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbd9b03-1272-4cbf-a3e6-8068b0a96b4b]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:45:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:45:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:45:39 user nova-compute[75391]: DEBUG os_brick.utils [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:45:39 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Updating existing volume attachment record: 7b9fe378-e0a0-45be-8a84-075d09efac81 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:45:39 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-92117be5-a131-40b0-9dc7-7ba6e74b76ad tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:45:39 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-92117be5-a131-40b0-9dc7-7ba6e74b76ad tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:45:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-92117be5-a131-40b0-9dc7-7ba6e74b76ad tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.493s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:39 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-92117be5-a131-40b0-9dc7-7ba6e74b76ad tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Deleted allocations for instance 1fc39b27-762e-4bc8-90ba-0215d65710ec
Nov 15 02:45:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-92117be5-a131-40b0-9dc7-7ba6e74b76ad tempest-TestVolumeSwap-1960139601 tempest-TestVolumeSwap-1960139601-project-member] Lock "1fc39b27-762e-4bc8-90ba-0215d65710ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.656s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "a4171d96-bb26-473f-a322-178dadbaab0a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "a4171d96-bb26-473f-a322-178dadbaab0a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:41 user nova-compute[75391]: DEBUG nova.compute.manager [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:45:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:41 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:45:41 user nova-compute[75391]: INFO nova.compute.claims [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Claim successful on node user
Nov 15 02:45:42 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:45:42 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:45:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:42 user nova-compute[75391]: DEBUG nova.compute.manager [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:45:42 user nova-compute[75391]: DEBUG nova.compute.manager [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:45:42 user nova-compute[75391]: DEBUG nova.network.neutron [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:45:42 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:45:42 user nova-compute[75391]: DEBUG nova.compute.manager [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:45:42 user nova-compute[75391]: DEBUG nova.policy [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f6ea5480ad1e49afa394e636c37e3b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81798f0465704c4d9c09d8c3d3175ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:45:42 user nova-compute[75391]: DEBUG nova.compute.manager [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:45:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:45:42 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Creating image(s)
Nov 15 02:45:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "/opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "/opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.175s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.191s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk 1073741824" returned: 0 in 0.050s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.204s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:43 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:45:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:43 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Cannot resize image /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:45:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:45:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Ensure instance console log exists: /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:45:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG nova.network.neutron [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Successfully created port: 2a223503-a5c6-4851-b555-f4b3c9ce26bf {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dfGrvENV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:45:44 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:45:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:45:44 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:45:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:45:44 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d38303-e059-4b40-b7a0-56af0e05bf15]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:45:44 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f1159f-ee6c-4f82-a23d-6ef214509948]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a] added
Nov 15 02:45:44 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee75f558-c769-46bc-ae4d-48a63b537a98]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[758d727f-d683-4c3d-992b-11f2ab0a28cc]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dfGrvENV {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dfGrvENV" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9c26e0-c079-4567-837c-9c245f777ea5]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dfGrvENV'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e0daf6-2d97-44d3-8094-077266d749ba]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4750e194-af9f-4778-a2bb-ffe099a0544e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:45:44 user nova-compute[75391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:45:44 user nova-compute[75391]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:45:44 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:45:44 user nova-compute[75391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:45:44 user nova-compute[75391]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:45:44 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b045ea-8a0a-4210-bb5f-b6945d996553]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a, portal: 172.16.0.220,3260]
Nov 15 02:45:44 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a, portal: 172.16.0.220,3260] successful.
Nov 15 02:45:44 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4b0220-a8b5-4356-91c6-39bc4fe40839]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0be328-de99-4680-bb17-897a114a05a1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:45:44 user nova-compute[75391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:45:44 user nova-compute[75391]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:45:44 user nova-compute[75391]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:45:44 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:45:44 user nova-compute[75391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:45:44 user nova-compute[75391]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:45:44 user nova-compute[75391]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:45:44 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f118ffb6-69ff-450d-9d6e-2dfa0735ef90]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dfGrvENV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG nova.network.neutron [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Successfully updated port: 2a223503-a5c6-4851-b555-f4b3c9ce26bf {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "refresh_cache-a4171d96-bb26-473f-a322-178dadbaab0a" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquired lock "refresh_cache-a4171d96-bb26-473f-a322-178dadbaab0a" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG nova.network.neutron [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-2ffe9677-38ab-4d33-a655-1b236af888fb req-7f9b4ab1-b9dd-48ac-adc9-322a3808568c service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Received event network-changed-2a223503-a5c6-4851-b555-f4b3c9ce26bf {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-2ffe9677-38ab-4d33-a655-1b236af888fb req-7f9b4ab1-b9dd-48ac-adc9-322a3808568c service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Refreshing instance network info cache due to event network-changed-2a223503-a5c6-4851-b555-f4b3c9ce26bf. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:45:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2ffe9677-38ab-4d33-a655-1b236af888fb req-7f9b4ab1-b9dd-48ac-adc9-322a3808568c service nova] Acquiring lock "refresh_cache-a4171d96-bb26-473f-a322-178dadbaab0a" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.network.neutron [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:45:45 user nova-compute[75391]: INFO nova.compute.claims [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Claim successful on node user
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.network.neutron [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Updating instance_info_cache with network_info: [{"id": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "address": "fa:16:3e:5b:49:f4", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a223503-a5", "ovs_interfaceid": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Releasing lock "refresh_cache-a4171d96-bb26-473f-a322-178dadbaab0a" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.compute.manager [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Instance network_info: |[{"id": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "address": "fa:16:3e:5b:49:f4", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a223503-a5", "ovs_interfaceid": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2ffe9677-38ab-4d33-a655-1b236af888fb req-7f9b4ab1-b9dd-48ac-adc9-322a3808568c service nova] Acquired lock "refresh_cache-a4171d96-bb26-473f-a322-178dadbaab0a" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.network.neutron [req-2ffe9677-38ab-4d33-a655-1b236af888fb req-7f9b4ab1-b9dd-48ac-adc9-322a3808568c service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Refreshing network info cache for port 2a223503-a5c6-4851-b555-f4b3c9ce26bf {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Start _get_guest_xml network_info=[{"id": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "address": "fa:16:3e:5b:49:f4", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a223503-a5", "ovs_interfaceid": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:45:45 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:45:45 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-94225325',display_name='tempest-tempest.common.compute-instance-94225325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-94225325',id=15,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmhK+EJhHmIDrZeRSNrf3UHZ5JLeQLAhGX/u9JkQb0ZIxg+Hha5DuE4jWuovQg5sU4I3Rt0gf/qTiKk2CMFhsxz1MyhTUWVIT75bqS2ShQt+vRSNlu3Pq6uyTO9HgnnNg==',key_name='tempest-keypair-537215865',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81798f0465704c4d9c09d8c3d3175ac5',ramdisk_id='',reservation_id='r-9oodw1p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1177660790',owner_user_name='tempest-ServerActionsTestOtherA-1177660790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:45:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ea5480ad1e49afa394e636c37e3b70',uuid=a4171d96-bb26-473f-a322-178dadbaab0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "address": "fa:16:3e:5b:49:f4", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a223503-a5", "ovs_interfaceid": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converting VIF {"id": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "address": "fa:16:3e:5b:49:f4", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a223503-a5", "ovs_interfaceid": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:49:f4,bridge_name='br-int',has_traffic_filtering=True,id=2a223503-a5c6-4851-b555-f4b3c9ce26bf,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a223503-a5') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.objects.instance [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lazy-loading 'pci_devices' on Instance uuid a4171d96-bb26-473f-a322-178dadbaab0a {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:45:45 user nova-compute[75391]:   <uuid>a4171d96-bb26-473f-a322-178dadbaab0a</uuid>
Nov 15 02:45:45 user nova-compute[75391]:   <name>instance-0000000f</name>
Nov 15 02:45:45 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:45:45 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:45:45 user nova-compute[75391]:   <metadata>
Nov 15 02:45:45 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:45:45 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:45:45 user nova-compute[75391]:       <nova:name>tempest-tempest.common.compute-instance-94225325</nova:name>
Nov 15 02:45:45 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:45:45</nova:creationTime>
Nov 15 02:45:45 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:45:45 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:45:45 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:45:45 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:45:45 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:45:45 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:45:45 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:45:45 user nova-compute[75391]:       <nova:owner>
Nov 15 02:45:45 user nova-compute[75391]:         <nova:user uuid="f6ea5480ad1e49afa394e636c37e3b70">tempest-ServerActionsTestOtherA-1177660790-project-member</nova:user>
Nov 15 02:45:45 user nova-compute[75391]:         <nova:project uuid="81798f0465704c4d9c09d8c3d3175ac5">tempest-ServerActionsTestOtherA-1177660790</nova:project>
Nov 15 02:45:45 user nova-compute[75391]:       </nova:owner>
Nov 15 02:45:45 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:45:45 user nova-compute[75391]:       <nova:ports>
Nov 15 02:45:45 user nova-compute[75391]:         <nova:port uuid="2a223503-a5c6-4851-b555-f4b3c9ce26bf">
Nov 15 02:45:45 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 02:45:45 user nova-compute[75391]:         </nova:port>
Nov 15 02:45:45 user nova-compute[75391]:       </nova:ports>
Nov 15 02:45:45 user nova-compute[75391]:     </nova:instance>
Nov 15 02:45:45 user nova-compute[75391]:   </metadata>
Nov 15 02:45:45 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:45:45 user nova-compute[75391]:     <system>
Nov 15 02:45:45 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:45:45 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:45:45 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:45:45 user nova-compute[75391]:       <entry name="serial">a4171d96-bb26-473f-a322-178dadbaab0a</entry>
Nov 15 02:45:45 user nova-compute[75391]:       <entry name="uuid">a4171d96-bb26-473f-a322-178dadbaab0a</entry>
Nov 15 02:45:45 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:45:45 user nova-compute[75391]:     </system>
Nov 15 02:45:45 user nova-compute[75391]:   </sysinfo>
Nov 15 02:45:45 user nova-compute[75391]:   <os>
Nov 15 02:45:45 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:45:45 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:45:45 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:45:45 user nova-compute[75391]:   </os>
Nov 15 02:45:45 user nova-compute[75391]:   <features>
Nov 15 02:45:45 user nova-compute[75391]:     <acpi/>
Nov 15 02:45:45 user nova-compute[75391]:     <apic/>
Nov 15 02:45:45 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:45:45 user nova-compute[75391]:   </features>
Nov 15 02:45:45 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:45:45 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:45:45 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:45:45 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:45:45 user nova-compute[75391]:   </clock>
Nov 15 02:45:45 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:45:45 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:45:45 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:45:45 user nova-compute[75391]:   </cpu>
Nov 15 02:45:45 user nova-compute[75391]:   <devices>
Nov 15 02:45:45 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:45:45 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:45:45 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk"/>
Nov 15 02:45:45 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:45:45 user nova-compute[75391]:     </disk>
Nov 15 02:45:45 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:45:45 user nova-compute[75391]:       <mac address="fa:16:3e:5b:49:f4"/>
Nov 15 02:45:45 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:45:45 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:45:45 user nova-compute[75391]:       <target dev="tap2a223503-a5"/>
Nov 15 02:45:45 user nova-compute[75391]:     </interface>
Nov 15 02:45:45 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:45:45 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/console.log" append="off"/>
Nov 15 02:45:45 user nova-compute[75391]:     </serial>
Nov 15 02:45:45 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:45:45 user nova-compute[75391]:     <video>
Nov 15 02:45:45 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:45:45 user nova-compute[75391]:     </video>
Nov 15 02:45:45 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:45:45 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:45:45 user nova-compute[75391]:     </rng>
Nov 15 02:45:45 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:45:45 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:45:45 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:45:45 user nova-compute[75391]:     </memballoon>
Nov 15 02:45:45 user nova-compute[75391]:   </devices>
Nov 15 02:45:45 user nova-compute[75391]: </domain>
Nov 15 02:45:45 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-94225325',display_name='tempest-tempest.common.compute-instance-94225325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-94225325',id=15,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmhK+EJhHmIDrZeRSNrf3UHZ5JLeQLAhGX/u9JkQb0ZIxg+Hha5DuE4jWuovQg5sU4I3Rt0gf/qTiKk2CMFhsxz1MyhTUWVIT75bqS2ShQt+vRSNlu3Pq6uyTO9HgnnNg==',key_name='tempest-keypair-537215865',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81798f0465704c4d9c09d8c3d3175ac5',ramdisk_id='',reservation_id='r-9oodw1p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1177660790',owner_user_name='tempest-ServerActionsTestOtherA-1177660790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:45:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ea5480ad1e49afa394e636c37e3b70',uuid=a4171d96-bb26-473f-a322-178dadbaab0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "address": "fa:16:3e:5b:49:f4", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a223503-a5", "ovs_interfaceid": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converting VIF {"id": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "address": "fa:16:3e:5b:49:f4", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a223503-a5", "ovs_interfaceid": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:49:f4,bridge_name='br-int',has_traffic_filtering=True,id=2a223503-a5c6-4851-b555-f4b3c9ce26bf,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a223503-a5') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG os_vif [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:49:f4,bridge_name='br-int',has_traffic_filtering=True,id=2a223503-a5c6-4851-b555-f4b3c9ce26bf,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a223503-a5') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'edec79fc-5394-58d9-91ec-c1b55ff1580d', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a223503-a5, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a223503-a5, col_values=(('qos', UUID('756f1423-01ed-426f-81aa-c43352c9d5f4')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a223503-a5, col_values=(('external_ids', {'iface-id': '2a223503-a5c6-4851-b555-f4b3c9ce26bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:49:f4', 'vm-uuid': 'a4171d96-bb26-473f-a322-178dadbaab0a'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:45 user nova-compute[75391]: INFO os_vif [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:49:f4,bridge_name='br-int',has_traffic_filtering=True,id=2a223503-a5c6-4851-b555-f4b3c9ce26bf,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a223503-a5')
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] No VIF found with MAC fa:16:3e:5b:49:f4, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26464616338383433', 'path': '/dev/sdd'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464616338383433', 'path': '/dev/sdd'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.objects.instance [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lazy-loading 'flavor' on Instance uuid ebb7e616-3c05-4d99-a0b3-76dc1723e82d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.network.neutron [req-2ffe9677-38ab-4d33-a655-1b236af888fb req-7f9b4ab1-b9dd-48ac-adc9-322a3808568c service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Updated VIF entry in instance network info cache for port 2a223503-a5c6-4851-b555-f4b3c9ce26bf. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.network.neutron [req-2ffe9677-38ab-4d33-a655-1b236af888fb req-7f9b4ab1-b9dd-48ac-adc9-322a3808568c service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Updating instance_info_cache with network_info: [{"id": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "address": "fa:16:3e:5b:49:f4", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a223503-a5", "ovs_interfaceid": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:45:45 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:45:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2ffe9677-38ab-4d33-a655-1b236af888fb req-7f9b4ab1-b9dd-48ac-adc9-322a3808568c service nova] Releasing lock "refresh_cache-a4171d96-bb26-473f-a322-178dadbaab0a" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 02:45:45 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:45:45 user nova-compute[75391]:   <source dev="/dev/sdd"/>
Nov 15 02:45:45 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:45:45 user nova-compute[75391]:   <serial>223d22cc-ebb2-4b73-8103-54aacfd3b44a</serial>
Nov 15 02:45:45 user nova-compute[75391]: </disk>
Nov 15 02:45:45 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.policy [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa67273822f247b2ae2d34ec9cd8c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae33412d3944fbcb20520ae0b5d5d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:45:45 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Creating image(s)
Nov 15 02:45:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "/opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "/opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "/opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.182s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.182s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk 1073741824" returned: 0 in 0.052s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:46 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Successfully created port: f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:45:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.192s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:46 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:45:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:45:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:45:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] No VIF found with MAC fa:16:3e:79:35:a3, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:45:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:46 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Cannot resize image /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:45:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:45:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Ensure instance console log exists: /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:45:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a854b3ab-b6ad-4d03-bee6-b61da5ddca4b tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.903s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Successfully updated port: f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "refresh_cache-da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquired lock "refresh_cache-da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.compute.manager [req-83f5a409-d707-4289-b8d2-bd8ace1f84dc req-6dfe453d-6fa3-49bc-8f55-3f9ceee2df80 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received event network-changed-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.compute.manager [req-83f5a409-d707-4289-b8d2-bd8ace1f84dc req-6dfe453d-6fa3-49bc-8f55-3f9ceee2df80 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Refreshing instance network info cache due to event network-changed-f3eff2a5-1256-4a92-969a-62aca65b7452. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-83f5a409-d707-4289-b8d2-bd8ace1f84dc req-6dfe453d-6fa3-49bc-8f55-3f9ceee2df80 service nova] Acquiring lock "refresh_cache-da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.compute.manager [req-3d939b7e-ea30-4248-9d9e-a9713061a6df req-5aaa0545-5144-4507-bab7-fb50ea245684 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Received event network-vif-plugged-2a223503-a5c6-4851-b555-f4b3c9ce26bf {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3d939b7e-ea30-4248-9d9e-a9713061a6df req-5aaa0545-5144-4507-bab7-fb50ea245684 service nova] Acquiring lock "a4171d96-bb26-473f-a322-178dadbaab0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3d939b7e-ea30-4248-9d9e-a9713061a6df req-5aaa0545-5144-4507-bab7-fb50ea245684 service nova] Lock "a4171d96-bb26-473f-a322-178dadbaab0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3d939b7e-ea30-4248-9d9e-a9713061a6df req-5aaa0545-5144-4507-bab7-fb50ea245684 service nova] Lock "a4171d96-bb26-473f-a322-178dadbaab0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.compute.manager [req-3d939b7e-ea30-4248-9d9e-a9713061a6df req-5aaa0545-5144-4507-bab7-fb50ea245684 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] No waiting events found dispatching network-vif-plugged-2a223503-a5c6-4851-b555-f4b3c9ce26bf {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:45:47 user nova-compute[75391]: WARNING nova.compute.manager [req-3d939b7e-ea30-4248-9d9e-a9713061a6df req-5aaa0545-5144-4507-bab7-fb50ea245684 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Received unexpected event network-vif-plugged-2a223503-a5c6-4851-b555-f4b3c9ce26bf for instance with vm_state building and task_state spawning.
Nov 15 02:45:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-1ee84f40-ff95-41d2-97f6-2ef320cdf9f2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-1ee84f40-ff95-41d2-97f6-2ef320cdf9f2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Updating instance_info_cache with network_info: [{"id": "f3eff2a5-1256-4a92-969a-62aca65b7452", "address": "fa:16:3e:1d:2d:fe", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eff2a5-12", "ovs_interfaceid": "f3eff2a5-1256-4a92-969a-62aca65b7452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Releasing lock "refresh_cache-da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Instance network_info: |[{"id": "f3eff2a5-1256-4a92-969a-62aca65b7452", "address": "fa:16:3e:1d:2d:fe", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eff2a5-12", "ovs_interfaceid": "f3eff2a5-1256-4a92-969a-62aca65b7452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-83f5a409-d707-4289-b8d2-bd8ace1f84dc req-6dfe453d-6fa3-49bc-8f55-3f9ceee2df80 service nova] Acquired lock "refresh_cache-da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.network.neutron [req-83f5a409-d707-4289-b8d2-bd8ace1f84dc req-6dfe453d-6fa3-49bc-8f55-3f9ceee2df80 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Refreshing network info cache for port f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Start _get_guest_xml network_info=[{"id": "f3eff2a5-1256-4a92-969a-62aca65b7452", "address": "fa:16:3e:1d:2d:fe", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eff2a5-12", "ovs_interfaceid": "f3eff2a5-1256-4a92-969a-62aca65b7452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:45:47 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:45:47 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:45:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2059106196',display_name='tempest-AttachVolumeTestJSON-server-2059106196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2059106196',id=16,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCD3L1SyX/DHVmOgefUSKxNSWOZ+sTPqXiHUSBukECcD3u5gRzMMwQl2EIJXu8cBcituCl5oxuFwWyqmLGHfNTrWeVvrAhqAma6otXiHGESdUtG7YKOLDquTjdHFcZgT9g==',key_name='tempest-keypair-354891702',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ae33412d3944fbcb20520ae0b5d5d17',ramdisk_id='',reservation_id='r-rjbq8t39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-452422979',owner_user_name='tempest-AttachVolumeTestJSON-452422979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:45:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa67273822f247b2ae2d34ec9cd8c8b4',uuid=da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3eff2a5-1256-4a92-969a-62aca65b7452", "address": "fa:16:3e:1d:2d:fe", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eff2a5-12", "ovs_interfaceid": "f3eff2a5-1256-4a92-969a-62aca65b7452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Converting VIF {"id": "f3eff2a5-1256-4a92-969a-62aca65b7452", "address": "fa:16:3e:1d:2d:fe", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eff2a5-12", "ovs_interfaceid": "f3eff2a5-1256-4a92-969a-62aca65b7452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:2d:fe,bridge_name='br-int',has_traffic_filtering=True,id=f3eff2a5-1256-4a92-969a-62aca65b7452,network=Network(4866e9c3-d16f-4496-b56a-1f100ea5622a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3eff2a5-12') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.objects.instance [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'pci_devices' on Instance uuid da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:45:47 user nova-compute[75391]:   <uuid>da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f</uuid>
Nov 15 02:45:47 user nova-compute[75391]:   <name>instance-00000010</name>
Nov 15 02:45:47 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:45:47 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:45:47 user nova-compute[75391]:   <metadata>
Nov 15 02:45:47 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:45:47 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:45:47 user nova-compute[75391]:       <nova:name>tempest-AttachVolumeTestJSON-server-2059106196</nova:name>
Nov 15 02:45:47 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:45:47</nova:creationTime>
Nov 15 02:45:47 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:45:47 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:45:47 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:45:47 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:45:47 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:45:47 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:45:47 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:45:47 user nova-compute[75391]:       <nova:owner>
Nov 15 02:45:47 user nova-compute[75391]:         <nova:user uuid="aa67273822f247b2ae2d34ec9cd8c8b4">tempest-AttachVolumeTestJSON-452422979-project-member</nova:user>
Nov 15 02:45:47 user nova-compute[75391]:         <nova:project uuid="3ae33412d3944fbcb20520ae0b5d5d17">tempest-AttachVolumeTestJSON-452422979</nova:project>
Nov 15 02:45:47 user nova-compute[75391]:       </nova:owner>
Nov 15 02:45:47 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:45:47 user nova-compute[75391]:       <nova:ports>
Nov 15 02:45:47 user nova-compute[75391]:         <nova:port uuid="f3eff2a5-1256-4a92-969a-62aca65b7452">
Nov 15 02:45:47 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 02:45:47 user nova-compute[75391]:         </nova:port>
Nov 15 02:45:47 user nova-compute[75391]:       </nova:ports>
Nov 15 02:45:47 user nova-compute[75391]:     </nova:instance>
Nov 15 02:45:47 user nova-compute[75391]:   </metadata>
Nov 15 02:45:47 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:45:47 user nova-compute[75391]:     <system>
Nov 15 02:45:47 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:45:47 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:45:47 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:45:47 user nova-compute[75391]:       <entry name="serial">da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f</entry>
Nov 15 02:45:47 user nova-compute[75391]:       <entry name="uuid">da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f</entry>
Nov 15 02:45:47 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:45:47 user nova-compute[75391]:     </system>
Nov 15 02:45:47 user nova-compute[75391]:   </sysinfo>
Nov 15 02:45:47 user nova-compute[75391]:   <os>
Nov 15 02:45:47 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:45:47 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:45:47 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:45:47 user nova-compute[75391]:   </os>
Nov 15 02:45:47 user nova-compute[75391]:   <features>
Nov 15 02:45:47 user nova-compute[75391]:     <acpi/>
Nov 15 02:45:47 user nova-compute[75391]:     <apic/>
Nov 15 02:45:47 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:45:47 user nova-compute[75391]:   </features>
Nov 15 02:45:47 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:45:47 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:45:47 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:45:47 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:45:47 user nova-compute[75391]:   </clock>
Nov 15 02:45:47 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:45:47 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:45:47 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:45:47 user nova-compute[75391]:   </cpu>
Nov 15 02:45:47 user nova-compute[75391]:   <devices>
Nov 15 02:45:47 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:45:47 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:45:47 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk"/>
Nov 15 02:45:47 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:45:47 user nova-compute[75391]:     </disk>
Nov 15 02:45:47 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:45:47 user nova-compute[75391]:       <mac address="fa:16:3e:1d:2d:fe"/>
Nov 15 02:45:47 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:45:47 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:45:47 user nova-compute[75391]:       <target dev="tapf3eff2a5-12"/>
Nov 15 02:45:47 user nova-compute[75391]:     </interface>
Nov 15 02:45:47 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:45:47 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/console.log" append="off"/>
Nov 15 02:45:47 user nova-compute[75391]:     </serial>
Nov 15 02:45:47 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:45:47 user nova-compute[75391]:     <video>
Nov 15 02:45:47 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:45:47 user nova-compute[75391]:     </video>
Nov 15 02:45:47 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:45:47 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:45:47 user nova-compute[75391]:     </rng>
Nov 15 02:45:47 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:45:47 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:45:47 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:45:47 user nova-compute[75391]:     </memballoon>
Nov 15 02:45:47 user nova-compute[75391]:   </devices>
Nov 15 02:45:47 user nova-compute[75391]: </domain>
Nov 15 02:45:47 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:45:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2059106196',display_name='tempest-AttachVolumeTestJSON-server-2059106196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2059106196',id=16,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCD3L1SyX/DHVmOgefUSKxNSWOZ+sTPqXiHUSBukECcD3u5gRzMMwQl2EIJXu8cBcituCl5oxuFwWyqmLGHfNTrWeVvrAhqAma6otXiHGESdUtG7YKOLDquTjdHFcZgT9g==',key_name='tempest-keypair-354891702',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ae33412d3944fbcb20520ae0b5d5d17',ramdisk_id='',reservation_id='r-rjbq8t39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-452422979',owner_user_name='tempest-AttachVolumeTestJSON-452422979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:45:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa67273822f247b2ae2d34ec9cd8c8b4',uuid=da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3eff2a5-1256-4a92-969a-62aca65b7452", "address": "fa:16:3e:1d:2d:fe", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eff2a5-12", "ovs_interfaceid": "f3eff2a5-1256-4a92-969a-62aca65b7452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Converting VIF {"id": "f3eff2a5-1256-4a92-969a-62aca65b7452", "address": "fa:16:3e:1d:2d:fe", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eff2a5-12", "ovs_interfaceid": "f3eff2a5-1256-4a92-969a-62aca65b7452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:2d:fe,bridge_name='br-int',has_traffic_filtering=True,id=f3eff2a5-1256-4a92-969a-62aca65b7452,network=Network(4866e9c3-d16f-4496-b56a-1f100ea5622a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3eff2a5-12') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG os_vif [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:2d:fe,bridge_name='br-int',has_traffic_filtering=True,id=f3eff2a5-1256-4a92-969a-62aca65b7452,network=Network(4866e9c3-d16f-4496-b56a-1f100ea5622a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3eff2a5-12') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76e9e620-2a76-55e1-b8e2-20a9d401efbe', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3eff2a5-12, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf3eff2a5-12, col_values=(('qos', UUID('bc4dfcb1-57d8-4ed7-84e0-e706b63eebd5')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf3eff2a5-12, col_values=(('external_ids', {'iface-id': 'f3eff2a5-1256-4a92-969a-62aca65b7452', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:2d:fe', 'vm-uuid': 'da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:47 user nova-compute[75391]: INFO os_vif [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:2d:fe,bridge_name='br-int',has_traffic_filtering=True,id=f3eff2a5-1256-4a92-969a-62aca65b7452,network=Network(4866e9c3-d16f-4496-b56a-1f100ea5622a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3eff2a5-12')
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] No VIF found with MAC fa:16:3e:1d:2d:fe, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:45:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:48 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Updating instance_info_cache with network_info: [{"id": "4ff5dedb-acb1-489b-a2dc-18a0f53f2933", "address": "fa:16:3e:2e:13:88", "network": {"id": "cb1a9e37-451d-43be-ab84-a0ebe7ab264b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500424491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9265d1e4bccb467fbf0c738844d8735b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff5dedb-ac", "ovs_interfaceid": "4ff5dedb-acb1-489b-a2dc-18a0f53f2933", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:45:48 user nova-compute[75391]: DEBUG nova.network.neutron [req-83f5a409-d707-4289-b8d2-bd8ace1f84dc req-6dfe453d-6fa3-49bc-8f55-3f9ceee2df80 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Updated VIF entry in instance network info cache for port f3eff2a5-1256-4a92-969a-62aca65b7452. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:45:48 user nova-compute[75391]: DEBUG nova.network.neutron [req-83f5a409-d707-4289-b8d2-bd8ace1f84dc req-6dfe453d-6fa3-49bc-8f55-3f9ceee2df80 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Updating instance_info_cache with network_info: [{"id": "f3eff2a5-1256-4a92-969a-62aca65b7452", "address": "fa:16:3e:1d:2d:fe", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eff2a5-12", "ovs_interfaceid": "f3eff2a5-1256-4a92-969a-62aca65b7452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:45:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-83f5a409-d707-4289-b8d2-bd8ace1f84dc req-6dfe453d-6fa3-49bc-8f55-3f9ceee2df80 service nova] Releasing lock "refresh_cache-da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:45:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-1ee84f40-ff95-41d2-97f6-2ef320cdf9f2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:45:48 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 02:45:48 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:45:48 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:45:48 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:45:48 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:45:48 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:45:48 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:45:48 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:45:48 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:45:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:48 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:45:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:49 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Stashing vm_state: active {{(pid=75391) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 15 02:45:49 user nova-compute[75391]: DEBUG nova.compute.manager [req-4bb75e49-7537-4c28-81d3-1a8073f9d13f req-1a1005ee-bdcf-4e24-bacf-a972da33db62 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received event network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4bb75e49-7537-4c28-81d3-1a8073f9d13f req-1a1005ee-bdcf-4e24-bacf-a972da33db62 service nova] Acquiring lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4bb75e49-7537-4c28-81d3-1a8073f9d13f req-1a1005ee-bdcf-4e24-bacf-a972da33db62 service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4bb75e49-7537-4c28-81d3-1a8073f9d13f req-1a1005ee-bdcf-4e24-bacf-a972da33db62 service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:49 user nova-compute[75391]: DEBUG nova.compute.manager [req-4bb75e49-7537-4c28-81d3-1a8073f9d13f req-1a1005ee-bdcf-4e24-bacf-a972da33db62 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] No waiting events found dispatching network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:45:49 user nova-compute[75391]: WARNING nova.compute.manager [req-4bb75e49-7537-4c28-81d3-1a8073f9d13f req-1a1005ee-bdcf-4e24-bacf-a972da33db62 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received unexpected event network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 for instance with vm_state building and task_state spawning.
Nov 15 02:45:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:49 user nova-compute[75391]: DEBUG nova.compute.manager [req-d0554966-5445-490b-a871-7960556c3804 req-d16c2cc5-ea8c-47d4-8fa9-599dd15066c9 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Received event network-vif-plugged-2a223503-a5c6-4851-b555-f4b3c9ce26bf {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d0554966-5445-490b-a871-7960556c3804 req-d16c2cc5-ea8c-47d4-8fa9-599dd15066c9 service nova] Acquiring lock "a4171d96-bb26-473f-a322-178dadbaab0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d0554966-5445-490b-a871-7960556c3804 req-d16c2cc5-ea8c-47d4-8fa9-599dd15066c9 service nova] Lock "a4171d96-bb26-473f-a322-178dadbaab0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d0554966-5445-490b-a871-7960556c3804 req-d16c2cc5-ea8c-47d4-8fa9-599dd15066c9 service nova] Lock "a4171d96-bb26-473f-a322-178dadbaab0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:49 user nova-compute[75391]: DEBUG nova.compute.manager [req-d0554966-5445-490b-a871-7960556c3804 req-d16c2cc5-ea8c-47d4-8fa9-599dd15066c9 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] No waiting events found dispatching network-vif-plugged-2a223503-a5c6-4851-b555-f4b3c9ce26bf {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:45:49 user nova-compute[75391]: WARNING nova.compute.manager [req-d0554966-5445-490b-a871-7960556c3804 req-d16c2cc5-ea8c-47d4-8fa9-599dd15066c9 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Received unexpected event network-vif-plugged-2a223503-a5c6-4851-b555-f4b3c9ce26bf for instance with vm_state building and task_state spawning.
Nov 15 02:45:49 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:45:49 user nova-compute[75391]: INFO nova.compute.claims [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Claim successful on node user
Nov 15 02:45:49 user nova-compute[75391]: DEBUG nova.compute.manager [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:45:49 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:45:49 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Instance spawned successfully.
Nov 15 02:45:49 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:45:49 user nova-compute[75391]: INFO nova.compute.resource_tracker [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Updating resource usage from migration a73f9925-ea9d-478b-b203-b2a81800f8b9
Nov 15 02:45:49 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:45:49 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:45:49 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:45:49 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:45:49 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:45:49 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:45:49 user nova-compute[75391]: INFO nova.compute.manager [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Took 7.18 seconds to spawn the instance on the hypervisor.
Nov 15 02:45:49 user nova-compute[75391]: DEBUG nova.compute.manager [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:45:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:49 user nova-compute[75391]: INFO nova.compute.manager [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Took 8.04 seconds to build instance.
Nov 15 02:45:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a734d40a-2fa0-41c4-9f83-52860424b66c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "a4171d96-bb26-473f-a322-178dadbaab0a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.163s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:49 user nova-compute[75391]: DEBUG nova.compute.manager [None req-961b276e-3e43-409e-8c45-85847683e473 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:45:49 user nova-compute[75391]: INFO nova.compute.manager [None req-961b276e-3e43-409e-8c45-85847683e473 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] instance snapshotting
Nov 15 02:45:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:50 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:45:50 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:45:50 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-961b276e-3e43-409e-8c45-85847683e473 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Beginning live snapshot process
Nov 15 02:45:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.743s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:50 user nova-compute[75391]: INFO nova.compute.manager [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Migrating
Nov 15 02:45:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:45:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:45:50 user nova-compute[75391]: INFO nova.compute.rpcapi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 15 02:45:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:45:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "refresh_cache-ebb7e616-3c05-4d99-a0b3-76dc1723e82d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:45:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquired lock "refresh_cache-ebb7e616-3c05-4d99-a0b3-76dc1723e82d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:45:50 user nova-compute[75391]: DEBUG nova.network.neutron [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:45:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:50 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:45:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-961b276e-3e43-409e-8c45-85847683e473 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json -f qcow2 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-961b276e-3e43-409e-8c45-85847683e473 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json -f qcow2" returned: 0 in 0.201s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-961b276e-3e43-409e-8c45-85847683e473 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json -f qcow2 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:50 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:45:50 user nova-compute[75391]: DEBUG nova.network.neutron [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Updating instance_info_cache with network_info: [{"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:45:50 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:45:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Releasing lock "refresh_cache-ebb7e616-3c05-4d99-a0b3-76dc1723e82d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:45:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-961b276e-3e43-409e-8c45-85847683e473 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json -f qcow2" returned: 0 in 0.252s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-961b276e-3e43-409e-8c45-85847683e473 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:50 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Starting migrate_disk_and_power_off {{(pid=75391) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-961b276e-3e43-409e-8c45-85847683e473 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.202s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-961b276e-3e43-409e-8c45-85847683e473 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp3nvm2kqu/a214165bf5bf4e06ba0ac463e6439465.delta 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-961b276e-3e43-409e-8c45-85847683e473 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp3nvm2kqu/a214165bf5bf4e06ba0ac463e6439465.delta 1073741824" returned: 0 in 0.061s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:51 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-961b276e-3e43-409e-8c45-85847683e473 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 02:45:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a3cee20-521e-4998-8744-f8bf83586176/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG nova.compute.manager [req-5d84fc62-224c-4823-8aa0-e83f54e379c5 req-fe6033c2-cf7b-4cfe-b9e3-096b2fc2a812 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Received event network-vif-unplugged-c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5d84fc62-224c-4823-8aa0-e83f54e379c5 req-fe6033c2-cf7b-4cfe-b9e3-096b2fc2a812 service nova] Acquiring lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5d84fc62-224c-4823-8aa0-e83f54e379c5 req-fe6033c2-cf7b-4cfe-b9e3-096b2fc2a812 service nova] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5d84fc62-224c-4823-8aa0-e83f54e379c5 req-fe6033c2-cf7b-4cfe-b9e3-096b2fc2a812 service nova] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG nova.compute.manager [req-5d84fc62-224c-4823-8aa0-e83f54e379c5 req-fe6033c2-cf7b-4cfe-b9e3-096b2fc2a812 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] No waiting events found dispatching network-vif-unplugged-c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:45:51 user nova-compute[75391]: WARNING nova.compute.manager [req-5d84fc62-224c-4823-8aa0-e83f54e379c5 req-fe6033c2-cf7b-4cfe-b9e3-096b2fc2a812 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Received unexpected event network-vif-unplugged-c9643afc-4454-4d29-b8a2-5422753857b0 for instance with vm_state active and task_state resize_migrating.
Nov 15 02:45:51 user nova-compute[75391]: DEBUG nova.compute.manager [req-3ed0a491-3038-4357-8a06-7169c8a90508 req-117f3f3a-58d1-420b-b665-d1f13897c0c6 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received event network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3ed0a491-3038-4357-8a06-7169c8a90508 req-117f3f3a-58d1-420b-b665-d1f13897c0c6 service nova] Acquiring lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3ed0a491-3038-4357-8a06-7169c8a90508 req-117f3f3a-58d1-420b-b665-d1f13897c0c6 service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3ed0a491-3038-4357-8a06-7169c8a90508 req-117f3f3a-58d1-420b-b665-d1f13897c0c6 service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG nova.compute.manager [req-3ed0a491-3038-4357-8a06-7169c8a90508 req-117f3f3a-58d1-420b-b665-d1f13897c0c6 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] No waiting events found dispatching network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:45:51 user nova-compute[75391]: WARNING nova.compute.manager [req-3ed0a491-3038-4357-8a06-7169c8a90508 req-117f3f3a-58d1-420b-b665-d1f13897c0c6 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received unexpected event network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 for instance with vm_state building and task_state spawning.
Nov 15 02:45:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a3cee20-521e-4998-8744-f8bf83586176/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a3cee20-521e-4998-8744-f8bf83586176/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a3cee20-521e-4998-8744-f8bf83586176/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:51 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Instance spawned successfully.
Nov 15 02:45:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-961b276e-3e43-409e-8c45-85847683e473 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 02:45:52 user nova-compute[75391]: INFO nova.compute.manager [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Took 6.21 seconds to spawn the instance on the hypervisor.
Nov 15 02:45:52 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:52 user nova-compute[75391]: INFO nova.compute.manager [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Took 7.28 seconds to build instance.
Nov 15 02:45:52 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Instance destroyed successfully.
Nov 15 02:45:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-689614808',display_name='tempest-ServerActionsTestOtherB-server-689614808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-689614808',id=2,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2usIoDVXl+b9hE3o9jGzEYasMoeupEZWjgdC34QhkyFhqHaktIVO5IuSwbU0DElzd5MkeVTBrP68npXS/361ypXFAC7mDzbXraFDprW+Txm/mxv6ZY7FykX6U+2H5j7A==',key_name='tempest-keypair-1921719925',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:42:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dfefdbf9f31b47d4a76d8fb06414eb5a',ramdisk_id='',reservation_id='r-qacecpst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-5763420',owner_user_name='tempest-ServerActionsTestOtherB-5763420-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:45:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34b23ed566024cc3a90f97206ea8162d',uuid=ebb7e616-3c05-4d99-a0b3-76dc1723e82d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1586176386-network", "vif_mac": "fa:16:3e:79:35:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Converting VIF {"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1586176386-network", "vif_mac": "fa:16:3e:79:35:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:35:a3,bridge_name='br-int',has_traffic_filtering=True,id=c9643afc-4454-4d29-b8a2-5422753857b0,network=Network(db549bf7-e039-4ea4-ac62-b5c090652e6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9643afc-44') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG os_vif [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:35:a3,bridge_name='br-int',has_traffic_filtering=True,id=c9643afc-4454-4d29-b8a2-5422753857b0,network=Network(db549bf7-e039-4ea4-ac62-b5c090652e6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9643afc-44') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9643afc-44, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7131d657-b4d1-425a-9799-3bd22b431c1d) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:52 user nova-compute[75391]: INFO os_vif [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:35:a3,bridge_name='br-int',has_traffic_filtering=True,id=c9643afc-4454-4d29-b8a2-5422753857b0,network=Network(db549bf7-e039-4ea4-ac62-b5c090652e6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9643afc-44')
Nov 15 02:45:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dfGrvENV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:45:52 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:45:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ac7176c8-72e5-40df-88b8-5a900e65caee tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.451s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9be8073-6ebe-4495-9b6c-61d87b80faaa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:45:52 user nova-compute[75391]: No targets found.
Nov 15 02:45:52 user nova-compute[75391]: iSNS:
Nov 15 02:45:52 user nova-compute[75391]: No targets found.
Nov 15 02:45:52 user nova-compute[75391]: STATIC:
Nov 15 02:45:52 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40
Nov 15 02:45:52 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:45:52 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:45:52 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b
Nov 15 02:45:52 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:45:52 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:45:52 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a
Nov 15 02:45:52 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:45:52 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:45:52 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:45:52 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:45:52 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:45:52 user nova-compute[75391]: FIRMWARE:
Nov 15 02:45:52 user nova-compute[75391]: No targets found.
Nov 15 02:45:52 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:45:52 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:45:52 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0077e9-28e6-40a9-ae91-3c7690baf2f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.090s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf053397-7f81-474a-b3ff-84c92ae922e6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:45:52 user nova-compute[75391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:45:52 user nova-compute[75391]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:45:52 user nova-compute[75391]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:45:52 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:45:52 user nova-compute[75391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:45:52 user nova-compute[75391]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:45:52 user nova-compute[75391]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:45:52 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62247d3370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a'): ({'sdd'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Removing single pathed devices sdd {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-961b276e-3e43-409e-8c45-85847683e473 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] COPY block job progress, current cursor: 27590656 final cursor: 75563008 {{(pid=75391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[342f9856-3acd-46f0-96c7-b95222293bfc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12ee366-5777-49c6-a6ce-de97ad9033c8]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Flushing IO for device /dev/sdd {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c17b9f-25b1-4bc2-b71f-fa1ba00d962e]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b7790a-3b96-4abd-8a61-344e8207111d]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] SCSI volumes sdd have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa169fdf-3b65-49a9-a015-b5e5d07c5056]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de0fe37-2463-4a60-88d0-f27f66c6d091]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a, portal: 172.16.0.220,3260]
Nov 15 02:45:52 user nova-compute[75391]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a, portal: 172.16.0.220,3260] successful.
Nov 15 02:45:52 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc3f886-d0ce-45a9-b6cb-0eea07ba3152]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.535s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] <== disconnect_volume: return (537ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:45:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:45:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-961b276e-3e43-409e-8c45-85847683e473 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 02:45:53 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-961b276e-3e43-409e-8c45-85847683e473 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 02:45:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:53 user nova-compute[75391]: DEBUG nova.privsep.utils [None req-961b276e-3e43-409e-8c45-85847683e473 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 02:45:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-961b276e-3e43-409e-8c45-85847683e473 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp3nvm2kqu/a214165bf5bf4e06ba0ac463e6439465.delta /opt/stack/data/nova/instances/snapshots/tmp3nvm2kqu/a214165bf5bf4e06ba0ac463e6439465 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:45:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d_resize/disk /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:53 user nova-compute[75391]: DEBUG nova.compute.manager [req-8bf3f038-385f-491e-acd4-ec79cf237a57 req-510ecfbc-29f0-4a4c-aab2-2dc4fe0fb590 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Received event network-vif-plugged-c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8bf3f038-385f-491e-acd4-ec79cf237a57 req-510ecfbc-29f0-4a4c-aab2-2dc4fe0fb590 service nova] Acquiring lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8bf3f038-385f-491e-acd4-ec79cf237a57 req-510ecfbc-29f0-4a4c-aab2-2dc4fe0fb590 service nova] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8bf3f038-385f-491e-acd4-ec79cf237a57 req-510ecfbc-29f0-4a4c-aab2-2dc4fe0fb590 service nova] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:53 user nova-compute[75391]: DEBUG nova.compute.manager [req-8bf3f038-385f-491e-acd4-ec79cf237a57 req-510ecfbc-29f0-4a4c-aab2-2dc4fe0fb590 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] No waiting events found dispatching network-vif-plugged-c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:45:53 user nova-compute[75391]: WARNING nova.compute.manager [req-8bf3f038-385f-491e-acd4-ec79cf237a57 req-510ecfbc-29f0-4a4c-aab2-2dc4fe0fb590 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Received unexpected event network-vif-plugged-c9643afc-4454-4d29-b8a2-5422753857b0 for instance with vm_state active and task_state resize_migrating.
Nov 15 02:45:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json" returned: 0 in 0.325s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-961b276e-3e43-409e-8c45-85847683e473 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp3nvm2kqu/a214165bf5bf4e06ba0ac463e6439465.delta /opt/stack/data/nova/instances/snapshots/tmp3nvm2kqu/a214165bf5bf4e06ba0ac463e6439465" returned: 0 in 0.647s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:53 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-961b276e-3e43-409e-8c45-85847683e473 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Snapshot extracted, beginning image upload
Nov 15 02:45:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] CMD "cp -r /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d_resize/disk /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk" returned: 0 in 0.688s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d_resize/disk.info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk.info {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] CMD "cp -r /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d_resize/disk.info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk.info" returned: 0 in 0.569s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Acquiring lock "60093cdf-015e-4c39-a514-1818a6e55385" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "60093cdf-015e-4c39-a514-1818a6e55385" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Acquiring lock "60093cdf-015e-4c39-a514-1818a6e55385-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "60093cdf-015e-4c39-a514-1818a6e55385-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "60093cdf-015e-4c39-a514-1818a6e55385-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:54 user nova-compute[75391]: INFO nova.compute.manager [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Terminating instance
Nov 15 02:45:54 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:45:54 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:45:54 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=7499MB free_disk=25.361419677734375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:45:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:54 user nova-compute[75391]: DEBUG nova.compute.manager [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:45:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:54 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Applying migration context for instance ebb7e616-3c05-4d99-a0b3-76dc1723e82d as it has an incoming, in-progress migration a73f9925-ea9d-478b-b203-b2a81800f8b9. Migration status is migrating {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 02:45:54 user nova-compute[75391]: INFO nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Updating resource usage from migration a73f9925-ea9d-478b-b203-b2a81800f8b9
Nov 15 02:45:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9744c8a1-046e-4a00-92e0-92ebb3275ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance fc9484c0-9083-4797-8ab1-2ad392822ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 60093cdf-015e-4c39-a514-1818a6e55385 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 38a63a30-a3bc-4556-9fb6-53522dbf2c68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 25884e14-afa3-4e5d-8154-a9e9eb455b94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6400a5f3-0ec9-4484-930c-1f5061ae5374 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6a3cee20-521e-4998-8744-f8bf83586176 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance a4171d96-bb26-473f-a322-178dadbaab0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Migration a73f9925-ea9d-478b-b203-b2a81800f8b9 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance ebb7e616-3c05-4d99-a0b3-76dc1723e82d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG nova.compute.manager [req-ea6f5263-8f2f-452a-a4a7-7cf74d0cff24 req-49f697cb-1843-46e6-8eb5-246107b75da4 service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Received event network-vif-unplugged-5f28911d-785a-4eee-aa6a-5de54d6836e5 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ea6f5263-8f2f-452a-a4a7-7cf74d0cff24 req-49f697cb-1843-46e6-8eb5-246107b75da4 service nova] Acquiring lock "60093cdf-015e-4c39-a514-1818a6e55385-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ea6f5263-8f2f-452a-a4a7-7cf74d0cff24 req-49f697cb-1843-46e6-8eb5-246107b75da4 service nova] Lock "60093cdf-015e-4c39-a514-1818a6e55385-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ea6f5263-8f2f-452a-a4a7-7cf74d0cff24 req-49f697cb-1843-46e6-8eb5-246107b75da4 service nova] Lock "60093cdf-015e-4c39-a514-1818a6e55385-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG nova.compute.manager [req-ea6f5263-8f2f-452a-a4a7-7cf74d0cff24 req-49f697cb-1843-46e6-8eb5-246107b75da4 service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] No waiting events found dispatching network-vif-unplugged-5f28911d-785a-4eee-aa6a-5de54d6836e5 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG nova.compute.manager [req-ea6f5263-8f2f-452a-a4a7-7cf74d0cff24 req-49f697cb-1843-46e6-8eb5-246107b75da4 service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Received event network-vif-unplugged-5f28911d-785a-4eee-aa6a-5de54d6836e5 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.755s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:55 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Instance destroyed successfully.
Nov 15 02:45:55 user nova-compute[75391]: DEBUG nova.objects.instance [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lazy-loading 'resources' on Instance uuid 60093cdf-015e-4c39-a514-1818a6e55385 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T02:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-687676829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1071606514',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJpUqLBG9MXTa4b8ttJcUyIaQWwwfKw3oQQHLLLE6hRohPvI+iHNv7PsUg7WlW0Rk9dnTSBu2zUo7T1ApUjCFWDWZfBwkbNbFZxmqfiLBpDMCEOaVy2Lcdga2I1GHUEGQ==',key_name='tempest-keypair-1458525323',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:44:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e357f7331b8042adbc7e74190412daa2',ramdisk_id='',reservation_id='r-2jmtqabu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1642963392',owner_user_name='tempest-ServerActionsV293TestJSON-1642963392-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:44:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='541a74f4f1004769b64f8086feae6255',uuid=60093cdf-015e-4c39-a514-1818a6e55385,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "address": "fa:16:3e:39:41:1f", "network": {"id": "8904261f-fabd-4932-b540-dcc6be4fe56e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-180821931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e357f7331b8042adbc7e74190412daa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f28911d-78", "ovs_interfaceid": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Converting VIF {"id": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "address": "fa:16:3e:39:41:1f", "network": {"id": "8904261f-fabd-4932-b540-dcc6be4fe56e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-180821931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e357f7331b8042adbc7e74190412daa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f28911d-78", "ovs_interfaceid": "5f28911d-785a-4eee-aa6a-5de54d6836e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:41:1f,bridge_name='br-int',has_traffic_filtering=True,id=5f28911d-785a-4eee-aa6a-5de54d6836e5,network=Network(8904261f-fabd-4932-b540-dcc6be4fe56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f28911d-78') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG os_vif [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:41:1f,bridge_name='br-int',has_traffic_filtering=True,id=5f28911d-785a-4eee-aa6a-5de54d6836e5,network=Network(8904261f-fabd-4932-b540-dcc6be4fe56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f28911d-78') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f28911d-78, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=74fdd18e-4637-4d9b-a794-4e8362d4f398) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:55 user nova-compute[75391]: INFO os_vif [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:41:1f,bridge_name='br-int',has_traffic_filtering=True,id=5f28911d-785a-4eee-aa6a-5de54d6836e5,network=Network(8904261f-fabd-4932-b540-dcc6be4fe56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f28911d-78')
Nov 15 02:45:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQIuJiSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:45:55 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:45:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d159783-5020-4d25-8936-ded5ec99b9b2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:45:55 user nova-compute[75391]: No targets found.
Nov 15 02:45:55 user nova-compute[75391]: iSNS:
Nov 15 02:45:55 user nova-compute[75391]: No targets found.
Nov 15 02:45:55 user nova-compute[75391]: STATIC:
Nov 15 02:45:55 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40
Nov 15 02:45:55 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:45:55 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:45:55 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b
Nov 15 02:45:55 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:45:55 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:45:55 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:45:55 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:45:55 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:45:55 user nova-compute[75391]: FIRMWARE:
Nov 15 02:45:55 user nova-compute[75391]: No targets found.
Nov 15 02:45:55 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:45:55 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:45:55 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e799a9-9713-4f86-9d5b-4abb0389397d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ddc0f5-1e85-444b-9d99-5c2851e657ae]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:45:55 user nova-compute[75391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:45:55 user nova-compute[75391]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:45:55 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 (non-flash)
Nov 15 02:45:55 user nova-compute[75391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:45:55 user nova-compute[75391]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:45:55 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6244172050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40'): ({'sdc'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Removing single pathed devices sdc {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1dd8318-dfd0-45de-9ab0-dd0b030d6e7f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf0eb6e-a8cb-4a7b-b8df-7d189ba1ac03]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Flushing IO for device /dev/sdc {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b754334-9ade-4678-b0a6-f2bcb2d2e50e]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51bc3c6-a3f3-4928-b770-211b525f26e1]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] SCSI volumes sdc have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8870df5-b444-4760-9fad-9cd02859a9ac]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[964f8c38-346e-4493-9e32-c87ff02fb103]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40, portal: 172.16.0.220,3260]
Nov 15 02:45:56 user nova-compute[75391]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40, portal: 172.16.0.220,3260] successful.
Nov 15 02:45:56 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[033d9a05-a9bf-456e-b06e-50ef67bcd2df]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:45:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:45:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] <== disconnect_volume: return (364ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:45:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:45:56 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Deleting instance files /opt/stack/data/nova/instances/60093cdf-015e-4c39-a514-1818a6e55385_del
Nov 15 02:45:56 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Deletion of /opt/stack/data/nova/instances/60093cdf-015e-4c39-a514-1818a6e55385_del complete
Nov 15 02:45:56 user nova-compute[75391]: INFO nova.compute.manager [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 15 02:45:56 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:45:56 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:45:56 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:45:56 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:45:56 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Took 0.83 seconds to deallocate network for instance.
Nov 15 02:45:56 user nova-compute[75391]: DEBUG nova.compute.manager [req-cb139817-1f0b-4da2-92f2-b1c5160c6205 req-6407a26d-bab9-4f0d-a9a1-fd1669704b06 service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Received event network-vif-deleted-5f28911d-785a-4eee-aa6a-5de54d6836e5 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:57 user nova-compute[75391]: DEBUG nova.network.neutron [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Port c9643afc-4454-4d29-b8a2-5422753857b0 binding to destination host user is already ACTIVE {{(pid=75391) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 02:45:57 user nova-compute[75391]: DEBUG nova.compute.manager [req-6fe96582-b18b-48f6-b6f4-1eb1c6ab9b84 req-d1ff9f4a-f204-463d-9c1a-2f2da7044dcc service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Received event network-vif-plugged-5f28911d-785a-4eee-aa6a-5de54d6836e5 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:45:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6fe96582-b18b-48f6-b6f4-1eb1c6ab9b84 req-d1ff9f4a-f204-463d-9c1a-2f2da7044dcc service nova] Acquiring lock "60093cdf-015e-4c39-a514-1818a6e55385-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6fe96582-b18b-48f6-b6f4-1eb1c6ab9b84 req-d1ff9f4a-f204-463d-9c1a-2f2da7044dcc service nova] Lock "60093cdf-015e-4c39-a514-1818a6e55385-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6fe96582-b18b-48f6-b6f4-1eb1c6ab9b84 req-d1ff9f4a-f204-463d-9c1a-2f2da7044dcc service nova] Lock "60093cdf-015e-4c39-a514-1818a6e55385-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:57 user nova-compute[75391]: DEBUG nova.compute.manager [req-6fe96582-b18b-48f6-b6f4-1eb1c6ab9b84 req-d1ff9f4a-f204-463d-9c1a-2f2da7044dcc service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] No waiting events found dispatching network-vif-plugged-5f28911d-785a-4eee-aa6a-5de54d6836e5 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:45:57 user nova-compute[75391]: WARNING nova.compute.manager [req-6fe96582-b18b-48f6-b6f4-1eb1c6ab9b84 req-d1ff9f4a-f204-463d-9c1a-2f2da7044dcc service nova] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Received unexpected event network-vif-plugged-5f28911d-785a-4eee-aa6a-5de54d6836e5 for instance with vm_state active and task_state deleting.
Nov 15 02:45:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "refresh_cache-ebb7e616-3c05-4d99-a0b3-76dc1723e82d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:45:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquired lock "refresh_cache-ebb7e616-3c05-4d99-a0b3-76dc1723e82d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:45:57 user nova-compute[75391]: DEBUG nova.network.neutron [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:45:57 user nova-compute[75391]: INFO nova.compute.manager [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Took 0.82 seconds to detach 1 volumes for instance.
Nov 15 02:45:57 user nova-compute[75391]: DEBUG nova.compute.manager [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] [instance: 60093cdf-015e-4c39-a514-1818a6e55385] Deleting volume: 7c9e2931-9e6c-42a6-9b3c-b1854f32cb40 {{(pid=75391) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 02:45:57 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-961b276e-3e43-409e-8c45-85847683e473 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Snapshot image upload complete
Nov 15 02:45:57 user nova-compute[75391]: INFO nova.compute.manager [None req-961b276e-3e43-409e-8c45-85847683e473 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Took 7.90 seconds to snapshot the instance on the hypervisor.
Nov 15 02:45:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:45:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:45:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:45:58 user nova-compute[75391]: DEBUG nova.network.neutron [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Updating instance_info_cache with network_info: [{"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:45:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Releasing lock "refresh_cache-ebb7e616-3c05-4d99-a0b3-76dc1723e82d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:45:58 user nova-compute[75391]: DEBUG os_brick.utils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:45:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[508e7984-6ce9-4e4f-b46f-56b7cf6471fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.036s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c60805d-5fff-4056-88eb-e88259ea8ed7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:45:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d87b19-d9a6-4d6d-b46c-3826fb15bb2b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2646397-57ae-44c7-9c50-fd482d1a9ea3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:45:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:45:58 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:45:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:45:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:45:58 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:45:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ae5871-097c-4ae3-b2ce-89f8ce59c88d]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:45:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:45:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:45:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:45:58 user nova-compute[75391]: DEBUG os_brick.utils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:45:58 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:45:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.630s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:45:58 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Deleted allocations for instance 60093cdf-015e-4c39-a514-1818a6e55385
Nov 15 02:45:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d2d83b01-5212-468b-93cc-3e0b58fdd110 tempest-ServerActionsV293TestJSON-1642963392 tempest-ServerActionsV293TestJSON-1642963392-project-member] Lock "60093cdf-015e-4c39-a514-1818a6e55385" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.953s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:46:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "5c684afe-4c7a-41f1-89fe-8977ae1b5f61" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:46:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "5c684afe-4c7a-41f1-89fe-8977ae1b5f61" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:46:00 user nova-compute[75391]: DEBUG nova.compute.manager [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:46:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:46:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:46:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:46:00 user nova-compute[75391]: INFO nova.compute.claims [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Claim successful on node user
Nov 15 02:46:01 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:46:01 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:46:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.732s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:46:01 user nova-compute[75391]: DEBUG nova.compute.manager [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:46:01 user nova-compute[75391]: DEBUG nova.compute.manager [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:46:01 user nova-compute[75391]: DEBUG nova.network.neutron [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:46:01 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:46:01 user nova-compute[75391]: DEBUG nova.compute.manager [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:46:01 user nova-compute[75391]: DEBUG nova.policy [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80bf1a1698dc420799dbaf2e254e5d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e0ca1f6ce542a482164410c5e67e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:46:01 user nova-compute[75391]: DEBUG nova.compute.manager [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:46:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:46:01 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Creating image(s)
Nov 15 02:46:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c684afe-4c7a-41f1-89fe-8977ae1b5f61/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:46:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "/opt/stack/data/nova/instances/5c684afe-4c7a-41f1-89fe-8977ae1b5f61/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:46:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "/opt/stack/data/nova/instances/5c684afe-4c7a-41f1-89fe-8977ae1b5f61/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:46:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "d1a7c5d3c5a3e3131dd7a678574f8e01e0630da1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:46:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "d1a7c5d3c5a3e3131dd7a678574f8e01e0630da1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:46:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1a7c5d3c5a3e3131dd7a678574f8e01e0630da1.part --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:02 user nova-compute[75391]: DEBUG nova.network.neutron [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Successfully created port: e1d514f4-a89c-4f39-ad6e-77ade59a00f1 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:46:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1a7c5d3c5a3e3131dd7a678574f8e01e0630da1.part --force-share --output=json" returned: 0 in 0.226s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:02 user nova-compute[75391]: DEBUG nova.virt.images [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] 3bc600dd-86d7-496d-bff0-2e6c93fc3952 was qcow2, converting to raw {{(pid=75391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 02:46:02 user nova-compute[75391]: DEBUG nova.privsep.utils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 02:46:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d1a7c5d3c5a3e3131dd7a678574f8e01e0630da1.part /opt/stack/data/nova/instances/_base/d1a7c5d3c5a3e3131dd7a678574f8e01e0630da1.converted {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d1a7c5d3c5a3e3131dd7a678574f8e01e0630da1.part /opt/stack/data/nova/instances/_base/d1a7c5d3c5a3e3131dd7a678574f8e01e0630da1.converted" returned: 0 in 0.277s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1a7c5d3c5a3e3131dd7a678574f8e01e0630da1.converted --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1a7c5d3c5a3e3131dd7a678574f8e01e0630da1.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "d1a7c5d3c5a3e3131dd7a678574f8e01e0630da1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.680s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:46:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1a7c5d3c5a3e3131dd7a678574f8e01e0630da1 --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:03 user nova-compute[75391]: DEBUG nova.network.neutron [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Successfully updated port: e1d514f4-a89c-4f39-ad6e-77ade59a00f1 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:46:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "refresh_cache-5c684afe-4c7a-41f1-89fe-8977ae1b5f61" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:46:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquired lock "refresh_cache-5c684afe-4c7a-41f1-89fe-8977ae1b5f61" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:46:03 user nova-compute[75391]: DEBUG nova.network.neutron [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:46:03 user nova-compute[75391]: DEBUG nova.compute.manager [req-5cf5870a-22a5-4385-bf9a-71be3e8d3708 req-92bdbf0a-5606-4b08-8656-ae52ab605b08 service nova] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Received event network-changed-e1d514f4-a89c-4f39-ad6e-77ade59a00f1 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:46:03 user nova-compute[75391]: DEBUG nova.compute.manager [req-5cf5870a-22a5-4385-bf9a-71be3e8d3708 req-92bdbf0a-5606-4b08-8656-ae52ab605b08 service nova] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Refreshing instance network info cache due to event network-changed-e1d514f4-a89c-4f39-ad6e-77ade59a00f1. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:46:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5cf5870a-22a5-4385-bf9a-71be3e8d3708 req-92bdbf0a-5606-4b08-8656-ae52ab605b08 service nova] Acquiring lock "refresh_cache-5c684afe-4c7a-41f1-89fe-8977ae1b5f61" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:46:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1a7c5d3c5a3e3131dd7a678574f8e01e0630da1 --force-share --output=json" returned: 0 in 0.177s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "d1a7c5d3c5a3e3131dd7a678574f8e01e0630da1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:46:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "d1a7c5d3c5a3e3131dd7a678574f8e01e0630da1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:46:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1a7c5d3c5a3e3131dd7a678574f8e01e0630da1 --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:03 user nova-compute[75391]: DEBUG nova.network.neutron [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:46:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1a7c5d3c5a3e3131dd7a678574f8e01e0630da1 --force-share --output=json" returned: 0 in 0.214s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1a7c5d3c5a3e3131dd7a678574f8e01e0630da1,backing_fmt=raw /opt/stack/data/nova/instances/5c684afe-4c7a-41f1-89fe-8977ae1b5f61/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1a7c5d3c5a3e3131dd7a678574f8e01e0630da1,backing_fmt=raw /opt/stack/data/nova/instances/5c684afe-4c7a-41f1-89fe-8977ae1b5f61/disk 1073741824" returned: 0 in 0.060s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "d1a7c5d3c5a3e3131dd7a678574f8e01e0630da1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:46:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1a7c5d3c5a3e3131dd7a678574f8e01e0630da1 --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:03 user nova-compute[75391]: DEBUG nova.network.neutron [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Updating instance_info_cache with network_info: [{"id": "e1d514f4-a89c-4f39-ad6e-77ade59a00f1", "address": "fa:16:3e:08:2f:ea", "network": {"id": "5567560c-b3c5-4802-b758-92d672458351", "bridge": "br-int", "label": "tempest-TestStampPattern-268456575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e0ca1f6ce542a482164410c5e67e13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d514f4-a8", "ovs_interfaceid": "e1d514f4-a89c-4f39-ad6e-77ade59a00f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:46:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Releasing lock "refresh_cache-5c684afe-4c7a-41f1-89fe-8977ae1b5f61" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:46:03 user nova-compute[75391]: DEBUG nova.compute.manager [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Instance network_info: |[{"id": "e1d514f4-a89c-4f39-ad6e-77ade59a00f1", "address": "fa:16:3e:08:2f:ea", "network": {"id": "5567560c-b3c5-4802-b758-92d672458351", "bridge": "br-int", "label": "tempest-TestStampPattern-268456575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e0ca1f6ce542a482164410c5e67e13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d514f4-a8", "ovs_interfaceid": "e1d514f4-a89c-4f39-ad6e-77ade59a00f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:46:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5cf5870a-22a5-4385-bf9a-71be3e8d3708 req-92bdbf0a-5606-4b08-8656-ae52ab605b08 service nova] Acquired lock "refresh_cache-5c684afe-4c7a-41f1-89fe-8977ae1b5f61" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:46:03 user nova-compute[75391]: DEBUG nova.network.neutron [req-5cf5870a-22a5-4385-bf9a-71be3e8d3708 req-92bdbf0a-5606-4b08-8656-ae52ab605b08 service nova] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Refreshing network info cache for port e1d514f4-a89c-4f39-ad6e-77ade59a00f1 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1a7c5d3c5a3e3131dd7a678574f8e01e0630da1 --force-share --output=json" returned: 0 in 0.218s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Ensure instance console log exists: /opt/stack/data/nova/instances/5c684afe-4c7a-41f1-89fe-8977ae1b5f61/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Start _get_guest_xml network_info=[{"id": "e1d514f4-a89c-4f39-ad6e-77ade59a00f1", "address": "fa:16:3e:08:2f:ea", "network": {"id": "5567560c-b3c5-4802-b758-92d672458351", "bridge": "br-int", "label": "tempest-TestStampPattern-268456575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e0ca1f6ce542a482164410c5e67e13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d514f4-a8", "ovs_interfaceid": "e1d514f4-a89c-4f39-ad6e-77ade59a00f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='fb62f37f6908bad389234d07f22f1d3d',container_format='bare',created_at=2023-11-15T02:45:50Z,direct_url=<?>,disk_format='qcow2',id=3bc600dd-86d7-496d-bff0-2e6c93fc3952,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-337784100',owner='49e0ca1f6ce542a482164410c5e67e13',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T02:45:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '3bc600dd-86d7-496d-bff0-2e6c93fc3952'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:46:04 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:46:04 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='fb62f37f6908bad389234d07f22f1d3d',container_format='bare',created_at=2023-11-15T02:45:50Z,direct_url=<?>,disk_format='qcow2',id=3bc600dd-86d7-496d-bff0-2e6c93fc3952,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-337784100',owner='49e0ca1f6ce542a482164410c5e67e13',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T02:45:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:45:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-249908960',display_name='tempest-TestStampPattern-server-249908960',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-249908960',id=17,image_ref='3bc600dd-86d7-496d-bff0-2e6c93fc3952',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3B/LEgcjzrDXoVcTjod3suFtQaJB7/AKBOdUne7T90RZ2Rsek9XiExDiKs3DHc1kAHMCNWLEQyKPOAYwsFFBz1wohZQQ7UNT2IOBVNPlD2nJvR8+6i+tJnL4hmFgKSyA==',key_name='tempest-TestStampPattern-587335042',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49e0ca1f6ce542a482164410c5e67e13',ramdisk_id='',reservation_id='r-uiuyv58g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='38a63a30-a3bc-4556-9fb6-53522dbf2c68',image_min_disk='1',image_min_ram='0',image_owner_id='49e0ca1f6ce542a482164410c5e67e13',image_owner_project_name='tempest-TestStampPattern-1142812634',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1142812634-project-member',image_user_id='80bf1a1698dc420799dbaf2e254e5d74',network_allocated='True',owner_project_name='tempest-TestStampPattern-1142812634',owner_user_name='tempest-TestStampPattern-1142812634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:46:01Z,user_data=None,user_id='80bf1a1698dc420799dbaf2e254e5d74',uuid=5c684afe-4c7a-41f1-89fe-8977ae1b5f61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1d514f4-a89c-4f39-ad6e-77ade59a00f1", "address": "fa:16:3e:08:2f:ea", "network": {"id": "5567560c-b3c5-4802-b758-92d672458351", "bridge": "br-int", "label": "tempest-TestStampPattern-268456575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e0ca1f6ce542a482164410c5e67e13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d514f4-a8", "ovs_interfaceid": "e1d514f4-a89c-4f39-ad6e-77ade59a00f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Converting VIF {"id": "e1d514f4-a89c-4f39-ad6e-77ade59a00f1", "address": "fa:16:3e:08:2f:ea", "network": {"id": "5567560c-b3c5-4802-b758-92d672458351", "bridge": "br-int", "label": "tempest-TestStampPattern-268456575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e0ca1f6ce542a482164410c5e67e13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d514f4-a8", "ovs_interfaceid": "e1d514f4-a89c-4f39-ad6e-77ade59a00f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:2f:ea,bridge_name='br-int',has_traffic_filtering=True,id=e1d514f4-a89c-4f39-ad6e-77ade59a00f1,network=Network(5567560c-b3c5-4802-b758-92d672458351),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d514f4-a8') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.objects.instance [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c684afe-4c7a-41f1-89fe-8977ae1b5f61 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:46:04 user nova-compute[75391]:   <uuid>5c684afe-4c7a-41f1-89fe-8977ae1b5f61</uuid>
Nov 15 02:46:04 user nova-compute[75391]:   <name>instance-00000011</name>
Nov 15 02:46:04 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:46:04 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:46:04 user nova-compute[75391]:   <metadata>
Nov 15 02:46:04 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:46:04 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:46:04 user nova-compute[75391]:       <nova:name>tempest-TestStampPattern-server-249908960</nova:name>
Nov 15 02:46:04 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:46:04</nova:creationTime>
Nov 15 02:46:04 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:46:04 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:46:04 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:46:04 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:46:04 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:46:04 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:46:04 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:46:04 user nova-compute[75391]:       <nova:owner>
Nov 15 02:46:04 user nova-compute[75391]:         <nova:user uuid="80bf1a1698dc420799dbaf2e254e5d74">tempest-TestStampPattern-1142812634-project-member</nova:user>
Nov 15 02:46:04 user nova-compute[75391]:         <nova:project uuid="49e0ca1f6ce542a482164410c5e67e13">tempest-TestStampPattern-1142812634</nova:project>
Nov 15 02:46:04 user nova-compute[75391]:       </nova:owner>
Nov 15 02:46:04 user nova-compute[75391]:       <nova:root type="image" uuid="3bc600dd-86d7-496d-bff0-2e6c93fc3952"/>
Nov 15 02:46:04 user nova-compute[75391]:       <nova:ports>
Nov 15 02:46:04 user nova-compute[75391]:         <nova:port uuid="e1d514f4-a89c-4f39-ad6e-77ade59a00f1">
Nov 15 02:46:04 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 02:46:04 user nova-compute[75391]:         </nova:port>
Nov 15 02:46:04 user nova-compute[75391]:       </nova:ports>
Nov 15 02:46:04 user nova-compute[75391]:     </nova:instance>
Nov 15 02:46:04 user nova-compute[75391]:   </metadata>
Nov 15 02:46:04 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:46:04 user nova-compute[75391]:     <system>
Nov 15 02:46:04 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:46:04 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:46:04 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:46:04 user nova-compute[75391]:       <entry name="serial">5c684afe-4c7a-41f1-89fe-8977ae1b5f61</entry>
Nov 15 02:46:04 user nova-compute[75391]:       <entry name="uuid">5c684afe-4c7a-41f1-89fe-8977ae1b5f61</entry>
Nov 15 02:46:04 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:46:04 user nova-compute[75391]:     </system>
Nov 15 02:46:04 user nova-compute[75391]:   </sysinfo>
Nov 15 02:46:04 user nova-compute[75391]:   <os>
Nov 15 02:46:04 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:46:04 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:46:04 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:46:04 user nova-compute[75391]:   </os>
Nov 15 02:46:04 user nova-compute[75391]:   <features>
Nov 15 02:46:04 user nova-compute[75391]:     <acpi/>
Nov 15 02:46:04 user nova-compute[75391]:     <apic/>
Nov 15 02:46:04 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:46:04 user nova-compute[75391]:   </features>
Nov 15 02:46:04 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:46:04 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:46:04 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:46:04 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:46:04 user nova-compute[75391]:   </clock>
Nov 15 02:46:04 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:46:04 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:46:04 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:46:04 user nova-compute[75391]:   </cpu>
Nov 15 02:46:04 user nova-compute[75391]:   <devices>
Nov 15 02:46:04 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:46:04 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:46:04 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/5c684afe-4c7a-41f1-89fe-8977ae1b5f61/disk"/>
Nov 15 02:46:04 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:46:04 user nova-compute[75391]:     </disk>
Nov 15 02:46:04 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:46:04 user nova-compute[75391]:       <mac address="fa:16:3e:08:2f:ea"/>
Nov 15 02:46:04 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:46:04 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:46:04 user nova-compute[75391]:       <target dev="tape1d514f4-a8"/>
Nov 15 02:46:04 user nova-compute[75391]:     </interface>
Nov 15 02:46:04 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:46:04 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/5c684afe-4c7a-41f1-89fe-8977ae1b5f61/console.log" append="off"/>
Nov 15 02:46:04 user nova-compute[75391]:     </serial>
Nov 15 02:46:04 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:46:04 user nova-compute[75391]:     <video>
Nov 15 02:46:04 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:46:04 user nova-compute[75391]:     </video>
Nov 15 02:46:04 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:46:04 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:46:04 user nova-compute[75391]:     </rng>
Nov 15 02:46:04 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:46:04 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:46:04 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:46:04 user nova-compute[75391]:     </memballoon>
Nov 15 02:46:04 user nova-compute[75391]:   </devices>
Nov 15 02:46:04 user nova-compute[75391]: </domain>
Nov 15 02:46:04 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:45:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-249908960',display_name='tempest-TestStampPattern-server-249908960',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-249908960',id=17,image_ref='3bc600dd-86d7-496d-bff0-2e6c93fc3952',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3B/LEgcjzrDXoVcTjod3suFtQaJB7/AKBOdUne7T90RZ2Rsek9XiExDiKs3DHc1kAHMCNWLEQyKPOAYwsFFBz1wohZQQ7UNT2IOBVNPlD2nJvR8+6i+tJnL4hmFgKSyA==',key_name='tempest-TestStampPattern-587335042',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49e0ca1f6ce542a482164410c5e67e13',ramdisk_id='',reservation_id='r-uiuyv58g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='38a63a30-a3bc-4556-9fb6-53522dbf2c68',image_min_disk='1',image_min_ram='0',image_owner_id='49e0ca1f6ce542a482164410c5e67e13',image_owner_project_name='tempest-TestStampPattern-1142812634',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1142812634-project-member',image_user_id='80bf1a1698dc420799dbaf2e254e5d74',network_allocated='True',owner_project_name='tempest-TestStampPattern-1142812634',owner_user_name='tempest-TestStampPattern-1142812634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:46:01Z,user_data=None,user_id='80bf1a1698dc420799dbaf2e254e5d74',uuid=5c684afe-4c7a-41f1-89fe-8977ae1b5f61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1d514f4-a89c-4f39-ad6e-77ade59a00f1", "address": "fa:16:3e:08:2f:ea", "network": {"id": "5567560c-b3c5-4802-b758-92d672458351", "bridge": "br-int", "label": "tempest-TestStampPattern-268456575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e0ca1f6ce542a482164410c5e67e13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d514f4-a8", "ovs_interfaceid": "e1d514f4-a89c-4f39-ad6e-77ade59a00f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Converting VIF {"id": "e1d514f4-a89c-4f39-ad6e-77ade59a00f1", "address": "fa:16:3e:08:2f:ea", "network": {"id": "5567560c-b3c5-4802-b758-92d672458351", "bridge": "br-int", "label": "tempest-TestStampPattern-268456575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e0ca1f6ce542a482164410c5e67e13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d514f4-a8", "ovs_interfaceid": "e1d514f4-a89c-4f39-ad6e-77ade59a00f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:2f:ea,bridge_name='br-int',has_traffic_filtering=True,id=e1d514f4-a89c-4f39-ad6e-77ade59a00f1,network=Network(5567560c-b3c5-4802-b758-92d672458351),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d514f4-a8') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG os_vif [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:2f:ea,bridge_name='br-int',has_traffic_filtering=True,id=e1d514f4-a89c-4f39-ad6e-77ade59a00f1,network=Network(5567560c-b3c5-4802-b758-92d672458351),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d514f4-a8') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0f94107-42ef-5cc2-a00f-9c24e610b77b', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1d514f4-a8, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape1d514f4-a8, col_values=(('qos', UUID('a41cd7b9-6845-43cc-af8d-ca974db337a6')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape1d514f4-a8, col_values=(('external_ids', {'iface-id': 'e1d514f4-a89c-4f39-ad6e-77ade59a00f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:2f:ea', 'vm-uuid': '5c684afe-4c7a-41f1-89fe-8977ae1b5f61'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:04 user nova-compute[75391]: INFO os_vif [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:2f:ea,bridge_name='br-int',has_traffic_filtering=True,id=e1d514f4-a89c-4f39-ad6e-77ade59a00f1,network=Network(5567560c-b3c5-4802-b758-92d672458351),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d514f4-a8')
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] No VIF found with MAC fa:16:3e:08:2f:ea, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.network.neutron [req-5cf5870a-22a5-4385-bf9a-71be3e8d3708 req-92bdbf0a-5606-4b08-8656-ae52ab605b08 service nova] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Updated VIF entry in instance network info cache for port e1d514f4-a89c-4f39-ad6e-77ade59a00f1. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG nova.network.neutron [req-5cf5870a-22a5-4385-bf9a-71be3e8d3708 req-92bdbf0a-5606-4b08-8656-ae52ab605b08 service nova] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Updating instance_info_cache with network_info: [{"id": "e1d514f4-a89c-4f39-ad6e-77ade59a00f1", "address": "fa:16:3e:08:2f:ea", "network": {"id": "5567560c-b3c5-4802-b758-92d672458351", "bridge": "br-int", "label": "tempest-TestStampPattern-268456575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e0ca1f6ce542a482164410c5e67e13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d514f4-a8", "ovs_interfaceid": "e1d514f4-a89c-4f39-ad6e-77ade59a00f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5cf5870a-22a5-4385-bf9a-71be3e8d3708 req-92bdbf0a-5606-4b08-8656-ae52ab605b08 service nova] Releasing lock "refresh_cache-5c684afe-4c7a-41f1-89fe-8977ae1b5f61" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:46:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Starting finish_migration {{(pid=75391) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 15 02:46:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Instance directory exists: not creating {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 02:46:05 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Creating image(s)
Nov 15 02:46:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG nova.compute.manager [req-e7d18b34-725e-422d-9d65-5aade3476893 req-08905866-8619-448d-ac3d-fa58a9a06f62 service nova] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Received event network-vif-plugged-e1d514f4-a89c-4f39-ad6e-77ade59a00f1 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e7d18b34-725e-422d-9d65-5aade3476893 req-08905866-8619-448d-ac3d-fa58a9a06f62 service nova] Acquiring lock "5c684afe-4c7a-41f1-89fe-8977ae1b5f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e7d18b34-725e-422d-9d65-5aade3476893 req-08905866-8619-448d-ac3d-fa58a9a06f62 service nova] Lock "5c684afe-4c7a-41f1-89fe-8977ae1b5f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e7d18b34-725e-422d-9d65-5aade3476893 req-08905866-8619-448d-ac3d-fa58a9a06f62 service nova] Lock "5c684afe-4c7a-41f1-89fe-8977ae1b5f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG nova.compute.manager [req-e7d18b34-725e-422d-9d65-5aade3476893 req-08905866-8619-448d-ac3d-fa58a9a06f62 service nova] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] No waiting events found dispatching network-vif-plugged-e1d514f4-a89c-4f39-ad6e-77ade59a00f1 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:46:06 user nova-compute[75391]: WARNING nova.compute.manager [req-e7d18b34-725e-422d-9d65-5aade3476893 req-08905866-8619-448d-ac3d-fa58a9a06f62 service nova] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Received unexpected event network-vif-plugged-e1d514f4-a89c-4f39-ad6e-77ade59a00f1 for instance with vm_state building and task_state spawning.
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.220s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk. size=21474836480 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk 21474836480 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk 21474836480" returned: 0 in 0.049s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Did not create local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Ensure instance console log exists: /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Start _get_guest_xml network_info=[{"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1586176386-network", "vif_mac": "fa:16:3e:79:35:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '0e8fa8d1-2bb7-4e7d-8d90-9b26af75c99e', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dfGrvENV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ebb7e616-3c05-4d99-a0b3-76dc1723e82d', 'attached_at': '2023-11-15T02:46:05.000000', 'detached_at': '', 'volume_id': '223d22cc-ebb2-4b73-8103-54aacfd3b44a', 'serial': '223d22cc-ebb2-4b73-8103-54aacfd3b44a'}, 'volume_type': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:46:06 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:46:06 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:46:06 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dfGrvENV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:46:06 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:46:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:46:06 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:46:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:46:06 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[942897b8-a606-42ed-a979-5689590543ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:46:06 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bf89ec-8ca0-4145-a3d5-691012e94b39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a] added
Nov 15 02:46:06 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b938aa9-dae6-424a-a350-bcdf5f31a50a]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d9f313-7e93-4904-a2cc-bbca7549bd4a]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dfGrvENV {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dfGrvENV" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a17972-30a6-45f1-969c-1055710eabda]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dfGrvENV'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae773a71-88be-4028-9bfe-c050ab2163f1]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92c632e-02e9-43b7-8098-9a878e650431]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:46:06 user nova-compute[75391]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:46:06 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:46:06 user nova-compute[75391]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:46:06 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc172e76-0568-46ea-8cb7-2bdc82402330]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a, portal: 172.16.0.220,3260]
Nov 15 02:46:06 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a, portal: 172.16.0.220,3260] successful.
Nov 15 02:46:06 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8030183-2fec-4b0a-bcb1-ce17f8b8c2a6]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf47fa3-9228-4216-8153-57bbf5463487]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:46:06 user nova-compute[75391]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:46:06 user nova-compute[75391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:46:06 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:46:06 user nova-compute[75391]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:46:06 user nova-compute[75391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:46:06 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2654f72d-97b4-4c16-8f6f-9b6b2c93dd48]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:46:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dfGrvENV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:46:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:46:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26464616338383433', 'path': '/dev/sdc'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:46:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464616338383433', 'path': '/dev/sdc'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:46:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-689614808',display_name='tempest-ServerActionsTestOtherB-server-689614808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-689614808',id=2,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2usIoDVXl+b9hE3o9jGzEYasMoeupEZWjgdC34QhkyFhqHaktIVO5IuSwbU0DElzd5MkeVTBrP68npXS/361ypXFAC7mDzbXraFDprW+Txm/mxv6ZY7FykX6U+2H5j7A==',key_name='tempest-keypair-1921719925',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:42:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dfefdbf9f31b47d4a76d8fb06414eb5a',ramdisk_id='',reservation_id='r-qacecpst',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-5763420',owner_user_name='tempest-ServerActionsTestOtherB-5763420-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:45:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34b23ed566024cc3a90f97206ea8162d',uuid=ebb7e616-3c05-4d99-a0b3-76dc1723e82d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1586176386-network", "vif_mac": "fa:16:3e:79:35:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:46:07 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Converting VIF {"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1586176386-network", "vif_mac": "fa:16:3e:79:35:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:46:07 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:35:a3,bridge_name='br-int',has_traffic_filtering=True,id=c9643afc-4454-4d29-b8a2-5422753857b0,network=Network(db549bf7-e039-4ea4-ac62-b5c090652e6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9643afc-44') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:46:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:46:07 user nova-compute[75391]:   <uuid>ebb7e616-3c05-4d99-a0b3-76dc1723e82d</uuid>
Nov 15 02:46:07 user nova-compute[75391]:   <name>instance-00000002</name>
Nov 15 02:46:07 user nova-compute[75391]:   <memory>2097152</memory>
Nov 15 02:46:07 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:46:07 user nova-compute[75391]:   <metadata>
Nov 15 02:46:07 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:46:07 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:46:07 user nova-compute[75391]:       <nova:name>tempest-ServerActionsTestOtherB-server-689614808</nova:name>
Nov 15 02:46:07 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:46:06</nova:creationTime>
Nov 15 02:46:07 user nova-compute[75391]:       <nova:flavor name="m1.small">
Nov 15 02:46:07 user nova-compute[75391]:         <nova:memory>2048</nova:memory>
Nov 15 02:46:07 user nova-compute[75391]:         <nova:disk>20</nova:disk>
Nov 15 02:46:07 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:46:07 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:46:07 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:46:07 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:46:07 user nova-compute[75391]:       <nova:owner>
Nov 15 02:46:07 user nova-compute[75391]:         <nova:user uuid="34b23ed566024cc3a90f97206ea8162d">tempest-ServerActionsTestOtherB-5763420-project-member</nova:user>
Nov 15 02:46:07 user nova-compute[75391]:         <nova:project uuid="dfefdbf9f31b47d4a76d8fb06414eb5a">tempest-ServerActionsTestOtherB-5763420</nova:project>
Nov 15 02:46:07 user nova-compute[75391]:       </nova:owner>
Nov 15 02:46:07 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:46:07 user nova-compute[75391]:       <nova:ports>
Nov 15 02:46:07 user nova-compute[75391]:         <nova:port uuid="c9643afc-4454-4d29-b8a2-5422753857b0">
Nov 15 02:46:07 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 02:46:07 user nova-compute[75391]:         </nova:port>
Nov 15 02:46:07 user nova-compute[75391]:       </nova:ports>
Nov 15 02:46:07 user nova-compute[75391]:     </nova:instance>
Nov 15 02:46:07 user nova-compute[75391]:   </metadata>
Nov 15 02:46:07 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:46:07 user nova-compute[75391]:     <system>
Nov 15 02:46:07 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:46:07 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:46:07 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:46:07 user nova-compute[75391]:       <entry name="serial">ebb7e616-3c05-4d99-a0b3-76dc1723e82d</entry>
Nov 15 02:46:07 user nova-compute[75391]:       <entry name="uuid">ebb7e616-3c05-4d99-a0b3-76dc1723e82d</entry>
Nov 15 02:46:07 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:46:07 user nova-compute[75391]:     </system>
Nov 15 02:46:07 user nova-compute[75391]:   </sysinfo>
Nov 15 02:46:07 user nova-compute[75391]:   <os>
Nov 15 02:46:07 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:46:07 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:46:07 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:46:07 user nova-compute[75391]:   </os>
Nov 15 02:46:07 user nova-compute[75391]:   <features>
Nov 15 02:46:07 user nova-compute[75391]:     <acpi/>
Nov 15 02:46:07 user nova-compute[75391]:     <apic/>
Nov 15 02:46:07 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:46:07 user nova-compute[75391]:   </features>
Nov 15 02:46:07 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:46:07 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:46:07 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:46:07 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:46:07 user nova-compute[75391]:   </clock>
Nov 15 02:46:07 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:46:07 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:46:07 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:46:07 user nova-compute[75391]:   </cpu>
Nov 15 02:46:07 user nova-compute[75391]:   <devices>
Nov 15 02:46:07 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:46:07 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:46:07 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk"/>
Nov 15 02:46:07 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:46:07 user nova-compute[75391]:     </disk>
Nov 15 02:46:07 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 02:46:07 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:46:07 user nova-compute[75391]:       <source dev="/dev/sdc"/>
Nov 15 02:46:07 user nova-compute[75391]:       <target dev="vdb" bus="virtio"/>
Nov 15 02:46:07 user nova-compute[75391]:       <serial>223d22cc-ebb2-4b73-8103-54aacfd3b44a</serial>
Nov 15 02:46:07 user nova-compute[75391]:     </disk>
Nov 15 02:46:07 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:46:07 user nova-compute[75391]:       <mac address="fa:16:3e:79:35:a3"/>
Nov 15 02:46:07 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:46:07 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:46:07 user nova-compute[75391]:       <target dev="tapc9643afc-44"/>
Nov 15 02:46:07 user nova-compute[75391]:     </interface>
Nov 15 02:46:07 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:46:07 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/console.log" append="off"/>
Nov 15 02:46:07 user nova-compute[75391]:     </serial>
Nov 15 02:46:07 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:46:07 user nova-compute[75391]:     <video>
Nov 15 02:46:07 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:46:07 user nova-compute[75391]:     </video>
Nov 15 02:46:07 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:46:07 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:46:07 user nova-compute[75391]:     </rng>
Nov 15 02:46:07 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:46:07 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:46:07 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:46:07 user nova-compute[75391]:     </memballoon>
Nov 15 02:46:07 user nova-compute[75391]:   </devices>
Nov 15 02:46:07 user nova-compute[75391]: </domain>
Nov 15 02:46:07 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:46:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-689614808',display_name='tempest-ServerActionsTestOtherB-server-689614808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-689614808',id=2,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2usIoDVXl+b9hE3o9jGzEYasMoeupEZWjgdC34QhkyFhqHaktIVO5IuSwbU0DElzd5MkeVTBrP68npXS/361ypXFAC7mDzbXraFDprW+Txm/mxv6ZY7FykX6U+2H5j7A==',key_name='tempest-keypair-1921719925',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:42:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dfefdbf9f31b47d4a76d8fb06414eb5a',ramdisk_id='',reservation_id='r-qacecpst',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-5763420',owner_user_name='tempest-ServerActionsTestOtherB-5763420-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:45:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34b23ed566024cc3a90f97206ea8162d',uuid=ebb7e616-3c05-4d99-a0b3-76dc1723e82d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1586176386-network", "vif_mac": "fa:16:3e:79:35:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:46:07 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Converting VIF {"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1586176386-network", "vif_mac": "fa:16:3e:79:35:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:46:07 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:35:a3,bridge_name='br-int',has_traffic_filtering=True,id=c9643afc-4454-4d29-b8a2-5422753857b0,network=Network(db549bf7-e039-4ea4-ac62-b5c090652e6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9643afc-44') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:46:07 user nova-compute[75391]: DEBUG os_vif [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:35:a3,bridge_name='br-int',has_traffic_filtering=True,id=c9643afc-4454-4d29-b8a2-5422753857b0,network=Network(db549bf7-e039-4ea4-ac62-b5c090652e6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9643afc-44') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:46:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:46:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:46:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0463733-cee5-5ff3-8620-fd8a83e092b2', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:46:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9643afc-44, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:46:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9643afc-44, col_values=(('qos', UUID('dd09968a-b26e-46bc-bd24-013d24cc825d')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:46:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9643afc-44, col_values=(('external_ids', {'iface-id': 'c9643afc-4454-4d29-b8a2-5422753857b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:35:a3', 'vm-uuid': 'ebb7e616-3c05-4d99-a0b3-76dc1723e82d'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:46:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:46:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:08 user nova-compute[75391]: INFO os_vif [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:35:a3,bridge_name='br-int',has_traffic_filtering=True,id=c9643afc-4454-4d29-b8a2-5422753857b0,network=Network(db549bf7-e039-4ea4-ac62-b5c090652e6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9643afc-44')
Nov 15 02:46:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:46:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:46:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] No VIF found with MAC fa:16:3e:79:35:a3, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:46:08 user nova-compute[75391]: DEBUG nova.compute.manager [req-e3b9f106-78c8-4f3b-8262-cfe2efb071c1 req-dbfdf018-b049-4383-91b6-3a5ee7668c21 service nova] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Received event network-vif-plugged-e1d514f4-a89c-4f39-ad6e-77ade59a00f1 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:46:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e3b9f106-78c8-4f3b-8262-cfe2efb071c1 req-dbfdf018-b049-4383-91b6-3a5ee7668c21 service nova] Acquiring lock "5c684afe-4c7a-41f1-89fe-8977ae1b5f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:46:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e3b9f106-78c8-4f3b-8262-cfe2efb071c1 req-dbfdf018-b049-4383-91b6-3a5ee7668c21 service nova] Lock "5c684afe-4c7a-41f1-89fe-8977ae1b5f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:46:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e3b9f106-78c8-4f3b-8262-cfe2efb071c1 req-dbfdf018-b049-4383-91b6-3a5ee7668c21 service nova] Lock "5c684afe-4c7a-41f1-89fe-8977ae1b5f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:46:08 user nova-compute[75391]: DEBUG nova.compute.manager [req-e3b9f106-78c8-4f3b-8262-cfe2efb071c1 req-dbfdf018-b049-4383-91b6-3a5ee7668c21 service nova] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] No waiting events found dispatching network-vif-plugged-e1d514f4-a89c-4f39-ad6e-77ade59a00f1 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:46:08 user nova-compute[75391]: WARNING nova.compute.manager [req-e3b9f106-78c8-4f3b-8262-cfe2efb071c1 req-dbfdf018-b049-4383-91b6-3a5ee7668c21 service nova] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Received unexpected event network-vif-plugged-e1d514f4-a89c-4f39-ad6e-77ade59a00f1 for instance with vm_state building and task_state spawning.
Nov 15 02:46:08 user nova-compute[75391]: DEBUG nova.compute.manager [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:46:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:46:08 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Instance spawned successfully.
Nov 15 02:46:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:46:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:46:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:46:08 user nova-compute[75391]: INFO nova.compute.manager [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Took 6.71 seconds to spawn the instance on the hypervisor.
Nov 15 02:46:08 user nova-compute[75391]: DEBUG nova.compute.manager [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:46:08 user nova-compute[75391]: INFO nova.compute.manager [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Took 7.90 seconds to build instance.
Nov 15 02:46:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3e0acf4e-aecc-455e-b132-f7d001e6640d tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "5c684afe-4c7a-41f1-89fe-8977ae1b5f61" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.041s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:46:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:10 user nova-compute[75391]: DEBUG nova.compute.manager [req-349e80a6-b17f-4a3e-b448-5a88e58378ca req-e95a5c31-31f2-49b1-b910-a093f696e880 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Received event network-vif-plugged-c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:46:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-349e80a6-b17f-4a3e-b448-5a88e58378ca req-e95a5c31-31f2-49b1-b910-a093f696e880 service nova] Acquiring lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:46:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-349e80a6-b17f-4a3e-b448-5a88e58378ca req-e95a5c31-31f2-49b1-b910-a093f696e880 service nova] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:46:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-349e80a6-b17f-4a3e-b448-5a88e58378ca req-e95a5c31-31f2-49b1-b910-a093f696e880 service nova] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:46:10 user nova-compute[75391]: DEBUG nova.compute.manager [req-349e80a6-b17f-4a3e-b448-5a88e58378ca req-e95a5c31-31f2-49b1-b910-a093f696e880 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] No waiting events found dispatching network-vif-plugged-c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:46:10 user nova-compute[75391]: WARNING nova.compute.manager [req-349e80a6-b17f-4a3e-b448-5a88e58378ca req-e95a5c31-31f2-49b1-b910-a093f696e880 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Received unexpected event network-vif-plugged-c9643afc-4454-4d29-b8a2-5422753857b0 for instance with vm_state active and task_state resize_finish.
Nov 15 02:46:10 user nova-compute[75391]: DEBUG nova.compute.manager [req-349e80a6-b17f-4a3e-b448-5a88e58378ca req-e95a5c31-31f2-49b1-b910-a093f696e880 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Received event network-vif-plugged-c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:46:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-349e80a6-b17f-4a3e-b448-5a88e58378ca req-e95a5c31-31f2-49b1-b910-a093f696e880 service nova] Acquiring lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:46:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-349e80a6-b17f-4a3e-b448-5a88e58378ca req-e95a5c31-31f2-49b1-b910-a093f696e880 service nova] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:46:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-349e80a6-b17f-4a3e-b448-5a88e58378ca req-e95a5c31-31f2-49b1-b910-a093f696e880 service nova] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:46:10 user nova-compute[75391]: DEBUG nova.compute.manager [req-349e80a6-b17f-4a3e-b448-5a88e58378ca req-e95a5c31-31f2-49b1-b910-a093f696e880 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] No waiting events found dispatching network-vif-plugged-c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:46:10 user nova-compute[75391]: WARNING nova.compute.manager [req-349e80a6-b17f-4a3e-b448-5a88e58378ca req-e95a5c31-31f2-49b1-b910-a093f696e880 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Received unexpected event network-vif-plugged-c9643afc-4454-4d29-b8a2-5422753857b0 for instance with vm_state active and task_state resize_finish.
Nov 15 02:46:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:11 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:46:11 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Instance running successfully.
Nov 15 02:46:11 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Failed to set time: agent not configured {{(pid=75391) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 15 02:46:11 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5ca28b98-e9a3-4fb5-81d1-5b8d4e8f8d10 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] finish_migration finished successfully. {{(pid=75391) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 15 02:46:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:17 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:22 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:38 user nova-compute[75391]: INFO nova.compute.manager [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Rescuing
Nov 15 02:46:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "refresh_cache-6400a5f3-0ec9-4484-930c-1f5061ae5374" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:46:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquired lock "refresh_cache-6400a5f3-0ec9-4484-930c-1f5061ae5374" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:46:38 user nova-compute[75391]: DEBUG nova.network.neutron [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:46:38 user nova-compute[75391]: DEBUG nova.network.neutron [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Updating instance_info_cache with network_info: [{"id": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "address": "fa:16:3e:84:8e:2f", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f803b5-4e", "ovs_interfaceid": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:46:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Releasing lock "refresh_cache-6400a5f3-0ec9-4484-930c-1f5061ae5374" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:46:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:39 user nova-compute[75391]: DEBUG nova.compute.manager [req-f1d7e724-4754-4694-b508-5af506614cdf req-16b42506-ab19-4bc4-9074-e18223f95f74 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Received event network-vif-unplugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:46:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f1d7e724-4754-4694-b508-5af506614cdf req-16b42506-ab19-4bc4-9074-e18223f95f74 service nova] Acquiring lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:46:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f1d7e724-4754-4694-b508-5af506614cdf req-16b42506-ab19-4bc4-9074-e18223f95f74 service nova] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:46:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f1d7e724-4754-4694-b508-5af506614cdf req-16b42506-ab19-4bc4-9074-e18223f95f74 service nova] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:46:39 user nova-compute[75391]: DEBUG nova.compute.manager [req-f1d7e724-4754-4694-b508-5af506614cdf req-16b42506-ab19-4bc4-9074-e18223f95f74 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] No waiting events found dispatching network-vif-unplugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:46:39 user nova-compute[75391]: WARNING nova.compute.manager [req-f1d7e724-4754-4694-b508-5af506614cdf req-16b42506-ab19-4bc4-9074-e18223f95f74 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Received unexpected event network-vif-unplugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 for instance with vm_state active and task_state rescuing.
Nov 15 02:46:39 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Instance destroyed successfully.
Nov 15 02:46:39 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Attempting a stable device rescue
Nov 15 02:46:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75391) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 02:46:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Instance directory exists: not creating {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 02:46:39 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Creating image(s)
Nov 15 02:46:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "/opt/stack/data/nova/instances/6400a5f3-0ec9-4484-930c-1f5061ae5374/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:46:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "/opt/stack/data/nova/instances/6400a5f3-0ec9-4484-930c-1f5061ae5374/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:46:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "/opt/stack/data/nova/instances/6400a5f3-0ec9-4484-930c-1f5061ae5374/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:46:39 user nova-compute[75391]: DEBUG nova.objects.instance [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6400a5f3-0ec9-4484-930c-1f5061ae5374 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:46:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "ae51d8429e4db80a65c8102ceebb0defab0ca398" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:46:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "ae51d8429e4db80a65c8102ceebb0defab0ca398" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:46:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae51d8429e4db80a65c8102ceebb0defab0ca398.part --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:40 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae51d8429e4db80a65c8102ceebb0defab0ca398.part --force-share --output=json" returned: 0 in 0.200s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:41 user nova-compute[75391]: DEBUG nova.virt.images [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] d2f28e62-6b00-4a47-93a8-66b33ce0bd58 was qcow2, converting to raw {{(pid=75391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 02:46:41 user nova-compute[75391]: DEBUG nova.privsep.utils [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 02:46:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ae51d8429e4db80a65c8102ceebb0defab0ca398.part /opt/stack/data/nova/instances/_base/ae51d8429e4db80a65c8102ceebb0defab0ca398.converted {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:41 user nova-compute[75391]: DEBUG nova.compute.manager [req-b39c4d04-b5f7-43d3-aca2-4e668507ac0d req-8d347b51-bcab-4d72-be75-04f8d6363a73 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Received event network-vif-plugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:46:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b39c4d04-b5f7-43d3-aca2-4e668507ac0d req-8d347b51-bcab-4d72-be75-04f8d6363a73 service nova] Acquiring lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:46:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b39c4d04-b5f7-43d3-aca2-4e668507ac0d req-8d347b51-bcab-4d72-be75-04f8d6363a73 service nova] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:46:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b39c4d04-b5f7-43d3-aca2-4e668507ac0d req-8d347b51-bcab-4d72-be75-04f8d6363a73 service nova] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:46:41 user nova-compute[75391]: DEBUG nova.compute.manager [req-b39c4d04-b5f7-43d3-aca2-4e668507ac0d req-8d347b51-bcab-4d72-be75-04f8d6363a73 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] No waiting events found dispatching network-vif-plugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:46:41 user nova-compute[75391]: WARNING nova.compute.manager [req-b39c4d04-b5f7-43d3-aca2-4e668507ac0d req-8d347b51-bcab-4d72-be75-04f8d6363a73 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Received unexpected event network-vif-plugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 for instance with vm_state active and task_state rescuing.
Nov 15 02:46:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ae51d8429e4db80a65c8102ceebb0defab0ca398.part /opt/stack/data/nova/instances/_base/ae51d8429e4db80a65c8102ceebb0defab0ca398.converted" returned: 0 in 0.567s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae51d8429e4db80a65c8102ceebb0defab0ca398.converted --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae51d8429e4db80a65c8102ceebb0defab0ca398.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "ae51d8429e4db80a65c8102ceebb0defab0ca398" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.155s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:46:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "ae51d8429e4db80a65c8102ceebb0defab0ca398" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:46:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "ae51d8429e4db80a65c8102ceebb0defab0ca398" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:46:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae51d8429e4db80a65c8102ceebb0defab0ca398 --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae51d8429e4db80a65c8102ceebb0defab0ca398 --force-share --output=json" returned: 0 in 0.202s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ae51d8429e4db80a65c8102ceebb0defab0ca398,backing_fmt=raw /opt/stack/data/nova/instances/6400a5f3-0ec9-4484-930c-1f5061ae5374/disk.rescue {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ae51d8429e4db80a65c8102ceebb0defab0ca398,backing_fmt=raw /opt/stack/data/nova/instances/6400a5f3-0ec9-4484-930c-1f5061ae5374/disk.rescue" returned: 0 in 0.056s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "ae51d8429e4db80a65c8102ceebb0defab0ca398" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.objects.instance [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lazy-loading 'migration_context' on Instance uuid 6400a5f3-0ec9-4484-930c-1f5061ae5374 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.objects.base [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Object Instance<6400a5f3-0ec9-4484-930c-1f5061ae5374> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Start _get_guest_xml network_info=[{"id": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "address": "fa:16:3e:84:8e:2f", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "vif_mac": "fa:16:3e:84:8e:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f803b5-4e", "ovs_interfaceid": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd2f28e62-6b00-4a47-93a8-66b33ce0bd58', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '87928730-295b-45e8-8654-fe5ae57d474e', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gjWowTAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '6400a5f3-0ec9-4484-930c-1f5061ae5374', 'attached_at': '', 'detached_at': '', 'volume_id': 'af618bdf-b151-451b-a7a8-62f1a5270a1f', 'serial': 'af618bdf-b151-451b-a7a8-62f1a5270a1f'}, 'volume_type': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.objects.instance [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lazy-loading 'resources' on Instance uuid 6400a5f3-0ec9-4484-930c-1f5061ae5374 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.objects.base [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Object Instance<6400a5f3-0ec9-4484-930c-1f5061ae5374> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.objects.instance [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lazy-loading 'numa_topology' on Instance uuid 6400a5f3-0ec9-4484-930c-1f5061ae5374 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.objects.base [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Object Instance<6400a5f3-0ec9-4484-930c-1f5061ae5374> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:46:42 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:46:42 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.objects.instance [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6400a5f3-0ec9-4484-930c-1f5061ae5374 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.objects.base [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Object Instance<6400a5f3-0ec9-4484-930c-1f5061ae5374> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gjWowTAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:46:42 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:46:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:46:42 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:46:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:46:42 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:46:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[98449bb9-763f-4b44-b7aa-ffaebfae4249]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = gjWowTAY\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 02:46:42 user nova-compute[75391]: node.name = iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:46:42 user nova-compute[75391]: node.tpgt = -1
Nov 15 02:46:42 user nova-compute[75391]: node.startup = automatic
Nov 15 02:46:42 user nova-compute[75391]: node.leading_login = No
Nov 15 02:46:42 user nova-compute[75391]: iface.iscsi_ifacename = default
Nov 15 02:46:42 user nova-compute[75391]: iface.net_ifacename = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.ipaddress = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.prefix_len = 0
Nov 15 02:46:42 user nova-compute[75391]: iface.hwaddress = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.transport_name = tcp
Nov 15 02:46:42 user nova-compute[75391]: iface.initiatorname = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.state = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.vlan_id = 0
Nov 15 02:46:42 user nova-compute[75391]: iface.vlan_priority = 0
Nov 15 02:46:42 user nova-compute[75391]: iface.vlan_state = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.iface_num = 0
Nov 15 02:46:42 user nova-compute[75391]: iface.mtu = 0
Nov 15 02:46:42 user nova-compute[75391]: iface.port = 0
Nov 15 02:46:42 user nova-compute[75391]: iface.bootproto = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.subnet_mask = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.gateway = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.dhcp_alt_client_id = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.dhcp_dns = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.dhcp_learn_iqn = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.dhcp_vendor_id_state = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.dhcp_vendor_id = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.dhcp_slp_da = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.fragmentation = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.gratuitous_arp = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.incoming_forwarding = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.tos_state = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.tos = 0
Nov 15 02:46:42 user nova-compute[75391]: iface.ttl = 0
Nov 15 02:46:42 user nova-compute[75391]: iface.delayed_ack = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.tcp_nagle = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.tcp_wsf_state = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.tcp_wsf = 0
Nov 15 02:46:42 user nova-compute[75391]: iface.tcp_timer_scale = 0
Nov 15 02:46:42 user nova-compute[75391]: iface.tcp_timestamp = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.redirect = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.def_task_mgmt_timeout = 0
Nov 15 02:46:42 user nova-compute[75391]: iface.header_digest = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.data_digest = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.immediate_data = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.initial_r2t = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.data_seq_inorder = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.data_pdu_inorder = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.erl = 0
Nov 15 02:46:42 user nova-compute[75391]: iface.max_receive_data_len = 0
Nov 15 02:46:42 user nova-compute[75391]: iface.first_burst_len = 0
Nov 15 02:46:42 user nova-compute[75391]: iface.max_outstanding_r2t = 0
Nov 15 02:46:42 user nova-compute[75391]: iface.max_burst_len = 0
Nov 15 02:46:42 user nova-compute[75391]: iface.chap_auth = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.bidi_chap = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.strict_login_compliance = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.discovery_auth = <empty>
Nov 15 02:46:42 user nova-compute[75391]: iface.discovery_logout = <empty>
Nov 15 02:46:42 user nova-compute[75391]: node.discovery_address = <empty>
Nov 15 02:46:42 user nova-compute[75391]: node.discovery_port = 0
Nov 15 02:46:42 user nova-compute[75391]: node.discovery_type = static
Nov 15 02:46:42 user nova-compute[75391]: node.session.initial_cmdsn = 0
Nov 15 02:46:42 user nova-compute[75391]: node.session.initial_login_retry_max = 8
Nov 15 02:46:42 user nova-compute[75391]: node.session.xmit_thread_priority = -20
Nov 15 02:46:42 user nova-compute[75391]: node.session.cmds_max = 128
Nov 15 02:46:42 user nova-compute[75391]: node.session.queue_depth = 32
Nov 15 02:46:42 user nova-compute[75391]: node.session.nr_sessions = 1
Nov 15 02:46:42 user nova-compute[75391]: node.session.auth.authmethod = CHAP
Nov 15 02:46:42 user nova-compute[75391]: node.session.auth.username = gjWowTAY
Nov 15 02:46:42 user nova-compute[75391]: node.session.auth.password = ***
Nov 15 02:46:42 user nova-compute[75391]: node.session.auth.username_in = <empty>
Nov 15 02:46:42 user nova-compute[75391]: node.session.auth.password_in = <empty>
Nov 15 02:46:42 user nova-compute[75391]: node.session.auth.chap_algs = MD5
Nov 15 02:46:42 user nova-compute[75391]: node.session.timeo.replacement_timeout = 120
Nov 15 02:46:42 user nova-compute[75391]: node.session.err_timeo.abort_timeout = 15
Nov 15 02:46:42 user nova-compute[75391]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 02:46:42 user nova-compute[75391]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 02:46:42 user nova-compute[75391]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 02:46:42 user nova-compute[75391]: node.session.iscsi.FastAbort = Yes
Nov 15 02:46:42 user nova-compute[75391]: node.session.iscsi.InitialR2T = No
Nov 15 02:46:42 user nova-compute[75391]: node.session.iscsi.ImmediateData = Yes
Nov 15 02:46:42 user nova-compute[75391]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 02:46:42 user nova-compute[75391]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 02:46:42 user nova-compute[75391]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 02:46:42 user nova-compute[75391]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 02:46:42 user nova-compute[75391]: node.session.iscsi.MaxConnections = 1
Nov 15 02:46:42 user nova-compute[75391]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 02:46:42 user nova-compute[75391]: node.session.iscsi.ERL = 0
Nov 15 02:46:42 user nova-compute[75391]: node.session.scan = manual
Nov 15 02:46:42 user nova-compute[75391]: node.session.reopen_max = 0
Nov 15 02:46:42 user nova-compute[75391]: node.conn[0].address = 172.16.0.220
Nov 15 02:46:42 user nova-compute[75391]: node.conn[0].port = 3260
Nov 15 02:46:42 user nova-compute[75391]: node.conn[0].startup = manual
Nov 15 02:46:42 user nova-compute[75391]: node.conn[0].tcp.window_size = 524288
Nov 15 02:46:42 user nova-compute[75391]: node.conn[0].tcp.type_of_service = 0
Nov 15 02:46:42 user nova-compute[75391]: node.conn[0].timeo.logout_timeout = 15
Nov 15 02:46:42 user nova-compute[75391]: node.conn[0].timeo.login_timeout = 15
Nov 15 02:46:42 user nova-compute[75391]: node.conn[0].timeo.auth_timeout = 45
Nov 15 02:46:42 user nova-compute[75391]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 02:46:42 user nova-compute[75391]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 02:46:42 user nova-compute[75391]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 02:46:42 user nova-compute[75391]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 02:46:42 user nova-compute[75391]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 02:46:42 user nova-compute[75391]: node.conn[0].iscsi.DataDigest = None
Nov 15 02:46:42 user nova-compute[75391]: node.conn[0].iscsi.IFMarker = No
Nov 15 02:46:42 user nova-compute[75391]: node.conn[0].iscsi.OFMarker = No
Nov 15 02:46:42 user nova-compute[75391]: # END RECORD
Nov 15 02:46:42 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[861dabfa-bace-4639-abf9-50cfcd2e2553]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec4f88a-b2bf-490f-b674-31c9acfe9ea8]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gjWowTAY {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gjWowTAY" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ea9ed9-12cc-4d18-97f0-75b2285ba912]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gjWowTAY'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[33469548-e23b-4a6f-a72a-e30c9e39a33d]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebe7728-1d43-4972-8413-daf4a532c45b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:46:42 user nova-compute[75391]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:46:42 user nova-compute[75391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:46:42 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:46:42 user nova-compute[75391]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:46:42 user nova-compute[75391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:46:42 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.161s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] HCTL ('37', '0', '0', 0) found on session 17 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7f19e0-bd02-4937-9ac3-cafa85b24901]: (4, ('0 0 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Searching for a device in session 17 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gjWowTAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.187s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] <== connect_volume: return (188ms) {'type': 'block', 'scsi_wwn': '23639303833396362', 'path': '/dev/sdf'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639303833396362', 'path': '/dev/sdf'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2096192783',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2096192783',id=13,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:45:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e63a88a9fe824c3e9c0807a50b569d54',ramdisk_id='',reservation_id='r-spxo8j0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-141063167',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:45:05Z,user_data=None,user_id='0aa106a59c374dde99b7697f94407339',uuid=6400a5f3-0ec9-4484-930c-1f5061ae5374,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "address": "fa:16:3e:84:8e:2f", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "vif_mac": "fa:16:3e:84:8e:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f803b5-4e", "ovs_interfaceid": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Converting VIF {"id": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "address": "fa:16:3e:84:8e:2f", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "vif_mac": "fa:16:3e:84:8e:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f803b5-4e", "ovs_interfaceid": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:8e:2f,bridge_name='br-int',has_traffic_filtering=True,id=95f803b5-4e7b-4463-aca1-39b54dbc7de9,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f803b5-4e') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.objects.instance [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lazy-loading 'pci_devices' on Instance uuid 6400a5f3-0ec9-4484-930c-1f5061ae5374 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.objects.base [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Object Instance<6400a5f3-0ec9-4484-930c-1f5061ae5374> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:46:42 user nova-compute[75391]:   <uuid>6400a5f3-0ec9-4484-930c-1f5061ae5374</uuid>
Nov 15 02:46:42 user nova-compute[75391]:   <name>instance-0000000d</name>
Nov 15 02:46:42 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:46:42 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:46:42 user nova-compute[75391]:   <metadata>
Nov 15 02:46:42 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:46:42 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:46:42 user nova-compute[75391]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2096192783</nova:name>
Nov 15 02:46:42 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:46:42</nova:creationTime>
Nov 15 02:46:42 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:46:42 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:46:42 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:46:42 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:46:42 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:46:42 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:46:42 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:46:42 user nova-compute[75391]:       <nova:owner>
Nov 15 02:46:42 user nova-compute[75391]:         <nova:user uuid="0aa106a59c374dde99b7697f94407339">tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member</nova:user>
Nov 15 02:46:42 user nova-compute[75391]:         <nova:project uuid="e63a88a9fe824c3e9c0807a50b569d54">tempest-ServerBootFromVolumeStableRescueTest-141063167</nova:project>
Nov 15 02:46:42 user nova-compute[75391]:       </nova:owner>
Nov 15 02:46:42 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:46:42 user nova-compute[75391]:       <nova:ports>
Nov 15 02:46:42 user nova-compute[75391]:         <nova:port uuid="95f803b5-4e7b-4463-aca1-39b54dbc7de9">
Nov 15 02:46:42 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 02:46:42 user nova-compute[75391]:         </nova:port>
Nov 15 02:46:42 user nova-compute[75391]:       </nova:ports>
Nov 15 02:46:42 user nova-compute[75391]:     </nova:instance>
Nov 15 02:46:42 user nova-compute[75391]:   </metadata>
Nov 15 02:46:42 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:46:42 user nova-compute[75391]:     <system>
Nov 15 02:46:42 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:46:42 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:46:42 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:46:42 user nova-compute[75391]:       <entry name="serial">6400a5f3-0ec9-4484-930c-1f5061ae5374</entry>
Nov 15 02:46:42 user nova-compute[75391]:       <entry name="uuid">6400a5f3-0ec9-4484-930c-1f5061ae5374</entry>
Nov 15 02:46:42 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:46:42 user nova-compute[75391]:     </system>
Nov 15 02:46:42 user nova-compute[75391]:   </sysinfo>
Nov 15 02:46:42 user nova-compute[75391]:   <os>
Nov 15 02:46:42 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:46:42 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:46:42 user nova-compute[75391]:   </os>
Nov 15 02:46:42 user nova-compute[75391]:   <features>
Nov 15 02:46:42 user nova-compute[75391]:     <acpi/>
Nov 15 02:46:42 user nova-compute[75391]:     <apic/>
Nov 15 02:46:42 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:46:42 user nova-compute[75391]:   </features>
Nov 15 02:46:42 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:46:42 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:46:42 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:46:42 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:46:42 user nova-compute[75391]:   </clock>
Nov 15 02:46:42 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:46:42 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:46:42 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:46:42 user nova-compute[75391]:   </cpu>
Nov 15 02:46:42 user nova-compute[75391]:   <devices>
Nov 15 02:46:42 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 02:46:42 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:46:42 user nova-compute[75391]:       <source dev="/dev/sdf"/>
Nov 15 02:46:42 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:46:42 user nova-compute[75391]:       <serial>af618bdf-b151-451b-a7a8-62f1a5270a1f</serial>
Nov 15 02:46:42 user nova-compute[75391]:     </disk>
Nov 15 02:46:42 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:46:42 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:46:42 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/6400a5f3-0ec9-4484-930c-1f5061ae5374/disk.rescue"/>
Nov 15 02:46:42 user nova-compute[75391]:       <target dev="vdb" bus="virtio"/>
Nov 15 02:46:42 user nova-compute[75391]:       <boot order="1"/>
Nov 15 02:46:42 user nova-compute[75391]:     </disk>
Nov 15 02:46:42 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:46:42 user nova-compute[75391]:       <mac address="fa:16:3e:84:8e:2f"/>
Nov 15 02:46:42 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:46:42 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:46:42 user nova-compute[75391]:       <target dev="tap95f803b5-4e"/>
Nov 15 02:46:42 user nova-compute[75391]:     </interface>
Nov 15 02:46:42 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:46:42 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/6400a5f3-0ec9-4484-930c-1f5061ae5374/console.log" append="off"/>
Nov 15 02:46:42 user nova-compute[75391]:     </serial>
Nov 15 02:46:42 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:46:42 user nova-compute[75391]:     <video>
Nov 15 02:46:42 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:46:42 user nova-compute[75391]:     </video>
Nov 15 02:46:42 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:46:42 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:46:42 user nova-compute[75391]:     </rng>
Nov 15 02:46:42 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:46:42 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:46:42 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:46:42 user nova-compute[75391]:     </memballoon>
Nov 15 02:46:42 user nova-compute[75391]:   </devices>
Nov 15 02:46:42 user nova-compute[75391]: </domain>
Nov 15 02:46:42 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:46:42 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Instance destroyed successfully.
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:46:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] No VIF found with MAC fa:16:3e:84:8e:2f, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:46:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-12858d83-cf76-4ee9-b331-f6b3f2e37866 req-8641ff3f-db53-4592-a2c7-96820965f7cf service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Received event network-vif-plugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:46:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-12858d83-cf76-4ee9-b331-f6b3f2e37866 req-8641ff3f-db53-4592-a2c7-96820965f7cf service nova] Acquiring lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:46:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-12858d83-cf76-4ee9-b331-f6b3f2e37866 req-8641ff3f-db53-4592-a2c7-96820965f7cf service nova] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:46:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-12858d83-cf76-4ee9-b331-f6b3f2e37866 req-8641ff3f-db53-4592-a2c7-96820965f7cf service nova] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:46:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-12858d83-cf76-4ee9-b331-f6b3f2e37866 req-8641ff3f-db53-4592-a2c7-96820965f7cf service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] No waiting events found dispatching network-vif-plugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:46:46 user nova-compute[75391]: WARNING nova.compute.manager [req-12858d83-cf76-4ee9-b331-f6b3f2e37866 req-8641ff3f-db53-4592-a2c7-96820965f7cf service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Received unexpected event network-vif-plugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 for instance with vm_state active and task_state rescuing.
Nov 15 02:46:46 user nova-compute[75391]: DEBUG nova.compute.manager [None req-33ab7178-58dd-4872-88ce-c3a08f344e0c tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:46:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:48 user nova-compute[75391]: DEBUG nova.compute.manager [req-eff7c14c-2d09-45b7-969b-83a56e038602 req-de45b485-12d9-45cc-bbd2-7454cd55c677 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Received event network-vif-plugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:46:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-eff7c14c-2d09-45b7-969b-83a56e038602 req-de45b485-12d9-45cc-bbd2-7454cd55c677 service nova] Acquiring lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:46:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-eff7c14c-2d09-45b7-969b-83a56e038602 req-de45b485-12d9-45cc-bbd2-7454cd55c677 service nova] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:46:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-eff7c14c-2d09-45b7-969b-83a56e038602 req-de45b485-12d9-45cc-bbd2-7454cd55c677 service nova] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:46:48 user nova-compute[75391]: DEBUG nova.compute.manager [req-eff7c14c-2d09-45b7-969b-83a56e038602 req-de45b485-12d9-45cc-bbd2-7454cd55c677 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] No waiting events found dispatching network-vif-plugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:46:48 user nova-compute[75391]: WARNING nova.compute.manager [req-eff7c14c-2d09-45b7-969b-83a56e038602 req-de45b485-12d9-45cc-bbd2-7454cd55c677 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Received unexpected event network-vif-plugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 for instance with vm_state rescued and task_state None.
Nov 15 02:46:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:50 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:50 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:55 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:46:55 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:46:55 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:46:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:55 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Didn't find any instances for network info cache update. {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 02:46:55 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:46:55 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:46:55 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:46:55 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:46:55 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:46:55 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:46:55 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:46:55 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:46:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:46:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:46:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:46:55 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:46:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:46:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:46:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6400a5f3-0ec9-4484-930c-1f5061ae5374/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6400a5f3-0ec9-4484-930c-1f5061ae5374/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6400a5f3-0ec9-4484-930c-1f5061ae5374/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ac591537-165d-45fa-b3ac-fc042644628d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Acquiring lock "6a3cee20-521e-4998-8744-f8bf83586176" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:46:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ac591537-165d-45fa-b3ac-fc042644628d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "6a3cee20-521e-4998-8744-f8bf83586176" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:46:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ac591537-165d-45fa-b3ac-fc042644628d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Acquiring lock "6a3cee20-521e-4998-8744-f8bf83586176-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:46:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ac591537-165d-45fa-b3ac-fc042644628d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "6a3cee20-521e-4998-8744-f8bf83586176-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:46:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ac591537-165d-45fa-b3ac-fc042644628d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "6a3cee20-521e-4998-8744-f8bf83586176-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:46:57 user nova-compute[75391]: INFO nova.compute.manager [None req-ac591537-165d-45fa-b3ac-fc042644628d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Terminating instance
Nov 15 02:46:57 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ac591537-165d-45fa-b3ac-fc042644628d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:46:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6400a5f3-0ec9-4484-930c-1f5061ae5374/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a3cee20-521e-4998-8744-f8bf83586176/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:58 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Instance destroyed successfully.
Nov 15 02:46:58 user nova-compute[75391]: DEBUG nova.objects.instance [None req-ac591537-165d-45fa-b3ac-fc042644628d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lazy-loading 'resources' on Instance uuid 6a3cee20-521e-4998-8744-f8bf83586176 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:46:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-ac591537-165d-45fa-b3ac-fc042644628d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:45:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1674493006',display_name='tempest-VolumesAdminNegativeTest-server-1674493006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1674493006',id=14,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:45:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9265d1e4bccb467fbf0c738844d8735b',ramdisk_id='',reservation_id='r-cl73ocy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1405215089',owner_user_name='tempest-VolumesAdminNegativeTest-1405215089-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:45:08Z,user_data=None,user_id='f67781b1c37f4b7dbabdfa16d7b891d0',uuid=6a3cee20-521e-4998-8744-f8bf83586176,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "162c733f-2235-48db-b812-5ad67decada5", "address": "fa:16:3e:05:cd:70", "network": {"id": "cb1a9e37-451d-43be-ab84-a0ebe7ab264b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500424491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9265d1e4bccb467fbf0c738844d8735b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162c733f-22", "ovs_interfaceid": "162c733f-2235-48db-b812-5ad67decada5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:46:58 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-ac591537-165d-45fa-b3ac-fc042644628d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Converting VIF {"id": "162c733f-2235-48db-b812-5ad67decada5", "address": "fa:16:3e:05:cd:70", "network": {"id": "cb1a9e37-451d-43be-ab84-a0ebe7ab264b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500424491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9265d1e4bccb467fbf0c738844d8735b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162c733f-22", "ovs_interfaceid": "162c733f-2235-48db-b812-5ad67decada5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:46:58 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-ac591537-165d-45fa-b3ac-fc042644628d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:cd:70,bridge_name='br-int',has_traffic_filtering=True,id=162c733f-2235-48db-b812-5ad67decada5,network=Network(cb1a9e37-451d-43be-ab84-a0ebe7ab264b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162c733f-22') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:46:58 user nova-compute[75391]: DEBUG os_vif [None req-ac591537-165d-45fa-b3ac-fc042644628d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:cd:70,bridge_name='br-int',has_traffic_filtering=True,id=162c733f-2235-48db-b812-5ad67decada5,network=Network(cb1a9e37-451d-43be-ab84-a0ebe7ab264b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162c733f-22') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:46:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap162c733f-22, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:46:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:46:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e7d9ee2-c70f-4daf-8e25-98140979a6b3) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:46:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:46:58 user nova-compute[75391]: INFO os_vif [None req-ac591537-165d-45fa-b3ac-fc042644628d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:cd:70,bridge_name='br-int',has_traffic_filtering=True,id=162c733f-2235-48db-b812-5ad67decada5,network=Network(cb1a9e37-451d-43be-ab84-a0ebe7ab264b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162c733f-22')
Nov 15 02:46:58 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-ac591537-165d-45fa-b3ac-fc042644628d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Deleting instance files /opt/stack/data/nova/instances/6a3cee20-521e-4998-8744-f8bf83586176_del
Nov 15 02:46:58 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-ac591537-165d-45fa-b3ac-fc042644628d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Deletion of /opt/stack/data/nova/instances/6a3cee20-521e-4998-8744-f8bf83586176_del complete
Nov 15 02:46:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a3cee20-521e-4998-8744-f8bf83586176/disk --force-share --output=json" returned: 1 in 0.199s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a3cee20-521e-4998-8744-f8bf83586176/disk --force-share --output=json' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:46:58 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000000e, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/6a3cee20-521e-4998-8744-f8bf83586176/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/6a3cee20-521e-4998-8744-f8bf83586176/disk
Nov 15 02:46:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c684afe-4c7a-41f1-89fe-8977ae1b5f61/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:58 user nova-compute[75391]: INFO nova.compute.manager [None req-ac591537-165d-45fa-b3ac-fc042644628d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 15 02:46:58 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-ac591537-165d-45fa-b3ac-fc042644628d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:46:58 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:46:58 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:46:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c684afe-4c7a-41f1-89fe-8977ae1b5f61/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c684afe-4c7a-41f1-89fe-8977ae1b5f61/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c684afe-4c7a-41f1-89fe-8977ae1b5f61/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:59 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:46:59 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Took 0.89 seconds to deallocate network for instance.
Nov 15 02:46:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:59 user nova-compute[75391]: DEBUG nova.compute.manager [req-5359da7c-db11-4de7-8dc5-9dd39fb8ff59 req-0c6ffd13-ccf8-4a0f-b687-3cbd7b89ec61 service nova] [instance: 6a3cee20-521e-4998-8744-f8bf83586176] Received event network-vif-deleted-162c733f-2235-48db-b812-5ad67decada5 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:46:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ac591537-165d-45fa-b3ac-fc042644628d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:46:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ac591537-165d-45fa-b3ac-fc042644628d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:46:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:46:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:46:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:00 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-ac591537-165d-45fa-b3ac-fc042644628d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:47:00 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-ac591537-165d-45fa-b3ac-fc042644628d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:47:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ac591537-165d-45fa-b3ac-fc042644628d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.659s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:00 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-ac591537-165d-45fa-b3ac-fc042644628d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Deleted allocations for instance 6a3cee20-521e-4998-8744-f8bf83586176
Nov 15 02:47:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ac591537-165d-45fa-b3ac-fc042644628d tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "6a3cee20-521e-4998-8744-f8bf83586176" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.983s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:47:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:01 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:47:01 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:47:01 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=7243MB free_disk=25.010162353515625GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:47:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:02 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Applying migration context for instance ebb7e616-3c05-4d99-a0b3-76dc1723e82d as it has an incoming, in-progress migration a73f9925-ea9d-478b-b203-b2a81800f8b9. Migration status is finished {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 02:47:02 user nova-compute[75391]: INFO nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Updating resource usage from migration a73f9925-ea9d-478b-b203-b2a81800f8b9
Nov 15 02:47:02 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9744c8a1-046e-4a00-92e0-92ebb3275ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:47:02 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance fc9484c0-9083-4797-8ab1-2ad392822ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:47:02 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:47:02 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 38a63a30-a3bc-4556-9fb6-53522dbf2c68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:47:02 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 25884e14-afa3-4e5d-8154-a9e9eb455b94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:47:02 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6400a5f3-0ec9-4484-930c-1f5061ae5374 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:47:02 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance a4171d96-bb26-473f-a322-178dadbaab0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:47:02 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:47:02 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Migration a73f9925-ea9d-478b-b203-b2a81800f8b9 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 02:47:02 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance ebb7e616-3c05-4d99-a0b3-76dc1723e82d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:47:02 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 5c684afe-4c7a-41f1-89fe-8977ae1b5f61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:47:02 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:47:02 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:47:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Acquiring lock "2b144078-2d2e-460c-b432-96d6309e338c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lock "2b144078-2d2e-460c-b432-96d6309e338c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:02 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:47:02 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:47:02 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:47:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:02 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:47:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.719s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.012s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-4dd0af96-b12c-4d1f-a2d3-36055d717cf9 req-07c5d91e-ec39-464b-8832-a8314d238ebf service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Received event network-changed-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-4dd0af96-b12c-4d1f-a2d3-36055d717cf9 req-07c5d91e-ec39-464b-8832-a8314d238ebf service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Refreshing instance network info cache due to event network-changed-6b8f74f5-6f5f-4946-afdb-80269c0d03b1. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:47:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4dd0af96-b12c-4d1f-a2d3-36055d717cf9 req-07c5d91e-ec39-464b-8832-a8314d238ebf service nova] Acquiring lock "refresh_cache-25884e14-afa3-4e5d-8154-a9e9eb455b94" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:47:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4dd0af96-b12c-4d1f-a2d3-36055d717cf9 req-07c5d91e-ec39-464b-8832-a8314d238ebf service nova] Acquired lock "refresh_cache-25884e14-afa3-4e5d-8154-a9e9eb455b94" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:47:02 user nova-compute[75391]: DEBUG nova.network.neutron [req-4dd0af96-b12c-4d1f-a2d3-36055d717cf9 req-07c5d91e-ec39-464b-8832-a8314d238ebf service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Refreshing network info cache for port 6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:47:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:47:02 user nova-compute[75391]: INFO nova.compute.claims [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Claim successful on node user
Nov 15 02:47:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:03 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:47:03 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:47:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.569s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:03 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:47:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:03 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:47:03 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:47:03 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:47:03 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:47:03 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:47:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:47:03 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Creating image(s)
Nov 15 02:47:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b144078-2d2e-460c-b432-96d6309e338c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lock "/opt/stack/data/nova/instances/2b144078-2d2e-460c-b432-96d6309e338c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lock "/opt/stack/data/nova/instances/2b144078-2d2e-460c-b432-96d6309e338c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:03 user nova-compute[75391]: DEBUG nova.policy [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e644a27f12f94d3ca787608cc36879fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4593a86a9104dadb43fce4e25e62b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:47:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "25884e14-afa3-4e5d-8154-a9e9eb455b94" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:03 user nova-compute[75391]: INFO nova.compute.manager [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Detaching volume ecf120b3-e9f4-444f-9a88-9284f626152b
Nov 15 02:47:03 user nova-compute[75391]: INFO nova.virt.block_device [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Attempting to driver detach volume ecf120b3-e9f4-444f-9a88-9284f626152b from mountpoint /dev/vdb
Nov 15 02:47:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Attempting to detach device vdb from instance 25884e14-afa3-4e5d-8154-a9e9eb455b94 from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:47:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:47:03 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:47:03 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 02:47:03 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:47:03 user nova-compute[75391]:   <serial>ecf120b3-e9f4-444f-9a88-9284f626152b</serial>
Nov 15 02:47:03 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 02:47:03 user nova-compute[75391]: </disk>
Nov 15 02:47:03 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:47:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.248s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:03 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Successfully detached device vdb from instance 25884e14-afa3-4e5d-8154-a9e9eb455b94 from the persistent domain config.
Nov 15 02:47:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 25884e14-afa3-4e5d-8154-a9e9eb455b94 from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 02:47:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:47:03 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:47:03 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 02:47:03 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:47:03 user nova-compute[75391]:   <serial>ecf120b3-e9f4-444f-9a88-9284f626152b</serial>
Nov 15 02:47:03 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 02:47:03 user nova-compute[75391]: </disk>
Nov 15 02:47:03 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:47:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.183s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/2b144078-2d2e-460c-b432-96d6309e338c/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/2b144078-2d2e-460c-b432-96d6309e338c/disk 1073741824" returned: 0 in 0.055s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:04 user nova-compute[75391]: DEBUG nova.network.neutron [req-4dd0af96-b12c-4d1f-a2d3-36055d717cf9 req-07c5d91e-ec39-464b-8832-a8314d238ebf service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Updated VIF entry in instance network info cache for port 6b8f74f5-6f5f-4946-afdb-80269c0d03b1. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:47:04 user nova-compute[75391]: DEBUG nova.network.neutron [req-4dd0af96-b12c-4d1f-a2d3-36055d717cf9 req-07c5d91e-ec39-464b-8832-a8314d238ebf service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Updating instance_info_cache with network_info: [{"id": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "address": "fa:16:3e:6b:28:6d", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b8f74f5-6f", "ovs_interfaceid": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:47:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4dd0af96-b12c-4d1f-a2d3-36055d717cf9 req-07c5d91e-ec39-464b-8832-a8314d238ebf service nova] Releasing lock "refresh_cache-25884e14-afa3-4e5d-8154-a9e9eb455b94" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:47:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.201s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:04 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2b144078-2d2e-460c-b432-96d6309e338c/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:47:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b144078-2d2e-460c-b432-96d6309e338c/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 25884e14-afa3-4e5d-8154-a9e9eb455b94 {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 02:47:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b144078-2d2e-460c-b432-96d6309e338c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:04 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Cannot resize image /opt/stack/data/nova/instances/2b144078-2d2e-460c-b432-96d6309e338c/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:47:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:47:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Ensure instance console log exists: /opt/stack/data/nova/instances/2b144078-2d2e-460c-b432-96d6309e338c/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:47:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:04 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Successfully created port: 5cf32d19-328e-4636-85cf-9055b9dc516b {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:47:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-27c0461a-d8d0-4b47-8769-4d2971130ccf req-f38bc962-6f6b-4d23-a31a-5f4e01c0fb79 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Received event network-changed-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-27c0461a-d8d0-4b47-8769-4d2971130ccf req-f38bc962-6f6b-4d23-a31a-5f4e01c0fb79 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Refreshing instance network info cache due to event network-changed-6b8f74f5-6f5f-4946-afdb-80269c0d03b1. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:47:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-27c0461a-d8d0-4b47-8769-4d2971130ccf req-f38bc962-6f6b-4d23-a31a-5f4e01c0fb79 service nova] Acquiring lock "refresh_cache-25884e14-afa3-4e5d-8154-a9e9eb455b94" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:47:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-27c0461a-d8d0-4b47-8769-4d2971130ccf req-f38bc962-6f6b-4d23-a31a-5f4e01c0fb79 service nova] Acquired lock "refresh_cache-25884e14-afa3-4e5d-8154-a9e9eb455b94" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:47:04 user nova-compute[75391]: DEBUG nova.network.neutron [req-27c0461a-d8d0-4b47-8769-4d2971130ccf req-f38bc962-6f6b-4d23-a31a-5f4e01c0fb79 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Refreshing network info cache for port 6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:47:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.network.neutron [req-27c0461a-d8d0-4b47-8769-4d2971130ccf req-f38bc962-6f6b-4d23-a31a-5f4e01c0fb79 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Updated VIF entry in instance network info cache for port 6b8f74f5-6f5f-4946-afdb-80269c0d03b1. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.network.neutron [req-27c0461a-d8d0-4b47-8769-4d2971130ccf req-f38bc962-6f6b-4d23-a31a-5f4e01c0fb79 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Updating instance_info_cache with network_info: [{"id": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "address": "fa:16:3e:6b:28:6d", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b8f74f5-6f", "ovs_interfaceid": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-27c0461a-d8d0-4b47-8769-4d2971130ccf req-f38bc962-6f6b-4d23-a31a-5f4e01c0fb79 service nova] Releasing lock "refresh_cache-25884e14-afa3-4e5d-8154-a9e9eb455b94" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Successfully updated port: 5cf32d19-328e-4636-85cf-9055b9dc516b {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Acquiring lock "refresh_cache-2b144078-2d2e-460c-b432-96d6309e338c" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Acquired lock "refresh_cache-2b144078-2d2e-460c-b432-96d6309e338c" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-ecba7e76-9a95-4420-be14-da1709288241 req-5e24cd2a-d7a8-4041-8b88-54811802860b service nova] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Received event network-changed-5cf32d19-328e-4636-85cf-9055b9dc516b {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-ecba7e76-9a95-4420-be14-da1709288241 req-5e24cd2a-d7a8-4041-8b88-54811802860b service nova] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Refreshing instance network info cache due to event network-changed-5cf32d19-328e-4636-85cf-9055b9dc516b. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ecba7e76-9a95-4420-be14-da1709288241 req-5e24cd2a-d7a8-4041-8b88-54811802860b service nova] Acquiring lock "refresh_cache-2b144078-2d2e-460c-b432-96d6309e338c" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Updating instance_info_cache with network_info: [{"id": "5cf32d19-328e-4636-85cf-9055b9dc516b", "address": "fa:16:3e:88:86:50", "network": {"id": "a072f3fa-a5c1-47ad-9521-79920d593ad0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-16679141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4593a86a9104dadb43fce4e25e62b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cf32d19-32", "ovs_interfaceid": "5cf32d19-328e-4636-85cf-9055b9dc516b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Releasing lock "refresh_cache-2b144078-2d2e-460c-b432-96d6309e338c" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Instance network_info: |[{"id": "5cf32d19-328e-4636-85cf-9055b9dc516b", "address": "fa:16:3e:88:86:50", "network": {"id": "a072f3fa-a5c1-47ad-9521-79920d593ad0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-16679141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4593a86a9104dadb43fce4e25e62b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cf32d19-32", "ovs_interfaceid": "5cf32d19-328e-4636-85cf-9055b9dc516b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ecba7e76-9a95-4420-be14-da1709288241 req-5e24cd2a-d7a8-4041-8b88-54811802860b service nova] Acquired lock "refresh_cache-2b144078-2d2e-460c-b432-96d6309e338c" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.network.neutron [req-ecba7e76-9a95-4420-be14-da1709288241 req-5e24cd2a-d7a8-4041-8b88-54811802860b service nova] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Refreshing network info cache for port 5cf32d19-328e-4636-85cf-9055b9dc516b {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Start _get_guest_xml network_info=[{"id": "5cf32d19-328e-4636-85cf-9055b9dc516b", "address": "fa:16:3e:88:86:50", "network": {"id": "a072f3fa-a5c1-47ad-9521-79920d593ad0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-16679141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4593a86a9104dadb43fce4e25e62b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cf32d19-32", "ovs_interfaceid": "5cf32d19-328e-4636-85cf-9055b9dc516b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:47:05 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:47:05 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:47:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1013641174',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1013641174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1013641',id=18,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCr431YR+5GJ9r3bNLlb2nrg33RWscWRe6juPvDOhvAgXWVyufyC+bvwi4TtZyeXs/ifvf5Nvc1Fg/ePWoC7tGy2Az2jBm9Q2OvRzeJJyy9HhGz7bHqdETPi58UX7AnHYQ==',key_name='tempest-keypair-1683423078',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4593a86a9104dadb43fce4e25e62b5a',ramdisk_id='',reservation_id='r-00lmkhsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-979449537',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e644a27f12f94d3ca787608cc36879fe',uuid=2b144078-2d2e-460c-b432-96d6309e338c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cf32d19-328e-4636-85cf-9055b9dc516b", "address": "fa:16:3e:88:86:50", "network": {"id": "a072f3fa-a5c1-47ad-9521-79920d593ad0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-16679141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4593a86a9104dadb43fce4e25e62b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cf32d19-32", "ovs_interfaceid": "5cf32d19-328e-4636-85cf-9055b9dc516b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Converting VIF {"id": "5cf32d19-328e-4636-85cf-9055b9dc516b", "address": "fa:16:3e:88:86:50", "network": {"id": "a072f3fa-a5c1-47ad-9521-79920d593ad0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-16679141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4593a86a9104dadb43fce4e25e62b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cf32d19-32", "ovs_interfaceid": "5cf32d19-328e-4636-85cf-9055b9dc516b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:86:50,bridge_name='br-int',has_traffic_filtering=True,id=5cf32d19-328e-4636-85cf-9055b9dc516b,network=Network(a072f3fa-a5c1-47ad-9521-79920d593ad0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cf32d19-32') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.objects.instance [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b144078-2d2e-460c-b432-96d6309e338c {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:47:05 user nova-compute[75391]:   <uuid>2b144078-2d2e-460c-b432-96d6309e338c</uuid>
Nov 15 02:47:05 user nova-compute[75391]:   <name>instance-00000012</name>
Nov 15 02:47:05 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:47:05 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:47:05 user nova-compute[75391]:   <metadata>
Nov 15 02:47:05 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:47:05 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:47:05 user nova-compute[75391]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1013641174</nova:name>
Nov 15 02:47:05 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:47:05</nova:creationTime>
Nov 15 02:47:05 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:47:05 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:47:05 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:47:05 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:47:05 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:47:05 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:47:05 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:47:05 user nova-compute[75391]:       <nova:owner>
Nov 15 02:47:05 user nova-compute[75391]:         <nova:user uuid="e644a27f12f94d3ca787608cc36879fe">tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member</nova:user>
Nov 15 02:47:05 user nova-compute[75391]:         <nova:project uuid="b4593a86a9104dadb43fce4e25e62b5a">tempest-TestServerVolumeAttachScenarioOldVersion-979449537</nova:project>
Nov 15 02:47:05 user nova-compute[75391]:       </nova:owner>
Nov 15 02:47:05 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:47:05 user nova-compute[75391]:       <nova:ports>
Nov 15 02:47:05 user nova-compute[75391]:         <nova:port uuid="5cf32d19-328e-4636-85cf-9055b9dc516b">
Nov 15 02:47:05 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 02:47:05 user nova-compute[75391]:         </nova:port>
Nov 15 02:47:05 user nova-compute[75391]:       </nova:ports>
Nov 15 02:47:05 user nova-compute[75391]:     </nova:instance>
Nov 15 02:47:05 user nova-compute[75391]:   </metadata>
Nov 15 02:47:05 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:47:05 user nova-compute[75391]:     <system>
Nov 15 02:47:05 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:47:05 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:47:05 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:47:05 user nova-compute[75391]:       <entry name="serial">2b144078-2d2e-460c-b432-96d6309e338c</entry>
Nov 15 02:47:05 user nova-compute[75391]:       <entry name="uuid">2b144078-2d2e-460c-b432-96d6309e338c</entry>
Nov 15 02:47:05 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:47:05 user nova-compute[75391]:     </system>
Nov 15 02:47:05 user nova-compute[75391]:   </sysinfo>
Nov 15 02:47:05 user nova-compute[75391]:   <os>
Nov 15 02:47:05 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:47:05 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:47:05 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:47:05 user nova-compute[75391]:   </os>
Nov 15 02:47:05 user nova-compute[75391]:   <features>
Nov 15 02:47:05 user nova-compute[75391]:     <acpi/>
Nov 15 02:47:05 user nova-compute[75391]:     <apic/>
Nov 15 02:47:05 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:47:05 user nova-compute[75391]:   </features>
Nov 15 02:47:05 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:47:05 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:47:05 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:47:05 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:47:05 user nova-compute[75391]:   </clock>
Nov 15 02:47:05 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:47:05 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:47:05 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:47:05 user nova-compute[75391]:   </cpu>
Nov 15 02:47:05 user nova-compute[75391]:   <devices>
Nov 15 02:47:05 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:47:05 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:47:05 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/2b144078-2d2e-460c-b432-96d6309e338c/disk"/>
Nov 15 02:47:05 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:47:05 user nova-compute[75391]:     </disk>
Nov 15 02:47:05 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:47:05 user nova-compute[75391]:       <mac address="fa:16:3e:88:86:50"/>
Nov 15 02:47:05 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:47:05 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:47:05 user nova-compute[75391]:       <target dev="tap5cf32d19-32"/>
Nov 15 02:47:05 user nova-compute[75391]:     </interface>
Nov 15 02:47:05 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:47:05 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/2b144078-2d2e-460c-b432-96d6309e338c/console.log" append="off"/>
Nov 15 02:47:05 user nova-compute[75391]:     </serial>
Nov 15 02:47:05 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:47:05 user nova-compute[75391]:     <video>
Nov 15 02:47:05 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:47:05 user nova-compute[75391]:     </video>
Nov 15 02:47:05 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:47:05 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:47:05 user nova-compute[75391]:     </rng>
Nov 15 02:47:05 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:47:05 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:47:05 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:47:05 user nova-compute[75391]:     </memballoon>
Nov 15 02:47:05 user nova-compute[75391]:   </devices>
Nov 15 02:47:05 user nova-compute[75391]: </domain>
Nov 15 02:47:05 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:47:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1013641174',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1013641174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1013641',id=18,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCr431YR+5GJ9r3bNLlb2nrg33RWscWRe6juPvDOhvAgXWVyufyC+bvwi4TtZyeXs/ifvf5Nvc1Fg/ePWoC7tGy2Az2jBm9Q2OvRzeJJyy9HhGz7bHqdETPi58UX7AnHYQ==',key_name='tempest-keypair-1683423078',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4593a86a9104dadb43fce4e25e62b5a',ramdisk_id='',reservation_id='r-00lmkhsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-979449537',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e644a27f12f94d3ca787608cc36879fe',uuid=2b144078-2d2e-460c-b432-96d6309e338c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cf32d19-328e-4636-85cf-9055b9dc516b", "address": "fa:16:3e:88:86:50", "network": {"id": "a072f3fa-a5c1-47ad-9521-79920d593ad0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-16679141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4593a86a9104dadb43fce4e25e62b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cf32d19-32", "ovs_interfaceid": "5cf32d19-328e-4636-85cf-9055b9dc516b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Converting VIF {"id": "5cf32d19-328e-4636-85cf-9055b9dc516b", "address": "fa:16:3e:88:86:50", "network": {"id": "a072f3fa-a5c1-47ad-9521-79920d593ad0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-16679141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4593a86a9104dadb43fce4e25e62b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cf32d19-32", "ovs_interfaceid": "5cf32d19-328e-4636-85cf-9055b9dc516b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:86:50,bridge_name='br-int',has_traffic_filtering=True,id=5cf32d19-328e-4636-85cf-9055b9dc516b,network=Network(a072f3fa-a5c1-47ad-9521-79920d593ad0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cf32d19-32') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG os_vif [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:86:50,bridge_name='br-int',has_traffic_filtering=True,id=5cf32d19-328e-4636-85cf-9055b9dc516b,network=Network(a072f3fa-a5c1-47ad-9521-79920d593ad0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cf32d19-32') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c2e8954e-d0ec-55e8-a097-67f49785314d', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5cf32d19-32, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5cf32d19-32, col_values=(('qos', UUID('8a39f313-4c96-4d11-9fda-be9a1fbadee1')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5cf32d19-32, col_values=(('external_ids', {'iface-id': '5cf32d19-328e-4636-85cf-9055b9dc516b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:86:50', 'vm-uuid': '2b144078-2d2e-460c-b432-96d6309e338c'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:47:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:05 user nova-compute[75391]: INFO os_vif [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:86:50,bridge_name='br-int',has_traffic_filtering=True,id=5cf32d19-328e-4636-85cf-9055b9dc516b,network=Network(a072f3fa-a5c1-47ad-9521-79920d593ad0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cf32d19-32')
Nov 15 02:47:06 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:47:06 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] No VIF found with MAC fa:16:3e:88:86:50, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:47:06 user nova-compute[75391]: DEBUG nova.network.neutron [req-ecba7e76-9a95-4420-be14-da1709288241 req-5e24cd2a-d7a8-4041-8b88-54811802860b service nova] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Updated VIF entry in instance network info cache for port 5cf32d19-328e-4636-85cf-9055b9dc516b. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:47:06 user nova-compute[75391]: DEBUG nova.network.neutron [req-ecba7e76-9a95-4420-be14-da1709288241 req-5e24cd2a-d7a8-4041-8b88-54811802860b service nova] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Updating instance_info_cache with network_info: [{"id": "5cf32d19-328e-4636-85cf-9055b9dc516b", "address": "fa:16:3e:88:86:50", "network": {"id": "a072f3fa-a5c1-47ad-9521-79920d593ad0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-16679141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4593a86a9104dadb43fce4e25e62b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cf32d19-32", "ovs_interfaceid": "5cf32d19-328e-4636-85cf-9055b9dc516b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:47:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ecba7e76-9a95-4420-be14-da1709288241 req-5e24cd2a-d7a8-4041-8b88-54811802860b service nova] Releasing lock "refresh_cache-2b144078-2d2e-460c-b432-96d6309e338c" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:47:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:08 user nova-compute[75391]: DEBUG nova.compute.manager [req-242beb9e-dcff-4b88-ab44-9deb061c5fa0 req-7924b4a0-f471-4fde-9b7c-cc79abaa4cfc service nova] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Received event network-vif-plugged-5cf32d19-328e-4636-85cf-9055b9dc516b {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-242beb9e-dcff-4b88-ab44-9deb061c5fa0 req-7924b4a0-f471-4fde-9b7c-cc79abaa4cfc service nova] Acquiring lock "2b144078-2d2e-460c-b432-96d6309e338c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-242beb9e-dcff-4b88-ab44-9deb061c5fa0 req-7924b4a0-f471-4fde-9b7c-cc79abaa4cfc service nova] Lock "2b144078-2d2e-460c-b432-96d6309e338c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-242beb9e-dcff-4b88-ab44-9deb061c5fa0 req-7924b4a0-f471-4fde-9b7c-cc79abaa4cfc service nova] Lock "2b144078-2d2e-460c-b432-96d6309e338c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:08 user nova-compute[75391]: DEBUG nova.compute.manager [req-242beb9e-dcff-4b88-ab44-9deb061c5fa0 req-7924b4a0-f471-4fde-9b7c-cc79abaa4cfc service nova] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] No waiting events found dispatching network-vif-plugged-5cf32d19-328e-4636-85cf-9055b9dc516b {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:08 user nova-compute[75391]: WARNING nova.compute.manager [req-242beb9e-dcff-4b88-ab44-9deb061c5fa0 req-7924b4a0-f471-4fde-9b7c-cc79abaa4cfc service nova] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Received unexpected event network-vif-plugged-5cf32d19-328e-4636-85cf-9055b9dc516b for instance with vm_state building and task_state spawning.
Nov 15 02:47:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:10 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:47:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:47:10 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Instance spawned successfully.
Nov 15 02:47:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:47:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:47:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:47:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:47:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:47:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:47:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:47:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:10 user nova-compute[75391]: DEBUG nova.compute.manager [req-0c47668f-9770-4a1f-8ead-13a525350db8 req-693737e5-8a81-4899-a6a7-4cec0ffcc696 service nova] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Received event network-vif-plugged-5cf32d19-328e-4636-85cf-9055b9dc516b {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0c47668f-9770-4a1f-8ead-13a525350db8 req-693737e5-8a81-4899-a6a7-4cec0ffcc696 service nova] Acquiring lock "2b144078-2d2e-460c-b432-96d6309e338c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0c47668f-9770-4a1f-8ead-13a525350db8 req-693737e5-8a81-4899-a6a7-4cec0ffcc696 service nova] Lock "2b144078-2d2e-460c-b432-96d6309e338c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0c47668f-9770-4a1f-8ead-13a525350db8 req-693737e5-8a81-4899-a6a7-4cec0ffcc696 service nova] Lock "2b144078-2d2e-460c-b432-96d6309e338c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:10 user nova-compute[75391]: DEBUG nova.compute.manager [req-0c47668f-9770-4a1f-8ead-13a525350db8 req-693737e5-8a81-4899-a6a7-4cec0ffcc696 service nova] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] No waiting events found dispatching network-vif-plugged-5cf32d19-328e-4636-85cf-9055b9dc516b {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:10 user nova-compute[75391]: WARNING nova.compute.manager [req-0c47668f-9770-4a1f-8ead-13a525350db8 req-693737e5-8a81-4899-a6a7-4cec0ffcc696 service nova] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Received unexpected event network-vif-plugged-5cf32d19-328e-4636-85cf-9055b9dc516b for instance with vm_state building and task_state spawning.
Nov 15 02:47:10 user nova-compute[75391]: INFO nova.compute.manager [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Took 6.69 seconds to spawn the instance on the hypervisor.
Nov 15 02:47:10 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:47:10 user nova-compute[75391]: INFO nova.compute.manager [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Took 7.73 seconds to build instance.
Nov 15 02:47:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f5c40a07-f67c-4359-8e54-9831cccc3ed5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lock "2b144078-2d2e-460c-b432-96d6309e338c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.837s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Acquiring lock "5c1c9a3d-04de-4786-a263-dcf19a07e4bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "5c1c9a3d-04de-4786-a263-dcf19a07e4bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:15 user nova-compute[75391]: DEBUG nova.compute.manager [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:47:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:15 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:47:15 user nova-compute[75391]: INFO nova.compute.claims [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Claim successful on node user
Nov 15 02:47:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:15 user nova-compute[75391]: DEBUG nova.compute.manager [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:47:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:15 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:47:15 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:47:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.595s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:16 user nova-compute[75391]: DEBUG nova.compute.manager [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:47:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.079s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:16 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:47:16 user nova-compute[75391]: INFO nova.compute.claims [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Claim successful on node user
Nov 15 02:47:16 user nova-compute[75391]: DEBUG nova.compute.manager [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:47:16 user nova-compute[75391]: DEBUG nova.network.neutron [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:47:16 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:47:16 user nova-compute[75391]: DEBUG nova.compute.manager [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:47:16 user nova-compute[75391]: DEBUG nova.policy [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6725c61101204b09be4fd561231c4123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238e9fdacbfe47c7bdd8c638872c6ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:47:16 user nova-compute[75391]: DEBUG nova.compute.manager [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:47:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:47:16 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Creating image(s)
Nov 15 02:47:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c1c9a3d-04de-4786-a263-dcf19a07e4bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "/opt/stack/data/nova/instances/5c1c9a3d-04de-4786-a263-dcf19a07e4bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "/opt/stack/data/nova/instances/5c1c9a3d-04de-4786-a263-dcf19a07e4bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.185s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.484s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/5c1c9a3d-04de-4786-a263-dcf19a07e4bc/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/5c1c9a3d-04de-4786-a263-dcf19a07e4bc/disk 1073741824" returned: 0 in 0.057s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.549s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.161s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG nova.compute.manager [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.199s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c1c9a3d-04de-4786-a263-dcf19a07e4bc/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c1c9a3d-04de-4786-a263-dcf19a07e4bc/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG nova.network.neutron [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Successfully created port: ba20e243-e5f1-4bbe-bac2-6163b07e850f {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG nova.compute.manager [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG nova.network.neutron [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:47:17 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:47:17 user nova-compute[75391]: DEBUG nova.compute.manager [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:47:17 user nova-compute[75391]: INFO nova.virt.block_device [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Booting with volume 1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 at /dev/vda
Nov 15 02:47:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c1c9a3d-04de-4786-a263-dcf19a07e4bc/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Cannot resize image /opt/stack/data/nova/instances/5c1c9a3d-04de-4786-a263-dcf19a07e4bc/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Ensure instance console log exists: /opt/stack/data/nova/instances/5c1c9a3d-04de-4786-a263-dcf19a07e4bc/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG os_brick.utils [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e742ef-79f7-468c-9766-95cf304fe234]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a605d8e-6db1-401c-bd4d-4152e8c9d3ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[54386ec7-6235-4162-bd12-e64f6ac634de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e877cede-9338-4093-9a21-7d7bcef36ab7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:47:17 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:47:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[45253cfb-a3c6-4564-bd87-ee035db17ed8]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG nova.policy [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4380b18a109e458f9b08a5154dfd5d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ba612613604fa38f1bb4ec29602cac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG os_brick.utils [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:47:17 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Updating existing volume attachment record: 174c204d-1837-4042-812b-72bb5809c1df {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:47:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:18 user nova-compute[75391]: DEBUG nova.network.neutron [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Successfully updated port: ba20e243-e5f1-4bbe-bac2-6163b07e850f {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:47:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Acquiring lock "refresh_cache-5c1c9a3d-04de-4786-a263-dcf19a07e4bc" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:47:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Acquired lock "refresh_cache-5c1c9a3d-04de-4786-a263-dcf19a07e4bc" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:47:18 user nova-compute[75391]: DEBUG nova.network.neutron [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:47:18 user nova-compute[75391]: DEBUG nova.network.neutron [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Successfully created port: 59301df7-815a-4047-b6e2-190a0e80b4d4 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:47:18 user nova-compute[75391]: DEBUG nova.compute.manager [req-5974e44a-c677-41b0-b232-42fa5f16f797 req-3f3859ea-8ab9-41c6-9eec-a0f69c94cf6d service nova] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Received event network-changed-ba20e243-e5f1-4bbe-bac2-6163b07e850f {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:18 user nova-compute[75391]: DEBUG nova.compute.manager [req-5974e44a-c677-41b0-b232-42fa5f16f797 req-3f3859ea-8ab9-41c6-9eec-a0f69c94cf6d service nova] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Refreshing instance network info cache due to event network-changed-ba20e243-e5f1-4bbe-bac2-6163b07e850f. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:47:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5974e44a-c677-41b0-b232-42fa5f16f797 req-3f3859ea-8ab9-41c6-9eec-a0f69c94cf6d service nova] Acquiring lock "refresh_cache-5c1c9a3d-04de-4786-a263-dcf19a07e4bc" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:47:18 user nova-compute[75391]: DEBUG nova.network.neutron [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.network.neutron [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Updating instance_info_cache with network_info: [{"id": "ba20e243-e5f1-4bbe-bac2-6163b07e850f", "address": "fa:16:3e:d8:43:3b", "network": {"id": "fe3b43e0-6135-45f0-97ec-8b2af5fa26fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1391931283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "238e9fdacbfe47c7bdd8c638872c6ca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba20e243-e5", "ovs_interfaceid": "ba20e243-e5f1-4bbe-bac2-6163b07e850f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Releasing lock "refresh_cache-5c1c9a3d-04de-4786-a263-dcf19a07e4bc" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.compute.manager [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Instance network_info: |[{"id": "ba20e243-e5f1-4bbe-bac2-6163b07e850f", "address": "fa:16:3e:d8:43:3b", "network": {"id": "fe3b43e0-6135-45f0-97ec-8b2af5fa26fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1391931283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "238e9fdacbfe47c7bdd8c638872c6ca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba20e243-e5", "ovs_interfaceid": "ba20e243-e5f1-4bbe-bac2-6163b07e850f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5974e44a-c677-41b0-b232-42fa5f16f797 req-3f3859ea-8ab9-41c6-9eec-a0f69c94cf6d service nova] Acquired lock "refresh_cache-5c1c9a3d-04de-4786-a263-dcf19a07e4bc" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.network.neutron [req-5974e44a-c677-41b0-b232-42fa5f16f797 req-3f3859ea-8ab9-41c6-9eec-a0f69c94cf6d service nova] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Refreshing network info cache for port ba20e243-e5f1-4bbe-bac2-6163b07e850f {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Start _get_guest_xml network_info=[{"id": "ba20e243-e5f1-4bbe-bac2-6163b07e850f", "address": "fa:16:3e:d8:43:3b", "network": {"id": "fe3b43e0-6135-45f0-97ec-8b2af5fa26fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1391931283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "238e9fdacbfe47c7bdd8c638872c6ca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba20e243-e5", "ovs_interfaceid": "ba20e243-e5f1-4bbe-bac2-6163b07e850f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:47:19 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:47:19 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1720822387',display_name='tempest-VolumesActionsTest-instance-1720822387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1720822387',id=19,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='238e9fdacbfe47c7bdd8c638872c6ca2',ramdisk_id='',reservation_id='r-9f0ndmdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-712553389',owner_user_name='tempest-VolumesActionsTest-712553389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:47:16Z,user_data=None,user_id='6725c61101204b09be4fd561231c4123',uuid=5c1c9a3d-04de-4786-a263-dcf19a07e4bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba20e243-e5f1-4bbe-bac2-6163b07e850f", "address": "fa:16:3e:d8:43:3b", "network": {"id": "fe3b43e0-6135-45f0-97ec-8b2af5fa26fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1391931283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "238e9fdacbfe47c7bdd8c638872c6ca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba20e243-e5", "ovs_interfaceid": "ba20e243-e5f1-4bbe-bac2-6163b07e850f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Converting VIF {"id": "ba20e243-e5f1-4bbe-bac2-6163b07e850f", "address": "fa:16:3e:d8:43:3b", "network": {"id": "fe3b43e0-6135-45f0-97ec-8b2af5fa26fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1391931283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "238e9fdacbfe47c7bdd8c638872c6ca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba20e243-e5", "ovs_interfaceid": "ba20e243-e5f1-4bbe-bac2-6163b07e850f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:43:3b,bridge_name='br-int',has_traffic_filtering=True,id=ba20e243-e5f1-4bbe-bac2-6163b07e850f,network=Network(fe3b43e0-6135-45f0-97ec-8b2af5fa26fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba20e243-e5') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.objects.instance [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c1c9a3d-04de-4786-a263-dcf19a07e4bc {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:47:19 user nova-compute[75391]:   <uuid>5c1c9a3d-04de-4786-a263-dcf19a07e4bc</uuid>
Nov 15 02:47:19 user nova-compute[75391]:   <name>instance-00000013</name>
Nov 15 02:47:19 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:47:19 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:47:19 user nova-compute[75391]:   <metadata>
Nov 15 02:47:19 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:47:19 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:47:19 user nova-compute[75391]:       <nova:name>tempest-VolumesActionsTest-instance-1720822387</nova:name>
Nov 15 02:47:19 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:47:19</nova:creationTime>
Nov 15 02:47:19 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:47:19 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:47:19 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:47:19 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:47:19 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:47:19 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:47:19 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:47:19 user nova-compute[75391]:       <nova:owner>
Nov 15 02:47:19 user nova-compute[75391]:         <nova:user uuid="6725c61101204b09be4fd561231c4123">tempest-VolumesActionsTest-712553389-project-member</nova:user>
Nov 15 02:47:19 user nova-compute[75391]:         <nova:project uuid="238e9fdacbfe47c7bdd8c638872c6ca2">tempest-VolumesActionsTest-712553389</nova:project>
Nov 15 02:47:19 user nova-compute[75391]:       </nova:owner>
Nov 15 02:47:19 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:47:19 user nova-compute[75391]:       <nova:ports>
Nov 15 02:47:19 user nova-compute[75391]:         <nova:port uuid="ba20e243-e5f1-4bbe-bac2-6163b07e850f">
Nov 15 02:47:19 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 02:47:19 user nova-compute[75391]:         </nova:port>
Nov 15 02:47:19 user nova-compute[75391]:       </nova:ports>
Nov 15 02:47:19 user nova-compute[75391]:     </nova:instance>
Nov 15 02:47:19 user nova-compute[75391]:   </metadata>
Nov 15 02:47:19 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:47:19 user nova-compute[75391]:     <system>
Nov 15 02:47:19 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:47:19 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:47:19 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:47:19 user nova-compute[75391]:       <entry name="serial">5c1c9a3d-04de-4786-a263-dcf19a07e4bc</entry>
Nov 15 02:47:19 user nova-compute[75391]:       <entry name="uuid">5c1c9a3d-04de-4786-a263-dcf19a07e4bc</entry>
Nov 15 02:47:19 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:47:19 user nova-compute[75391]:     </system>
Nov 15 02:47:19 user nova-compute[75391]:   </sysinfo>
Nov 15 02:47:19 user nova-compute[75391]:   <os>
Nov 15 02:47:19 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:47:19 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:47:19 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:47:19 user nova-compute[75391]:   </os>
Nov 15 02:47:19 user nova-compute[75391]:   <features>
Nov 15 02:47:19 user nova-compute[75391]:     <acpi/>
Nov 15 02:47:19 user nova-compute[75391]:     <apic/>
Nov 15 02:47:19 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:47:19 user nova-compute[75391]:   </features>
Nov 15 02:47:19 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:47:19 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:47:19 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:47:19 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:47:19 user nova-compute[75391]:   </clock>
Nov 15 02:47:19 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:47:19 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:47:19 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:47:19 user nova-compute[75391]:   </cpu>
Nov 15 02:47:19 user nova-compute[75391]:   <devices>
Nov 15 02:47:19 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:47:19 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:47:19 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/5c1c9a3d-04de-4786-a263-dcf19a07e4bc/disk"/>
Nov 15 02:47:19 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:47:19 user nova-compute[75391]:     </disk>
Nov 15 02:47:19 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:47:19 user nova-compute[75391]:       <mac address="fa:16:3e:d8:43:3b"/>
Nov 15 02:47:19 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:47:19 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:47:19 user nova-compute[75391]:       <target dev="tapba20e243-e5"/>
Nov 15 02:47:19 user nova-compute[75391]:     </interface>
Nov 15 02:47:19 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:47:19 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/5c1c9a3d-04de-4786-a263-dcf19a07e4bc/console.log" append="off"/>
Nov 15 02:47:19 user nova-compute[75391]:     </serial>
Nov 15 02:47:19 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:47:19 user nova-compute[75391]:     <video>
Nov 15 02:47:19 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:47:19 user nova-compute[75391]:     </video>
Nov 15 02:47:19 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:47:19 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:47:19 user nova-compute[75391]:     </rng>
Nov 15 02:47:19 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:47:19 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:47:19 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:47:19 user nova-compute[75391]:     </memballoon>
Nov 15 02:47:19 user nova-compute[75391]:   </devices>
Nov 15 02:47:19 user nova-compute[75391]: </domain>
Nov 15 02:47:19 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1720822387',display_name='tempest-VolumesActionsTest-instance-1720822387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1720822387',id=19,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='238e9fdacbfe47c7bdd8c638872c6ca2',ramdisk_id='',reservation_id='r-9f0ndmdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-712553389',owner_user_name='tempest-VolumesActionsTest-712553389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:47:16Z,user_data=None,user_id='6725c61101204b09be4fd561231c4123',uuid=5c1c9a3d-04de-4786-a263-dcf19a07e4bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba20e243-e5f1-4bbe-bac2-6163b07e850f", "address": "fa:16:3e:d8:43:3b", "network": {"id": "fe3b43e0-6135-45f0-97ec-8b2af5fa26fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1391931283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "238e9fdacbfe47c7bdd8c638872c6ca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba20e243-e5", "ovs_interfaceid": "ba20e243-e5f1-4bbe-bac2-6163b07e850f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Converting VIF {"id": "ba20e243-e5f1-4bbe-bac2-6163b07e850f", "address": "fa:16:3e:d8:43:3b", "network": {"id": "fe3b43e0-6135-45f0-97ec-8b2af5fa26fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1391931283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "238e9fdacbfe47c7bdd8c638872c6ca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba20e243-e5", "ovs_interfaceid": "ba20e243-e5f1-4bbe-bac2-6163b07e850f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:43:3b,bridge_name='br-int',has_traffic_filtering=True,id=ba20e243-e5f1-4bbe-bac2-6163b07e850f,network=Network(fe3b43e0-6135-45f0-97ec-8b2af5fa26fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba20e243-e5') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG os_vif [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:43:3b,bridge_name='br-int',has_traffic_filtering=True,id=ba20e243-e5f1-4bbe-bac2-6163b07e850f,network=Network(fe3b43e0-6135-45f0-97ec-8b2af5fa26fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba20e243-e5') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d9ca451-7795-5058-8de6-e7aae91f27bc', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba20e243-e5, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba20e243-e5, col_values=(('qos', UUID('4e0f94e4-1b2e-407a-9479-138441d0db4d')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba20e243-e5, col_values=(('external_ids', {'iface-id': 'ba20e243-e5f1-4bbe-bac2-6163b07e850f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:43:3b', 'vm-uuid': '5c1c9a3d-04de-4786-a263-dcf19a07e4bc'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:19 user nova-compute[75391]: INFO os_vif [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:43:3b,bridge_name='br-int',has_traffic_filtering=True,id=ba20e243-e5f1-4bbe-bac2-6163b07e850f,network=Network(fe3b43e0-6135-45f0-97ec-8b2af5fa26fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba20e243-e5')
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] No VIF found with MAC fa:16:3e:d8:43:3b, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.network.neutron [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Successfully created port: b870665b-9254-4608-bd91-7aa46ed614d8 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.network.neutron [req-5974e44a-c677-41b0-b232-42fa5f16f797 req-3f3859ea-8ab9-41c6-9eec-a0f69c94cf6d service nova] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Updated VIF entry in instance network info cache for port ba20e243-e5f1-4bbe-bac2-6163b07e850f. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG nova.network.neutron [req-5974e44a-c677-41b0-b232-42fa5f16f797 req-3f3859ea-8ab9-41c6-9eec-a0f69c94cf6d service nova] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Updating instance_info_cache with network_info: [{"id": "ba20e243-e5f1-4bbe-bac2-6163b07e850f", "address": "fa:16:3e:d8:43:3b", "network": {"id": "fe3b43e0-6135-45f0-97ec-8b2af5fa26fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1391931283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "238e9fdacbfe47c7bdd8c638872c6ca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba20e243-e5", "ovs_interfaceid": "ba20e243-e5f1-4bbe-bac2-6163b07e850f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:47:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5974e44a-c677-41b0-b232-42fa5f16f797 req-3f3859ea-8ab9-41c6-9eec-a0f69c94cf6d service nova] Releasing lock "refresh_cache-5c1c9a3d-04de-4786-a263-dcf19a07e4bc" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:47:20 user nova-compute[75391]: DEBUG nova.network.neutron [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Successfully created port: 973cfe4a-ca5b-463e-b8e1-3477e73b20fb {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:47:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:21 user nova-compute[75391]: DEBUG nova.compute.manager [req-732503e2-efd7-4324-9733-6a161a198045 req-2ea64064-4e94-441f-af1d-fa113da58808 service nova] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Received event network-vif-plugged-ba20e243-e5f1-4bbe-bac2-6163b07e850f {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-732503e2-efd7-4324-9733-6a161a198045 req-2ea64064-4e94-441f-af1d-fa113da58808 service nova] Acquiring lock "5c1c9a3d-04de-4786-a263-dcf19a07e4bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-732503e2-efd7-4324-9733-6a161a198045 req-2ea64064-4e94-441f-af1d-fa113da58808 service nova] Lock "5c1c9a3d-04de-4786-a263-dcf19a07e4bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-732503e2-efd7-4324-9733-6a161a198045 req-2ea64064-4e94-441f-af1d-fa113da58808 service nova] Lock "5c1c9a3d-04de-4786-a263-dcf19a07e4bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:21 user nova-compute[75391]: DEBUG nova.compute.manager [req-732503e2-efd7-4324-9733-6a161a198045 req-2ea64064-4e94-441f-af1d-fa113da58808 service nova] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] No waiting events found dispatching network-vif-plugged-ba20e243-e5f1-4bbe-bac2-6163b07e850f {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:21 user nova-compute[75391]: WARNING nova.compute.manager [req-732503e2-efd7-4324-9733-6a161a198045 req-2ea64064-4e94-441f-af1d-fa113da58808 service nova] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Received unexpected event network-vif-plugged-ba20e243-e5f1-4bbe-bac2-6163b07e850f for instance with vm_state building and task_state spawning.
Nov 15 02:47:21 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:21 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:21 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:21 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:21 user nova-compute[75391]: DEBUG nova.network.neutron [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Successfully created port: 4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:47:22 user nova-compute[75391]: DEBUG nova.network.neutron [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Successfully created port: d91f58e8-8742-4077-9536-9e7f4cf22a8c {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:47:23 user nova-compute[75391]: INFO nova.virt.block_device [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Booting with volume 5dded56a-c818-4c6d-8e74-ebb85fab2103 at /dev/vdb
Nov 15 02:47:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG os_brick.utils [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[653b5618-1f42-46ad-9e27-6dbe1038ac7c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59eaad3-96c3-486c-8495-dfb04d1da4ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9293498b-bc3f-4787-8f27-7e3ff6c493cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd01f56-faf6-465f-aefc-55dff72f3c09]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG nova.compute.manager [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:47:23 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:47:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec95b0f-153f-495a-a04c-82002f33e00f]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG os_brick.utils [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Updating existing volume attachment record: 85b48576-8f59-44c6-a79c-46daabce9a1d {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:47:23 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Instance spawned successfully.
Nov 15 02:47:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:47:23 user nova-compute[75391]: INFO nova.compute.manager [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Took 7.11 seconds to spawn the instance on the hypervisor.
Nov 15 02:47:23 user nova-compute[75391]: DEBUG nova.compute.manager [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG nova.compute.manager [req-3bcdf759-28c7-40d7-a28c-e798ac4e34af req-4c46196f-3dc1-4260-83aa-423a559a0016 service nova] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Received event network-vif-plugged-ba20e243-e5f1-4bbe-bac2-6163b07e850f {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3bcdf759-28c7-40d7-a28c-e798ac4e34af req-4c46196f-3dc1-4260-83aa-423a559a0016 service nova] Acquiring lock "5c1c9a3d-04de-4786-a263-dcf19a07e4bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3bcdf759-28c7-40d7-a28c-e798ac4e34af req-4c46196f-3dc1-4260-83aa-423a559a0016 service nova] Lock "5c1c9a3d-04de-4786-a263-dcf19a07e4bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3bcdf759-28c7-40d7-a28c-e798ac4e34af req-4c46196f-3dc1-4260-83aa-423a559a0016 service nova] Lock "5c1c9a3d-04de-4786-a263-dcf19a07e4bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG nova.compute.manager [req-3bcdf759-28c7-40d7-a28c-e798ac4e34af req-4c46196f-3dc1-4260-83aa-423a559a0016 service nova] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] No waiting events found dispatching network-vif-plugged-ba20e243-e5f1-4bbe-bac2-6163b07e850f {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:23 user nova-compute[75391]: WARNING nova.compute.manager [req-3bcdf759-28c7-40d7-a28c-e798ac4e34af req-4c46196f-3dc1-4260-83aa-423a559a0016 service nova] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Received unexpected event network-vif-plugged-ba20e243-e5f1-4bbe-bac2-6163b07e850f for instance with vm_state building and task_state spawning.
Nov 15 02:47:23 user nova-compute[75391]: INFO nova.compute.manager [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Took 8.09 seconds to build instance.
Nov 15 02:47:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-314fc5c6-8b2e-4202-8c6b-79173f3c6723 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "5c1c9a3d-04de-4786-a263-dcf19a07e4bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.221s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:23 user nova-compute[75391]: DEBUG nova.network.neutron [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Successfully updated port: 59301df7-815a-4047-b6e2-190a0e80b4d4 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:25 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 25884e14-afa3-4e5d-8154-a9e9eb455b94 is timed out.
Nov 15 02:47:25 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Successfully detached device vdb from instance 25884e14-afa3-4e5d-8154-a9e9eb455b94 from the live domain config.
Nov 15 02:47:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JMOTbEVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:47:25 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:47:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f6c04e-d738-45dd-a163-ff30d5735d62]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:47:25 user nova-compute[75391]: No targets found.
Nov 15 02:47:25 user nova-compute[75391]: iSNS:
Nov 15 02:47:25 user nova-compute[75391]: No targets found.
Nov 15 02:47:25 user nova-compute[75391]: STATIC:
Nov 15 02:47:25 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b
Nov 15 02:47:25 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:47:25 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:47:25 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a
Nov 15 02:47:25 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:47:25 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:47:25 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:47:25 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:47:25 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:47:25 user nova-compute[75391]: FIRMWARE:
Nov 15 02:47:25 user nova-compute[75391]: No targets found.
Nov 15 02:47:25 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:47:25 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:47:25 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[346245b6-a9ce-45dc-a619-421e243360ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed4e73c-3223-4043-abe3-7c7484614d0c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:25 user nova-compute[75391]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:47:25 user nova-compute[75391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:47:25 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:25 user nova-compute[75391]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b (non-flash)
Nov 15 02:47:25 user nova-compute[75391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:47:25 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62441736d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b'): ({'sdb'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Removing single pathed devices sdb {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.043s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[78251ceb-c199-42af-94f7-55ac0c0a3271]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b85b83-9921-4a5d-99d6-b730465bf5f4]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Flushing IO for device /dev/sdb {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe29716-4ee3-4960-9366-9412e4e24140]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG nova.network.neutron [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Successfully updated port: d42541b2-a63d-470b-88ff-078657735d0a {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.185s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5680545a-6d65-4709-ab3d-0a957b668294]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.054s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf368a9-e3ba-426c-a0ae-bc50701c26a5]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --logout" returned: 0 in 0.120s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb0c0e6-642a-45c9-b42a-8dd9f9c3e2f3]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b, portal: 172.16.0.220,3260]
Nov 15 02:47:25 user nova-compute[75391]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b, portal: 172.16.0.220,3260] successful.
Nov 15 02:47:25 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf120b3-e9f4-444f-9a88-9284f626152b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb60b5a3-e7c7-474e-a79c-87b545e20881]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.653s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] <== disconnect_volume: return (655ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG nova.compute.manager [req-82fa4876-6ab2-4e2f-ad05-ec43cc1f2964 req-baa85aba-4f36-4360-91aa-0928a4ce2104 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-changed-59301df7-815a-4047-b6e2-190a0e80b4d4 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG nova.compute.manager [req-82fa4876-6ab2-4e2f-ad05-ec43cc1f2964 req-baa85aba-4f36-4360-91aa-0928a4ce2104 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Refreshing instance network info cache due to event network-changed-59301df7-815a-4047-b6e2-190a0e80b4d4. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-82fa4876-6ab2-4e2f-ad05-ec43cc1f2964 req-baa85aba-4f36-4360-91aa-0928a4ce2104 service nova] Acquiring lock "refresh_cache-60762562-adbd-4af6-8c0e-d6363a4111d2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-82fa4876-6ab2-4e2f-ad05-ec43cc1f2964 req-baa85aba-4f36-4360-91aa-0928a4ce2104 service nova] Acquired lock "refresh_cache-60762562-adbd-4af6-8c0e-d6363a4111d2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG nova.network.neutron [req-82fa4876-6ab2-4e2f-ad05-ec43cc1f2964 req-baa85aba-4f36-4360-91aa-0928a4ce2104 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Refreshing network info cache for port 59301df7-815a-4047-b6e2-190a0e80b4d4 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:47:25 user nova-compute[75391]: DEBUG nova.network.neutron [req-82fa4876-6ab2-4e2f-ad05-ec43cc1f2964 req-baa85aba-4f36-4360-91aa-0928a4ce2104 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:47:26 user nova-compute[75391]: DEBUG nova.network.neutron [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Successfully updated port: 6a2c8701-e54c-4ad6-b508-bbfbdd7e263c {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:47:26 user nova-compute[75391]: DEBUG nova.network.neutron [req-82fa4876-6ab2-4e2f-ad05-ec43cc1f2964 req-baa85aba-4f36-4360-91aa-0928a4ce2104 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:47:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-82fa4876-6ab2-4e2f-ad05-ec43cc1f2964 req-baa85aba-4f36-4360-91aa-0928a4ce2104 service nova] Releasing lock "refresh_cache-60762562-adbd-4af6-8c0e-d6363a4111d2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:47:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-82fa4876-6ab2-4e2f-ad05-ec43cc1f2964 req-baa85aba-4f36-4360-91aa-0928a4ce2104 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-changed-d42541b2-a63d-470b-88ff-078657735d0a {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-82fa4876-6ab2-4e2f-ad05-ec43cc1f2964 req-baa85aba-4f36-4360-91aa-0928a4ce2104 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Refreshing instance network info cache due to event network-changed-d42541b2-a63d-470b-88ff-078657735d0a. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:47:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-82fa4876-6ab2-4e2f-ad05-ec43cc1f2964 req-baa85aba-4f36-4360-91aa-0928a4ce2104 service nova] Acquiring lock "refresh_cache-60762562-adbd-4af6-8c0e-d6363a4111d2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:47:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-82fa4876-6ab2-4e2f-ad05-ec43cc1f2964 req-baa85aba-4f36-4360-91aa-0928a4ce2104 service nova] Acquired lock "refresh_cache-60762562-adbd-4af6-8c0e-d6363a4111d2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:47:26 user nova-compute[75391]: DEBUG nova.network.neutron [req-82fa4876-6ab2-4e2f-ad05-ec43cc1f2964 req-baa85aba-4f36-4360-91aa-0928a4ce2104 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Refreshing network info cache for port d42541b2-a63d-470b-88ff-078657735d0a {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:47:26 user nova-compute[75391]: DEBUG nova.network.neutron [req-82fa4876-6ab2-4e2f-ad05-ec43cc1f2964 req-baa85aba-4f36-4360-91aa-0928a4ce2104 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:47:26 user nova-compute[75391]: DEBUG nova.objects.instance [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lazy-loading 'flavor' on Instance uuid 25884e14-afa3-4e5d-8154-a9e9eb455b94 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:47:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d3639cd5-93be-48ed-9332-d934747f6838 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.865s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:26 user nova-compute[75391]: DEBUG nova.network.neutron [req-82fa4876-6ab2-4e2f-ad05-ec43cc1f2964 req-baa85aba-4f36-4360-91aa-0928a4ce2104 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:47:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-82fa4876-6ab2-4e2f-ad05-ec43cc1f2964 req-baa85aba-4f36-4360-91aa-0928a4ce2104 service nova] Releasing lock "refresh_cache-60762562-adbd-4af6-8c0e-d6363a4111d2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:47:27 user nova-compute[75391]: DEBUG nova.network.neutron [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Successfully updated port: b870665b-9254-4608-bd91-7aa46ed614d8 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:47:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-9ee537a9-ba7e-4586-b5d8-6729048039ec req-560253f3-b852-4dd7-9156-0fc24274a1a6 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-changed-6a2c8701-e54c-4ad6-b508-bbfbdd7e263c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-9ee537a9-ba7e-4586-b5d8-6729048039ec req-560253f3-b852-4dd7-9156-0fc24274a1a6 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Refreshing instance network info cache due to event network-changed-6a2c8701-e54c-4ad6-b508-bbfbdd7e263c. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:47:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9ee537a9-ba7e-4586-b5d8-6729048039ec req-560253f3-b852-4dd7-9156-0fc24274a1a6 service nova] Acquiring lock "refresh_cache-60762562-adbd-4af6-8c0e-d6363a4111d2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:47:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9ee537a9-ba7e-4586-b5d8-6729048039ec req-560253f3-b852-4dd7-9156-0fc24274a1a6 service nova] Acquired lock "refresh_cache-60762562-adbd-4af6-8c0e-d6363a4111d2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:47:27 user nova-compute[75391]: DEBUG nova.network.neutron [req-9ee537a9-ba7e-4586-b5d8-6729048039ec req-560253f3-b852-4dd7-9156-0fc24274a1a6 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Refreshing network info cache for port 6a2c8701-e54c-4ad6-b508-bbfbdd7e263c {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:47:27 user nova-compute[75391]: DEBUG nova.network.neutron [req-9ee537a9-ba7e-4586-b5d8-6729048039ec req-560253f3-b852-4dd7-9156-0fc24274a1a6 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:47:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:28 user nova-compute[75391]: DEBUG nova.network.neutron [req-9ee537a9-ba7e-4586-b5d8-6729048039ec req-560253f3-b852-4dd7-9156-0fc24274a1a6 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:47:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9ee537a9-ba7e-4586-b5d8-6729048039ec req-560253f3-b852-4dd7-9156-0fc24274a1a6 service nova] Releasing lock "refresh_cache-60762562-adbd-4af6-8c0e-d6363a4111d2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:47:28 user nova-compute[75391]: DEBUG nova.compute.manager [req-9ee537a9-ba7e-4586-b5d8-6729048039ec req-560253f3-b852-4dd7-9156-0fc24274a1a6 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-changed-b870665b-9254-4608-bd91-7aa46ed614d8 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:28 user nova-compute[75391]: DEBUG nova.compute.manager [req-9ee537a9-ba7e-4586-b5d8-6729048039ec req-560253f3-b852-4dd7-9156-0fc24274a1a6 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Refreshing instance network info cache due to event network-changed-b870665b-9254-4608-bd91-7aa46ed614d8. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:47:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9ee537a9-ba7e-4586-b5d8-6729048039ec req-560253f3-b852-4dd7-9156-0fc24274a1a6 service nova] Acquiring lock "refresh_cache-60762562-adbd-4af6-8c0e-d6363a4111d2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:47:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9ee537a9-ba7e-4586-b5d8-6729048039ec req-560253f3-b852-4dd7-9156-0fc24274a1a6 service nova] Acquired lock "refresh_cache-60762562-adbd-4af6-8c0e-d6363a4111d2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:47:28 user nova-compute[75391]: DEBUG nova.network.neutron [req-9ee537a9-ba7e-4586-b5d8-6729048039ec req-560253f3-b852-4dd7-9156-0fc24274a1a6 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Refreshing network info cache for port b870665b-9254-4608-bd91-7aa46ed614d8 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:47:28 user nova-compute[75391]: DEBUG nova.network.neutron [req-9ee537a9-ba7e-4586-b5d8-6729048039ec req-560253f3-b852-4dd7-9156-0fc24274a1a6 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:47:28 user nova-compute[75391]: DEBUG nova.network.neutron [req-9ee537a9-ba7e-4586-b5d8-6729048039ec req-560253f3-b852-4dd7-9156-0fc24274a1a6 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:47:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9ee537a9-ba7e-4586-b5d8-6729048039ec req-560253f3-b852-4dd7-9156-0fc24274a1a6 service nova] Releasing lock "refresh_cache-60762562-adbd-4af6-8c0e-d6363a4111d2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:47:28 user nova-compute[75391]: DEBUG nova.network.neutron [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Successfully updated port: 973cfe4a-ca5b-463e-b8e1-3477e73b20fb {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:47:29 user nova-compute[75391]: INFO nova.virt.block_device [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Booting with volume 43ee0797-97d7-4cb4-9af4-e197a7fcfb18 at /dev/vdc
Nov 15 02:47:29 user nova-compute[75391]: DEBUG os_brick.utils [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:47:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[95683ff9-94ac-4bad-9029-a0e8ad468e74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa566b64-e3ad-4806-bc5f-1d369d909283]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[574140ca-4b82-4586-8c4a-65c82f5fac71]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa90f2bf-728f-40ed-9372-f182bde6f7b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:47:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:47:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:47:29 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:47:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f27730-b732-4167-ac2f-ae444ea63d28]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:47:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:47:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:47:29 user nova-compute[75391]: DEBUG os_brick.utils [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:47:29 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Updating existing volume attachment record: 18fe4f3b-fbd7-44a8-ac99-932692289ddc {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:47:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:29 user nova-compute[75391]: DEBUG nova.network.neutron [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Successfully updated port: 4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:47:29 user nova-compute[75391]: DEBUG nova.compute.manager [req-47af1019-4a94-4c99-b9c8-322654039fc4 req-a561e022-514d-4c05-bbc2-e506f7042212 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-changed-973cfe4a-ca5b-463e-b8e1-3477e73b20fb {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:29 user nova-compute[75391]: DEBUG nova.compute.manager [req-47af1019-4a94-4c99-b9c8-322654039fc4 req-a561e022-514d-4c05-bbc2-e506f7042212 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Refreshing instance network info cache due to event network-changed-973cfe4a-ca5b-463e-b8e1-3477e73b20fb. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:47:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-47af1019-4a94-4c99-b9c8-322654039fc4 req-a561e022-514d-4c05-bbc2-e506f7042212 service nova] Acquiring lock "refresh_cache-60762562-adbd-4af6-8c0e-d6363a4111d2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:47:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-47af1019-4a94-4c99-b9c8-322654039fc4 req-a561e022-514d-4c05-bbc2-e506f7042212 service nova] Acquired lock "refresh_cache-60762562-adbd-4af6-8c0e-d6363a4111d2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:47:29 user nova-compute[75391]: DEBUG nova.network.neutron [req-47af1019-4a94-4c99-b9c8-322654039fc4 req-a561e022-514d-4c05-bbc2-e506f7042212 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Refreshing network info cache for port 973cfe4a-ca5b-463e-b8e1-3477e73b20fb {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:47:29 user nova-compute[75391]: DEBUG nova.network.neutron [req-47af1019-4a94-4c99-b9c8-322654039fc4 req-a561e022-514d-4c05-bbc2-e506f7042212 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:47:30 user nova-compute[75391]: DEBUG nova.network.neutron [req-47af1019-4a94-4c99-b9c8-322654039fc4 req-a561e022-514d-4c05-bbc2-e506f7042212 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:47:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-47af1019-4a94-4c99-b9c8-322654039fc4 req-a561e022-514d-4c05-bbc2-e506f7042212 service nova] Releasing lock "refresh_cache-60762562-adbd-4af6-8c0e-d6363a4111d2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:47:30 user nova-compute[75391]: DEBUG nova.compute.manager [req-47af1019-4a94-4c99-b9c8-322654039fc4 req-a561e022-514d-4c05-bbc2-e506f7042212 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-changed-4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:30 user nova-compute[75391]: DEBUG nova.compute.manager [req-47af1019-4a94-4c99-b9c8-322654039fc4 req-a561e022-514d-4c05-bbc2-e506f7042212 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Refreshing instance network info cache due to event network-changed-4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:47:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-47af1019-4a94-4c99-b9c8-322654039fc4 req-a561e022-514d-4c05-bbc2-e506f7042212 service nova] Acquiring lock "refresh_cache-60762562-adbd-4af6-8c0e-d6363a4111d2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:47:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-47af1019-4a94-4c99-b9c8-322654039fc4 req-a561e022-514d-4c05-bbc2-e506f7042212 service nova] Acquired lock "refresh_cache-60762562-adbd-4af6-8c0e-d6363a4111d2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:47:30 user nova-compute[75391]: DEBUG nova.network.neutron [req-47af1019-4a94-4c99-b9c8-322654039fc4 req-a561e022-514d-4c05-bbc2-e506f7042212 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Refreshing network info cache for port 4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:47:30 user nova-compute[75391]: DEBUG nova.network.neutron [req-47af1019-4a94-4c99-b9c8-322654039fc4 req-a561e022-514d-4c05-bbc2-e506f7042212 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:47:30 user nova-compute[75391]: DEBUG nova.network.neutron [req-47af1019-4a94-4c99-b9c8-322654039fc4 req-a561e022-514d-4c05-bbc2-e506f7042212 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:47:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-47af1019-4a94-4c99-b9c8-322654039fc4 req-a561e022-514d-4c05-bbc2-e506f7042212 service nova] Releasing lock "refresh_cache-60762562-adbd-4af6-8c0e-d6363a4111d2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:47:30 user nova-compute[75391]: DEBUG nova.network.neutron [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Successfully updated port: d91f58e8-8742-4077-9536-9e7f4cf22a8c {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:47:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Acquiring lock "refresh_cache-60762562-adbd-4af6-8c0e-d6363a4111d2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:47:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Acquired lock "refresh_cache-60762562-adbd-4af6-8c0e-d6363a4111d2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:47:30 user nova-compute[75391]: DEBUG nova.network.neutron [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:47:31 user nova-compute[75391]: DEBUG nova.network.neutron [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:47:31 user nova-compute[75391]: DEBUG nova.compute.manager [req-4aeb5e74-514a-4872-8843-9b2aaf58948a req-c88b38f6-1830-4a65-939d-4f51c1e5eb65 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-changed-d91f58e8-8742-4077-9536-9e7f4cf22a8c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:31 user nova-compute[75391]: DEBUG nova.compute.manager [req-4aeb5e74-514a-4872-8843-9b2aaf58948a req-c88b38f6-1830-4a65-939d-4f51c1e5eb65 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Refreshing instance network info cache due to event network-changed-d91f58e8-8742-4077-9536-9e7f4cf22a8c. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:47:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4aeb5e74-514a-4872-8843-9b2aaf58948a req-c88b38f6-1830-4a65-939d-4f51c1e5eb65 service nova] Acquiring lock "refresh_cache-60762562-adbd-4af6-8c0e-d6363a4111d2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:47:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:33 user nova-compute[75391]: DEBUG nova.network.neutron [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Updating instance_info_cache with network_info: [{"id": "59301df7-815a-4047-b6e2-190a0e80b4d4", "address": "fa:16:3e:11:89:27", "network": {"id": "e4f300b0-c84b-4d12-9cd9-b2b92726d342", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1598402766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59301df7-81", "ovs_interfaceid": "59301df7-815a-4047-b6e2-190a0e80b4d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d42541b2-a63d-470b-88ff-078657735d0a", "address": "fa:16:3e:ef:72:46", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42541b2-a6", "ovs_interfaceid": "d42541b2-a63d-470b-88ff-078657735d0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a2c8701-e54c-4ad6-b508-bbfbdd7e263c", "address": "fa:16:3e:ba:d3:c1", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a2c8701-e5", "ovs_interfaceid": "6a2c8701-e54c-4ad6-b508-bbfbdd7e263c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b870665b-9254-4608-bd91-7aa46ed614d8", "address": "fa:16:3e:51:a0:67", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb870665b-92", "ovs_interfaceid": "b870665b-9254-4608-bd91-7aa46ed614d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "973cfe4a-ca5b-463e-b8e1-3477e73b20fb", "address": "fa:16:3e:1a:d1:fc", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973cfe4a-ca", "ovs_interfaceid": "973cfe4a-ca5b-463e-b8e1-3477e73b20fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2", "address": "fa:16:3e:fd:5f:e6", "network": {"id": "b2951d9f-4d4e-49b4-86db-e6d3b1460558", "bridge": "br-int", "label": "tempest-device-tagging-net2-258791214", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c79b81c-4b", "ovs_interfaceid": "4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d91f58e8-8742-4077-9536-9e7f4cf22a8c", "address": "fa:16:3e:1a:e8:a6", "network": {"id": "b2951d9f-4d4e-49b4-86db-e6d3b1460558", "bridge": "br-int", "label": "tempest-device-tagging-net2-258791214", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd91f58e8-87", "ovs_interfaceid": "d91f58e8-8742-4077-9536-9e7f4cf22a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:47:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Releasing lock "refresh_cache-60762562-adbd-4af6-8c0e-d6363a4111d2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:47:33 user nova-compute[75391]: DEBUG nova.compute.manager [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Instance network_info: |[{"id": "59301df7-815a-4047-b6e2-190a0e80b4d4", "address": "fa:16:3e:11:89:27", "network": {"id": "e4f300b0-c84b-4d12-9cd9-b2b92726d342", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1598402766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59301df7-81", "ovs_interfaceid": "59301df7-815a-4047-b6e2-190a0e80b4d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d42541b2-a63d-470b-88ff-078657735d0a", "address": "fa:16:3e:ef:72:46", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42541b2-a6", "ovs_interfaceid": "d42541b2-a63d-470b-88ff-078657735d0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a2c8701-e54c-4ad6-b508-bbfbdd7e263c", "address": "fa:16:3e:ba:d3:c1", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a2c8701-e5", "ovs_interfaceid": "6a2c8701-e54c-4ad6-b508-bbfbdd7e263c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b870665b-9254-4608-bd91-7aa46ed614d8", "address": "fa:16:3e:51:a0:67", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb870665b-92", "ovs_interfaceid": "b870665b-9254-4608-bd91-7aa46ed614d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "973cfe4a-ca5b-463e-b8e1-3477e73b20fb", "address": "fa:16:3e:1a:d1:fc", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973cfe4a-ca", "ovs_interfaceid": "973cfe4a-ca5b-463e-b8e1-3477e73b20fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2", "address": "fa:16:3e:fd:5f:e6", "network": {"id": "b2951d9f-4d4e-49b4-86db-e6d3b1460558", "bridge": "br-int", "label": "tempest-device-tagging-net2-258791214", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c79b81c-4b", "ovs_interfaceid": "4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d91f58e8-8742-4077-9536-9e7f4cf22a8c", "address": "fa:16:3e:1a:e8:a6", "network": {"id": "b2951d9f-4d4e-49b4-86db-e6d3b1460558", "bridge": "br-int", "label": "tempest-device-tagging-net2-258791214", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd91f58e8-87", "ovs_interfaceid": "d91f58e8-8742-4077-9536-9e7f4cf22a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:47:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4aeb5e74-514a-4872-8843-9b2aaf58948a req-c88b38f6-1830-4a65-939d-4f51c1e5eb65 service nova] Acquired lock "refresh_cache-60762562-adbd-4af6-8c0e-d6363a4111d2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:47:33 user nova-compute[75391]: DEBUG nova.network.neutron [req-4aeb5e74-514a-4872-8843-9b2aaf58948a req-c88b38f6-1830-4a65-939d-4f51c1e5eb65 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Refreshing network info cache for port d91f58e8-8742-4077-9536-9e7f4cf22a8c {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:47:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-6877fbbe-ad2e-4b23-a2f7-de3b7825e897 req-d890b9a2-40dd-44dd-882e-5b47b7187798 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Received event network-changed-2a223503-a5c6-4851-b555-f4b3c9ce26bf {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-6877fbbe-ad2e-4b23-a2f7-de3b7825e897 req-d890b9a2-40dd-44dd-882e-5b47b7187798 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Refreshing instance network info cache due to event network-changed-2a223503-a5c6-4851-b555-f4b3c9ce26bf. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:47:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6877fbbe-ad2e-4b23-a2f7-de3b7825e897 req-d890b9a2-40dd-44dd-882e-5b47b7187798 service nova] Acquiring lock "refresh_cache-a4171d96-bb26-473f-a322-178dadbaab0a" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:47:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6877fbbe-ad2e-4b23-a2f7-de3b7825e897 req-d890b9a2-40dd-44dd-882e-5b47b7187798 service nova] Acquired lock "refresh_cache-a4171d96-bb26-473f-a322-178dadbaab0a" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:47:33 user nova-compute[75391]: DEBUG nova.network.neutron [req-6877fbbe-ad2e-4b23-a2f7-de3b7825e897 req-d890b9a2-40dd-44dd-882e-5b47b7187798 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Refreshing network info cache for port 2a223503-a5c6-4851-b555-f4b3c9ce26bf {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:47:33 user nova-compute[75391]: DEBUG nova.network.neutron [req-4aeb5e74-514a-4872-8843-9b2aaf58948a req-c88b38f6-1830-4a65-939d-4f51c1e5eb65 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Updated VIF entry in instance network info cache for port d91f58e8-8742-4077-9536-9e7f4cf22a8c. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:47:33 user nova-compute[75391]: DEBUG nova.network.neutron [req-4aeb5e74-514a-4872-8843-9b2aaf58948a req-c88b38f6-1830-4a65-939d-4f51c1e5eb65 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Updating instance_info_cache with network_info: [{"id": "59301df7-815a-4047-b6e2-190a0e80b4d4", "address": "fa:16:3e:11:89:27", "network": {"id": "e4f300b0-c84b-4d12-9cd9-b2b92726d342", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1598402766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59301df7-81", "ovs_interfaceid": "59301df7-815a-4047-b6e2-190a0e80b4d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d42541b2-a63d-470b-88ff-078657735d0a", "address": "fa:16:3e:ef:72:46", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42541b2-a6", "ovs_interfaceid": "d42541b2-a63d-470b-88ff-078657735d0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a2c8701-e54c-4ad6-b508-bbfbdd7e263c", "address": "fa:16:3e:ba:d3:c1", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a2c8701-e5", "ovs_interfaceid": "6a2c8701-e54c-4ad6-b508-bbfbdd7e263c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b870665b-9254-4608-bd91-7aa46ed614d8", "address": "fa:16:3e:51:a0:67", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb870665b-92", "ovs_interfaceid": "b870665b-9254-4608-bd91-7aa46ed614d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "973cfe4a-ca5b-463e-b8e1-3477e73b20fb", "address": "fa:16:3e:1a:d1:fc", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973cfe4a-ca", "ovs_interfaceid": "973cfe4a-ca5b-463e-b8e1-3477e73b20fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2", "address": "fa:16:3e:fd:5f:e6", "network": {"id": "b2951d9f-4d4e-49b4-86db-e6d3b1460558", "bridge": "br-int", "label": "tempest-device-tagging-net2-258791214", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c79b81c-4b", "ovs_interfaceid": "4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d91f58e8-8742-4077-9536-9e7f4cf22a8c", "address": "fa:16:3e:1a:e8:a6", "network": {"id": "b2951d9f-4d4e-49b4-86db-e6d3b1460558", "bridge": "br-int", "label": "tempest-device-tagging-net2-258791214", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd91f58e8-87", "ovs_interfaceid": "d91f58e8-8742-4077-9536-9e7f4cf22a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:47:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4aeb5e74-514a-4872-8843-9b2aaf58948a req-c88b38f6-1830-4a65-939d-4f51c1e5eb65 service nova] Releasing lock "refresh_cache-60762562-adbd-4af6-8c0e-d6363a4111d2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG nova.network.neutron [req-6877fbbe-ad2e-4b23-a2f7-de3b7825e897 req-d890b9a2-40dd-44dd-882e-5b47b7187798 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Updated VIF entry in instance network info cache for port 2a223503-a5c6-4851-b555-f4b3c9ce26bf. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG nova.network.neutron [req-6877fbbe-ad2e-4b23-a2f7-de3b7825e897 req-d890b9a2-40dd-44dd-882e-5b47b7187798 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Updating instance_info_cache with network_info: [{"id": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "address": "fa:16:3e:5b:49:f4", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a223503-a5", "ovs_interfaceid": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6877fbbe-ad2e-4b23-a2f7-de3b7825e897 req-d890b9a2-40dd-44dd-882e-5b47b7187798 service nova] Releasing lock "refresh_cache-a4171d96-bb26-473f-a322-178dadbaab0a" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "a4171d96-bb26-473f-a322-178dadbaab0a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "a4171d96-bb26-473f-a322-178dadbaab0a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG nova.objects.instance [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lazy-loading 'flavor' on Instance uuid a4171d96-bb26-473f-a322-178dadbaab0a {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "a4171d96-bb26-473f-a322-178dadbaab0a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "a4171d96-bb26-473f-a322-178dadbaab0a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "a4171d96-bb26-473f-a322-178dadbaab0a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:34 user nova-compute[75391]: INFO nova.compute.manager [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Attaching volume 400f1ca0-2998-4527-83c4-829f0cbe09ea to /dev/vdb
Nov 15 02:47:34 user nova-compute[75391]: DEBUG os_brick.utils [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[396a550c-45a5-46de-81b5-561909e817a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG nova.compute.manager [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:47:34 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Creating image(s)
Nov 15 02:47:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Did not create local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Ensure instance console log exists: /opt/stack/data/nova/instances/60762562-adbd-4af6-8c0e-d6363a4111d2/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Start _get_guest_xml network_info=[{"id": "59301df7-815a-4047-b6e2-190a0e80b4d4", "address": "fa:16:3e:11:89:27", "network": {"id": "e4f300b0-c84b-4d12-9cd9-b2b92726d342", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1598402766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59301df7-81", "ovs_interfaceid": "59301df7-815a-4047-b6e2-190a0e80b4d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d42541b2-a63d-470b-88ff-078657735d0a", "address": "fa:16:3e:ef:72:46", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42541b2-a6", "ovs_interfaceid": "d42541b2-a63d-470b-88ff-078657735d0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a2c8701-e54c-4ad6-b508-bbfbdd7e263c", "address": "fa:16:3e:ba:d3:c1", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a2c8701-e5", "ovs_interfaceid": "6a2c8701-e54c-4ad6-b508-bbfbdd7e263c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b870665b-9254-4608-bd91-7aa46ed614d8", "address": "fa:16:3e:51:a0:67", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb870665b-92", "ovs_interfaceid": "b870665b-9254-4608-bd91-7aa46ed614d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "973cfe4a-ca5b-463e-b8e1-3477e73b20fb", "address": "fa:16:3e:1a:d1:fc", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973cfe4a-ca", "ovs_interfaceid": "973cfe4a-ca5b-463e-b8e1-3477e73b20fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2", "address": "fa:16:3e:fd:5f:e6", "network": {"id": "b2951d9f-4d4e-49b4-86db-e6d3b1460558", "bridge": "br-int", "label": "tempest-device-tagging-net2-258791214", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c79b81c-4b", "ovs_interfaceid": "4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d91f58e8-8742-4077-9536-9e7f4cf22a8c", "address": "fa:16:3e:1a:e8:a6", "network": {"id": "b2951d9f-4d4e-49b4-86db-e6d3b1460558", "bridge": "br-int", "label": "tempest-device-tagging-net2-258791214", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd91f58e8-87", "ovs_interfaceid": "d91f58e8-8742-4077-9536-9e7f4cf22a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '174c204d-1837-4042-812b-72bb5809c1df', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kyZEiwjX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '60762562-adbd-4af6-8c0e-d6363a4111d2', 'attached_at': '', 'detached_at': '', 'volume_id': '1d817de5-94f3-48d3-a8cf-acffc9b6ffc4', 'serial': '1d817de5-94f3-48d3-a8cf-acffc9b6ffc4'}, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '85b48576-8f59-44c6-a79c-46daabce9a1d', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uabqPvMQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '60762562-adbd-4af6-8c0e-d6363a4111d2', 'attached_at': '', 'detached_at': '', 'volume_id': '5dded56a-c818-4c6d-8e74-ebb85fab2103', 'serial': '5dded56a-c818-4c6d-8e74-ebb85fab2103'}, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '18fe4f3b-fbd7-44a8-ac99-932692289ddc', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gSxOKumf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '60762562-adbd-4af6-8c0e-d6363a4111d2', 'attached_at': '', 'detached_at': '', 'volume_id': '43ee0797-97d7-4cb4-9af4-e197a7fcfb18', 'serial': '43ee0797-97d7-4cb4-9af4-e197a7fcfb18'}, 'volume_type': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[793c3e9a-033c-4aef-af1f-9a2f8c42d046]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:34 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:47:34 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:47:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kyZEiwjX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:47:34 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:47:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:47:34 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:47:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:47:34 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f433905d-a7b7-4fc2-81ee-ed1cfdba60ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6403892-7b83-4f1b-9a67-b7296ed97567]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0425ba81-f421-45a5-99e3-e7eb8a20513f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:47:34 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:47:34 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1f5cb4-8592-4698-acf7-33b9d358ebf7]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG os_brick.utils [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] <== get_connector_properties: return (202ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Updating existing volume attachment record: b3c31f9f-c985-4e7a-9516-6e24593e145a {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5ed103-9d18-4c56-8379-049f22ed78a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4] added
Nov 15 02:47:34 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[58758a91-dbff-460a-aa10-f9361ece8d8c]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cd1281-7a0c-492f-9800-1019d6a32331]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kyZEiwjX {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kyZEiwjX" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fd3a93-98d6-4e9d-9156-161235276328]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kyZEiwjX'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d794e66-be43-40c3-9fb6-b3d265fa5f3f]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b8c6b9-8275-42da-aa36-53fe21b8c247]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:34 user nova-compute[75391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:47:34 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:34 user nova-compute[75391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:47:34 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[162d085e-8cd6-44c9-95f4-0a815dfdf595]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4, portal: 172.16.0.220,3260]
Nov 15 02:47:34 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4, portal: 172.16.0.220,3260] successful.
Nov 15 02:47:34 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[16929ed2-14df-4ee9-abc0-c4c7856d94af]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9919c8ee-6923-4170-bec4-ff983fd84b2b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:34 user nova-compute[75391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:47:34 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:34 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:34 user nova-compute[75391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:47:34 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:34 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:47:34 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:47:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:35 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d90dc3-ccf7-450e-afc5-2a6a3795d4d0]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:35 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:47:35 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kyZEiwjX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '23365303266336537', 'path': '/dev/sdb'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365303266336537', 'path': '/dev/sdb'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uabqPvMQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:47:36 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:47:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.009s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:47:36 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:47:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:47:36 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[51023af9-da31-4989-9f57-59665e95be5c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:47:36 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[27328760-3353-49b7-90c6-d78f42e20a38]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103] added
Nov 15 02:47:36 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5484f3-dbf2-4371-90f3-4c92a0d8af2a]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[68621a49-1c7a-4d3f-a331-528aaa87ed89]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uabqPvMQ {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uabqPvMQ" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4cb2d5-bb68-48a0-a648-99a99a2056a7]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uabqPvMQ'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[69814c57-9ed7-4c61-be39-4698df7da19f]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[427563fb-a176-4fb2-8fe2-c327c1160ecb]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:36 user nova-compute[75391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:47:36 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:36 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:36 user nova-compute[75391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:47:36 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:36 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6a081b-2720-40c5-91bb-331c977908dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103, portal: 172.16.0.220,3260]
Nov 15 02:47:36 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103, portal: 172.16.0.220,3260] successful.
Nov 15 02:47:36 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74a3c80-6150-43a2-ba3d-f4df3c063fbe]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[24840d9e-2cae-4b87-bceb-3b0459d0412d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:36 user nova-compute[75391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:47:36 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:36 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:47:36 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:36 user nova-compute[75391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:47:36 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:36 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:47:36 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cca741-f899-4ae7-a899-29c573047c43]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uabqPvMQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG nova.compute.manager [req-f6500b4f-73fd-45e5-8210-63e27e4f6ee9 req-da738b97-7de4-403f-b787-5ad5eeee943f service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received event network-changed-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG nova.compute.manager [req-f6500b4f-73fd-45e5-8210-63e27e4f6ee9 req-da738b97-7de4-403f-b787-5ad5eeee943f service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Refreshing instance network info cache due to event network-changed-f3eff2a5-1256-4a92-969a-62aca65b7452. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f6500b4f-73fd-45e5-8210-63e27e4f6ee9 req-da738b97-7de4-403f-b787-5ad5eeee943f service nova] Acquiring lock "refresh_cache-da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f6500b4f-73fd-45e5-8210-63e27e4f6ee9 req-da738b97-7de4-403f-b787-5ad5eeee943f service nova] Acquired lock "refresh_cache-da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:47:36 user nova-compute[75391]: DEBUG nova.network.neutron [req-f6500b4f-73fd-45e5-8210-63e27e4f6ee9 req-da738b97-7de4-403f-b787-5ad5eeee943f service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Refreshing network info cache for port f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG nova.network.neutron [req-f6500b4f-73fd-45e5-8210-63e27e4f6ee9 req-da738b97-7de4-403f-b787-5ad5eeee943f service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Updated VIF entry in instance network info cache for port f3eff2a5-1256-4a92-969a-62aca65b7452. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG nova.network.neutron [req-f6500b4f-73fd-45e5-8210-63e27e4f6ee9 req-da738b97-7de4-403f-b787-5ad5eeee943f service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Updating instance_info_cache with network_info: [{"id": "f3eff2a5-1256-4a92-969a-62aca65b7452", "address": "fa:16:3e:1d:2d:fe", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eff2a5-12", "ovs_interfaceid": "f3eff2a5-1256-4a92-969a-62aca65b7452", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f6500b4f-73fd-45e5-8210-63e27e4f6ee9 req-da738b97-7de4-403f-b787-5ad5eeee943f service nova] Releasing lock "refresh_cache-da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23066623961333265', 'path': '/dev/sdd'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066623961333265', 'path': '/dev/sdd'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gSxOKumf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:47:37 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:47:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:47:37 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:47:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:47:37 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6044a0c0-4b43-41ab-bcee-df5fd4834140]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:47:37 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e7ea39-b7ae-43be-9da7-a318be6000cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18] added
Nov 15 02:47:37 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bde845-82e1-43f5-ab3b-9f43f9c3076b]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7086c22-9cec-493f-8c5f-2bc9b4f593b9]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gSxOKumf {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gSxOKumf" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1c6bf3-613f-4fe4-90bf-f84ad2fb86be]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gSxOKumf'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d7e74c-7fbb-40e7-a29f-7bfb43bf22b1]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d318b7-442d-4c69-872a-e1c3e8e98c22]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:37 user nova-compute[75391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:47:37 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:37 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:47:37 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:37 user nova-compute[75391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:47:37 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:37 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:47:37 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8db583-cc26-4cd9-8b7f-46a3b2d08328]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18, portal: 172.16.0.220,3260]
Nov 15 02:47:37 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18, portal: 172.16.0.220,3260] successful.
Nov 15 02:47:37 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d764f94-1f6d-4a51-a0cb-5e63196d115d]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b50f92a-d00f-46cd-9129-fdbd0b233ab2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:37 user nova-compute[75391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:47:37 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:37 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:47:37 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:47:37 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:37 user nova-compute[75391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:47:37 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:37 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:47:37 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:47:37 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[17da9d85-8860-4220-a946-dffdcc33df90]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:47:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gSxOKumf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23930646130303563', 'path': '/dev/sde'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930646130303563', 'path': '/dev/sde'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539282742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539282742',id=20,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKza1whiTyjorzZVhyM5Da4n8+g8hKkFF6P0kflNEQ+1nL/QCauJlu23FgG5vnkGFXLe4gXIyZt4E7kXz1Lx1BPYqrYXAg8ZGX9DrYKxZncH5Sd0WgI2mhhpCQa/hbpklw==',key_name='tempest-keypair-1303500730',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70ba612613604fa38f1bb4ec29602cac',ramdisk_id='',reservation_id='r-edo4xu27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-408717637',owner_user_name='tempest-TaggedBootDevicesTest_v242-408717637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4380b18a109e458f9b08a5154dfd5d27',uuid=60762562-adbd-4af6-8c0e-d6363a4111d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59301df7-815a-4047-b6e2-190a0e80b4d4", "address": "fa:16:3e:11:89:27", "network": {"id": "e4f300b0-c84b-4d12-9cd9-b2b92726d342", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1598402766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59301df7-81", "ovs_interfaceid": "59301df7-815a-4047-b6e2-190a0e80b4d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converting VIF {"id": "59301df7-815a-4047-b6e2-190a0e80b4d4", "address": "fa:16:3e:11:89:27", "network": {"id": "e4f300b0-c84b-4d12-9cd9-b2b92726d342", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1598402766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59301df7-81", "ovs_interfaceid": "59301df7-815a-4047-b6e2-190a0e80b4d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:89:27,bridge_name='br-int',has_traffic_filtering=True,id=59301df7-815a-4047-b6e2-190a0e80b4d4,network=Network(e4f300b0-c84b-4d12-9cd9-b2b92726d342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59301df7-81') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539282742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539282742',id=20,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKza1whiTyjorzZVhyM5Da4n8+g8hKkFF6P0kflNEQ+1nL/QCauJlu23FgG5vnkGFXLe4gXIyZt4E7kXz1Lx1BPYqrYXAg8ZGX9DrYKxZncH5Sd0WgI2mhhpCQa/hbpklw==',key_name='tempest-keypair-1303500730',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70ba612613604fa38f1bb4ec29602cac',ramdisk_id='',reservation_id='r-edo4xu27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-408717637',owner_user_name='tempest-TaggedBootDevicesTest_v242-408717637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4380b18a109e458f9b08a5154dfd5d27',uuid=60762562-adbd-4af6-8c0e-d6363a4111d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d42541b2-a63d-470b-88ff-078657735d0a", "address": "fa:16:3e:ef:72:46", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42541b2-a6", "ovs_interfaceid": "d42541b2-a63d-470b-88ff-078657735d0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converting VIF {"id": "d42541b2-a63d-470b-88ff-078657735d0a", "address": "fa:16:3e:ef:72:46", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42541b2-a6", "ovs_interfaceid": "d42541b2-a63d-470b-88ff-078657735d0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:72:46,bridge_name='br-int',has_traffic_filtering=True,id=d42541b2-a63d-470b-88ff-078657735d0a,network=Network(74933e47-dccc-47d3-8c5c-a355abc6d0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd42541b2-a6') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539282742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539282742',id=20,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKza1whiTyjorzZVhyM5Da4n8+g8hKkFF6P0kflNEQ+1nL/QCauJlu23FgG5vnkGFXLe4gXIyZt4E7kXz1Lx1BPYqrYXAg8ZGX9DrYKxZncH5Sd0WgI2mhhpCQa/hbpklw==',key_name='tempest-keypair-1303500730',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70ba612613604fa38f1bb4ec29602cac',ramdisk_id='',reservation_id='r-edo4xu27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-408717637',owner_user_name='tempest-TaggedBootDevicesTest_v242-408717637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4380b18a109e458f9b08a5154dfd5d27',uuid=60762562-adbd-4af6-8c0e-d6363a4111d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a2c8701-e54c-4ad6-b508-bbfbdd7e263c", "address": "fa:16:3e:ba:d3:c1", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a2c8701-e5", "ovs_interfaceid": "6a2c8701-e54c-4ad6-b508-bbfbdd7e263c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converting VIF {"id": "6a2c8701-e54c-4ad6-b508-bbfbdd7e263c", "address": "fa:16:3e:ba:d3:c1", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a2c8701-e5", "ovs_interfaceid": "6a2c8701-e54c-4ad6-b508-bbfbdd7e263c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:d3:c1,bridge_name='br-int',has_traffic_filtering=True,id=6a2c8701-e54c-4ad6-b508-bbfbdd7e263c,network=Network(74933e47-dccc-47d3-8c5c-a355abc6d0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a2c8701-e5') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539282742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539282742',id=20,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKza1whiTyjorzZVhyM5Da4n8+g8hKkFF6P0kflNEQ+1nL/QCauJlu23FgG5vnkGFXLe4gXIyZt4E7kXz1Lx1BPYqrYXAg8ZGX9DrYKxZncH5Sd0WgI2mhhpCQa/hbpklw==',key_name='tempest-keypair-1303500730',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70ba612613604fa38f1bb4ec29602cac',ramdisk_id='',reservation_id='r-edo4xu27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-408717637',owner_user_name='tempest-TaggedBootDevicesTest_v242-408717637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4380b18a109e458f9b08a5154dfd5d27',uuid=60762562-adbd-4af6-8c0e-d6363a4111d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b870665b-9254-4608-bd91-7aa46ed614d8", "address": "fa:16:3e:51:a0:67", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb870665b-92", "ovs_interfaceid": "b870665b-9254-4608-bd91-7aa46ed614d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converting VIF {"id": "b870665b-9254-4608-bd91-7aa46ed614d8", "address": "fa:16:3e:51:a0:67", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb870665b-92", "ovs_interfaceid": "b870665b-9254-4608-bd91-7aa46ed614d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:a0:67,bridge_name='br-int',has_traffic_filtering=True,id=b870665b-9254-4608-bd91-7aa46ed614d8,network=Network(74933e47-dccc-47d3-8c5c-a355abc6d0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb870665b-92') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539282742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539282742',id=20,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKza1whiTyjorzZVhyM5Da4n8+g8hKkFF6P0kflNEQ+1nL/QCauJlu23FgG5vnkGFXLe4gXIyZt4E7kXz1Lx1BPYqrYXAg8ZGX9DrYKxZncH5Sd0WgI2mhhpCQa/hbpklw==',key_name='tempest-keypair-1303500730',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70ba612613604fa38f1bb4ec29602cac',ramdisk_id='',reservation_id='r-edo4xu27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-408717637',owner_user_name='tempest-TaggedBootDevicesTest_v242-408717637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4380b18a109e458f9b08a5154dfd5d27',uuid=60762562-adbd-4af6-8c0e-d6363a4111d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "973cfe4a-ca5b-463e-b8e1-3477e73b20fb", "address": "fa:16:3e:1a:d1:fc", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973cfe4a-ca", "ovs_interfaceid": "973cfe4a-ca5b-463e-b8e1-3477e73b20fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converting VIF {"id": "973cfe4a-ca5b-463e-b8e1-3477e73b20fb", "address": "fa:16:3e:1a:d1:fc", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973cfe4a-ca", "ovs_interfaceid": "973cfe4a-ca5b-463e-b8e1-3477e73b20fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:d1:fc,bridge_name='br-int',has_traffic_filtering=True,id=973cfe4a-ca5b-463e-b8e1-3477e73b20fb,network=Network(74933e47-dccc-47d3-8c5c-a355abc6d0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap973cfe4a-ca') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539282742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539282742',id=20,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKza1whiTyjorzZVhyM5Da4n8+g8hKkFF6P0kflNEQ+1nL/QCauJlu23FgG5vnkGFXLe4gXIyZt4E7kXz1Lx1BPYqrYXAg8ZGX9DrYKxZncH5Sd0WgI2mhhpCQa/hbpklw==',key_name='tempest-keypair-1303500730',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70ba612613604fa38f1bb4ec29602cac',ramdisk_id='',reservation_id='r-edo4xu27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-408717637',owner_user_name='tempest-TaggedBootDevicesTest_v242-408717637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4380b18a109e458f9b08a5154dfd5d27',uuid=60762562-adbd-4af6-8c0e-d6363a4111d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2", "address": "fa:16:3e:fd:5f:e6", "network": {"id": "b2951d9f-4d4e-49b4-86db-e6d3b1460558", "bridge": "br-int", "label": "tempest-device-tagging-net2-258791214", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c79b81c-4b", "ovs_interfaceid": "4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converting VIF {"id": "4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2", "address": "fa:16:3e:fd:5f:e6", "network": {"id": "b2951d9f-4d4e-49b4-86db-e6d3b1460558", "bridge": "br-int", "label": "tempest-device-tagging-net2-258791214", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c79b81c-4b", "ovs_interfaceid": "4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:5f:e6,bridge_name='br-int',has_traffic_filtering=True,id=4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2,network=Network(b2951d9f-4d4e-49b4-86db-e6d3b1460558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c79b81c-4b') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539282742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539282742',id=20,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKza1whiTyjorzZVhyM5Da4n8+g8hKkFF6P0kflNEQ+1nL/QCauJlu23FgG5vnkGFXLe4gXIyZt4E7kXz1Lx1BPYqrYXAg8ZGX9DrYKxZncH5Sd0WgI2mhhpCQa/hbpklw==',key_name='tempest-keypair-1303500730',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70ba612613604fa38f1bb4ec29602cac',ramdisk_id='',reservation_id='r-edo4xu27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-408717637',owner_user_name='tempest-TaggedBootDevicesTest_v242-408717637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4380b18a109e458f9b08a5154dfd5d27',uuid=60762562-adbd-4af6-8c0e-d6363a4111d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d91f58e8-8742-4077-9536-9e7f4cf22a8c", "address": "fa:16:3e:1a:e8:a6", "network": {"id": "b2951d9f-4d4e-49b4-86db-e6d3b1460558", "bridge": "br-int", "label": "tempest-device-tagging-net2-258791214", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd91f58e8-87", "ovs_interfaceid": "d91f58e8-8742-4077-9536-9e7f4cf22a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converting VIF {"id": "d91f58e8-8742-4077-9536-9e7f4cf22a8c", "address": "fa:16:3e:1a:e8:a6", "network": {"id": "b2951d9f-4d4e-49b4-86db-e6d3b1460558", "bridge": "br-int", "label": "tempest-device-tagging-net2-258791214", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd91f58e8-87", "ovs_interfaceid": "d91f58e8-8742-4077-9536-9e7f4cf22a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:e8:a6,bridge_name='br-int',has_traffic_filtering=True,id=d91f58e8-8742-4077-9536-9e7f4cf22a8c,network=Network(b2951d9f-4d4e-49b4-86db-e6d3b1460558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd91f58e8-87') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.objects.instance [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lazy-loading 'pci_devices' on Instance uuid 60762562-adbd-4af6-8c0e-d6363a4111d2 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:47:38 user nova-compute[75391]:   <uuid>60762562-adbd-4af6-8c0e-d6363a4111d2</uuid>
Nov 15 02:47:38 user nova-compute[75391]:   <name>instance-00000014</name>
Nov 15 02:47:38 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:47:38 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:47:38 user nova-compute[75391]:   <metadata>
Nov 15 02:47:38 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:47:38 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:47:38 user nova-compute[75391]:       <nova:name>tempest-device-tagging-server-539282742</nova:name>
Nov 15 02:47:38 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:47:34</nova:creationTime>
Nov 15 02:47:38 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:47:38 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:47:38 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:47:38 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:47:38 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:47:38 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:47:38 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:47:38 user nova-compute[75391]:       <nova:owner>
Nov 15 02:47:38 user nova-compute[75391]:         <nova:user uuid="4380b18a109e458f9b08a5154dfd5d27">tempest-TaggedBootDevicesTest_v242-408717637-project-member</nova:user>
Nov 15 02:47:38 user nova-compute[75391]:         <nova:project uuid="70ba612613604fa38f1bb4ec29602cac">tempest-TaggedBootDevicesTest_v242-408717637</nova:project>
Nov 15 02:47:38 user nova-compute[75391]:       </nova:owner>
Nov 15 02:47:38 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:47:38 user nova-compute[75391]:       <nova:ports>
Nov 15 02:47:38 user nova-compute[75391]:         <nova:port uuid="59301df7-815a-4047-b6e2-190a0e80b4d4">
Nov 15 02:47:38 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 02:47:38 user nova-compute[75391]:         </nova:port>
Nov 15 02:47:38 user nova-compute[75391]:         <nova:port uuid="d42541b2-a63d-470b-88ff-078657735d0a">
Nov 15 02:47:38 user nova-compute[75391]:           <nova:ip type="fixed" address="10.1.1.62" ipVersion="4"/>
Nov 15 02:47:38 user nova-compute[75391]:         </nova:port>
Nov 15 02:47:38 user nova-compute[75391]:         <nova:port uuid="6a2c8701-e54c-4ad6-b508-bbfbdd7e263c">
Nov 15 02:47:38 user nova-compute[75391]:           <nova:ip type="fixed" address="10.1.1.235" ipVersion="4"/>
Nov 15 02:47:38 user nova-compute[75391]:         </nova:port>
Nov 15 02:47:38 user nova-compute[75391]:         <nova:port uuid="b870665b-9254-4608-bd91-7aa46ed614d8">
Nov 15 02:47:38 user nova-compute[75391]:           <nova:ip type="fixed" address="10.1.1.132" ipVersion="4"/>
Nov 15 02:47:38 user nova-compute[75391]:         </nova:port>
Nov 15 02:47:38 user nova-compute[75391]:         <nova:port uuid="973cfe4a-ca5b-463e-b8e1-3477e73b20fb">
Nov 15 02:47:38 user nova-compute[75391]:           <nova:ip type="fixed" address="10.1.1.71" ipVersion="4"/>
Nov 15 02:47:38 user nova-compute[75391]:         </nova:port>
Nov 15 02:47:38 user nova-compute[75391]:         <nova:port uuid="4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2">
Nov 15 02:47:38 user nova-compute[75391]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 15 02:47:38 user nova-compute[75391]:         </nova:port>
Nov 15 02:47:38 user nova-compute[75391]:         <nova:port uuid="d91f58e8-8742-4077-9536-9e7f4cf22a8c">
Nov 15 02:47:38 user nova-compute[75391]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 15 02:47:38 user nova-compute[75391]:         </nova:port>
Nov 15 02:47:38 user nova-compute[75391]:       </nova:ports>
Nov 15 02:47:38 user nova-compute[75391]:     </nova:instance>
Nov 15 02:47:38 user nova-compute[75391]:   </metadata>
Nov 15 02:47:38 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:47:38 user nova-compute[75391]:     <system>
Nov 15 02:47:38 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:47:38 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:47:38 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:47:38 user nova-compute[75391]:       <entry name="serial">60762562-adbd-4af6-8c0e-d6363a4111d2</entry>
Nov 15 02:47:38 user nova-compute[75391]:       <entry name="uuid">60762562-adbd-4af6-8c0e-d6363a4111d2</entry>
Nov 15 02:47:38 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:47:38 user nova-compute[75391]:     </system>
Nov 15 02:47:38 user nova-compute[75391]:   </sysinfo>
Nov 15 02:47:38 user nova-compute[75391]:   <os>
Nov 15 02:47:38 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:47:38 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:47:38 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:47:38 user nova-compute[75391]:   </os>
Nov 15 02:47:38 user nova-compute[75391]:   <features>
Nov 15 02:47:38 user nova-compute[75391]:     <acpi/>
Nov 15 02:47:38 user nova-compute[75391]:     <apic/>
Nov 15 02:47:38 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:47:38 user nova-compute[75391]:   </features>
Nov 15 02:47:38 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:47:38 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:47:38 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:47:38 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:47:38 user nova-compute[75391]:   </clock>
Nov 15 02:47:38 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:47:38 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:47:38 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:47:38 user nova-compute[75391]:   </cpu>
Nov 15 02:47:38 user nova-compute[75391]:   <devices>
Nov 15 02:47:38 user nova-compute[75391]:     <disk type="file" device="cdrom">
Nov 15 02:47:38 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 02:47:38 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/60762562-adbd-4af6-8c0e-d6363a4111d2/disk.config"/>
Nov 15 02:47:38 user nova-compute[75391]:       <target dev="hda" bus="ide"/>
Nov 15 02:47:38 user nova-compute[75391]:     </disk>
Nov 15 02:47:38 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 02:47:38 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:47:38 user nova-compute[75391]:       <source dev="/dev/sdb"/>
Nov 15 02:47:38 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:47:38 user nova-compute[75391]:       <serial>1d817de5-94f3-48d3-a8cf-acffc9b6ffc4</serial>
Nov 15 02:47:38 user nova-compute[75391]:     </disk>
Nov 15 02:47:38 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 02:47:38 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:47:38 user nova-compute[75391]:       <source dev="/dev/sdd"/>
Nov 15 02:47:38 user nova-compute[75391]:       <target dev="vdb" bus="virtio"/>
Nov 15 02:47:38 user nova-compute[75391]:       <serial>5dded56a-c818-4c6d-8e74-ebb85fab2103</serial>
Nov 15 02:47:38 user nova-compute[75391]:     </disk>
Nov 15 02:47:38 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 02:47:38 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:47:38 user nova-compute[75391]:       <source dev="/dev/sde"/>
Nov 15 02:47:38 user nova-compute[75391]:       <target dev="vdc" bus="virtio"/>
Nov 15 02:47:38 user nova-compute[75391]:       <serial>43ee0797-97d7-4cb4-9af4-e197a7fcfb18</serial>
Nov 15 02:47:38 user nova-compute[75391]:     </disk>
Nov 15 02:47:38 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:47:38 user nova-compute[75391]:       <mac address="fa:16:3e:11:89:27"/>
Nov 15 02:47:38 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:47:38 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:47:38 user nova-compute[75391]:       <target dev="tap59301df7-81"/>
Nov 15 02:47:38 user nova-compute[75391]:     </interface>
Nov 15 02:47:38 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:47:38 user nova-compute[75391]:       <mac address="fa:16:3e:ef:72:46"/>
Nov 15 02:47:38 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:47:38 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:47:38 user nova-compute[75391]:       <target dev="tapd42541b2-a6"/>
Nov 15 02:47:38 user nova-compute[75391]:     </interface>
Nov 15 02:47:38 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:47:38 user nova-compute[75391]:       <mac address="fa:16:3e:ba:d3:c1"/>
Nov 15 02:47:38 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:47:38 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:47:38 user nova-compute[75391]:       <target dev="tap6a2c8701-e5"/>
Nov 15 02:47:38 user nova-compute[75391]:     </interface>
Nov 15 02:47:38 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:47:38 user nova-compute[75391]:       <mac address="fa:16:3e:51:a0:67"/>
Nov 15 02:47:38 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:47:38 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:47:38 user nova-compute[75391]:       <target dev="tapb870665b-92"/>
Nov 15 02:47:38 user nova-compute[75391]:     </interface>
Nov 15 02:47:38 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:47:38 user nova-compute[75391]:       <mac address="fa:16:3e:1a:d1:fc"/>
Nov 15 02:47:38 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:47:38 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:47:38 user nova-compute[75391]:       <target dev="tap973cfe4a-ca"/>
Nov 15 02:47:38 user nova-compute[75391]:     </interface>
Nov 15 02:47:38 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:47:38 user nova-compute[75391]:       <mac address="fa:16:3e:fd:5f:e6"/>
Nov 15 02:47:38 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:47:38 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:47:38 user nova-compute[75391]:       <target dev="tap4c79b81c-4b"/>
Nov 15 02:47:38 user nova-compute[75391]:     </interface>
Nov 15 02:47:38 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:47:38 user nova-compute[75391]:       <mac address="fa:16:3e:1a:e8:a6"/>
Nov 15 02:47:38 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:47:38 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:47:38 user nova-compute[75391]:       <target dev="tapd91f58e8-87"/>
Nov 15 02:47:38 user nova-compute[75391]:     </interface>
Nov 15 02:47:38 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:47:38 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/60762562-adbd-4af6-8c0e-d6363a4111d2/console.log" append="off"/>
Nov 15 02:47:38 user nova-compute[75391]:     </serial>
Nov 15 02:47:38 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:47:38 user nova-compute[75391]:     <video>
Nov 15 02:47:38 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:47:38 user nova-compute[75391]:     </video>
Nov 15 02:47:38 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:47:38 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:47:38 user nova-compute[75391]:     </rng>
Nov 15 02:47:38 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:47:38 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:47:38 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:47:38 user nova-compute[75391]:     </memballoon>
Nov 15 02:47:38 user nova-compute[75391]:   </devices>
Nov 15 02:47:38 user nova-compute[75391]: </domain>
Nov 15 02:47:38 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539282742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539282742',id=20,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKza1whiTyjorzZVhyM5Da4n8+g8hKkFF6P0kflNEQ+1nL/QCauJlu23FgG5vnkGFXLe4gXIyZt4E7kXz1Lx1BPYqrYXAg8ZGX9DrYKxZncH5Sd0WgI2mhhpCQa/hbpklw==',key_name='tempest-keypair-1303500730',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70ba612613604fa38f1bb4ec29602cac',ramdisk_id='',reservation_id='r-edo4xu27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-408717637',owner_user_name='tempest-TaggedBootDevicesTest_v242-408717637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4380b18a109e458f9b08a5154dfd5d27',uuid=60762562-adbd-4af6-8c0e-d6363a4111d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59301df7-815a-4047-b6e2-190a0e80b4d4", "address": "fa:16:3e:11:89:27", "network": {"id": "e4f300b0-c84b-4d12-9cd9-b2b92726d342", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1598402766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59301df7-81", "ovs_interfaceid": "59301df7-815a-4047-b6e2-190a0e80b4d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converting VIF {"id": "59301df7-815a-4047-b6e2-190a0e80b4d4", "address": "fa:16:3e:11:89:27", "network": {"id": "e4f300b0-c84b-4d12-9cd9-b2b92726d342", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1598402766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59301df7-81", "ovs_interfaceid": "59301df7-815a-4047-b6e2-190a0e80b4d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:89:27,bridge_name='br-int',has_traffic_filtering=True,id=59301df7-815a-4047-b6e2-190a0e80b4d4,network=Network(e4f300b0-c84b-4d12-9cd9-b2b92726d342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59301df7-81') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG os_vif [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:89:27,bridge_name='br-int',has_traffic_filtering=True,id=59301df7-815a-4047-b6e2-190a0e80b4d4,network=Network(e4f300b0-c84b-4d12-9cd9-b2b92726d342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59301df7-81') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f154e2b3-05c3-5677-b6d8-2fe949f1e41a', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59301df7-81, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap59301df7-81, col_values=(('qos', UUID('c27527f3-1062-4192-90f8-ac645fb69ed6')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap59301df7-81, col_values=(('external_ids', {'iface-id': '59301df7-815a-4047-b6e2-190a0e80b4d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:89:27', 'vm-uuid': '60762562-adbd-4af6-8c0e-d6363a4111d2'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:38 user nova-compute[75391]: INFO os_vif [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:89:27,bridge_name='br-int',has_traffic_filtering=True,id=59301df7-815a-4047-b6e2-190a0e80b4d4,network=Network(e4f300b0-c84b-4d12-9cd9-b2b92726d342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59301df7-81')
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539282742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539282742',id=20,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKza1whiTyjorzZVhyM5Da4n8+g8hKkFF6P0kflNEQ+1nL/QCauJlu23FgG5vnkGFXLe4gXIyZt4E7kXz1Lx1BPYqrYXAg8ZGX9DrYKxZncH5Sd0WgI2mhhpCQa/hbpklw==',key_name='tempest-keypair-1303500730',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70ba612613604fa38f1bb4ec29602cac',ramdisk_id='',reservation_id='r-edo4xu27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-408717637',owner_user_name='tempest-TaggedBootDevicesTest_v242-408717637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4380b18a109e458f9b08a5154dfd5d27',uuid=60762562-adbd-4af6-8c0e-d6363a4111d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d42541b2-a63d-470b-88ff-078657735d0a", "address": "fa:16:3e:ef:72:46", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42541b2-a6", "ovs_interfaceid": "d42541b2-a63d-470b-88ff-078657735d0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converting VIF {"id": "d42541b2-a63d-470b-88ff-078657735d0a", "address": "fa:16:3e:ef:72:46", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42541b2-a6", "ovs_interfaceid": "d42541b2-a63d-470b-88ff-078657735d0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:72:46,bridge_name='br-int',has_traffic_filtering=True,id=d42541b2-a63d-470b-88ff-078657735d0a,network=Network(74933e47-dccc-47d3-8c5c-a355abc6d0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd42541b2-a6') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG os_vif [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:72:46,bridge_name='br-int',has_traffic_filtering=True,id=d42541b2-a63d-470b-88ff-078657735d0a,network=Network(74933e47-dccc-47d3-8c5c-a355abc6d0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd42541b2-a6') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d33e245-1c29-58e2-a628-032a2b5390bf', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:47:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd42541b2-a6, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd42541b2-a6, col_values=(('qos', UUID('fd872e34-fe70-4b40-ad44-cfd0bd17d3d8')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd42541b2-a6, col_values=(('external_ids', {'iface-id': 'd42541b2-a63d-470b-88ff-078657735d0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:72:46', 'vm-uuid': '60762562-adbd-4af6-8c0e-d6363a4111d2'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: INFO os_vif [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:72:46,bridge_name='br-int',has_traffic_filtering=True,id=d42541b2-a63d-470b-88ff-078657735d0a,network=Network(74933e47-dccc-47d3-8c5c-a355abc6d0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd42541b2-a6')
Nov 15 02:47:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539282742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539282742',id=20,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKza1whiTyjorzZVhyM5Da4n8+g8hKkFF6P0kflNEQ+1nL/QCauJlu23FgG5vnkGFXLe4gXIyZt4E7kXz1Lx1BPYqrYXAg8ZGX9DrYKxZncH5Sd0WgI2mhhpCQa/hbpklw==',key_name='tempest-keypair-1303500730',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70ba612613604fa38f1bb4ec29602cac',ramdisk_id='',reservation_id='r-edo4xu27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-408717637',owner_user_name='tempest-TaggedBootDevicesTest_v242-408717637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4380b18a109e458f9b08a5154dfd5d27',uuid=60762562-adbd-4af6-8c0e-d6363a4111d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a2c8701-e54c-4ad6-b508-bbfbdd7e263c", "address": "fa:16:3e:ba:d3:c1", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a2c8701-e5", "ovs_interfaceid": "6a2c8701-e54c-4ad6-b508-bbfbdd7e263c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converting VIF {"id": "6a2c8701-e54c-4ad6-b508-bbfbdd7e263c", "address": "fa:16:3e:ba:d3:c1", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a2c8701-e5", "ovs_interfaceid": "6a2c8701-e54c-4ad6-b508-bbfbdd7e263c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:d3:c1,bridge_name='br-int',has_traffic_filtering=True,id=6a2c8701-e54c-4ad6-b508-bbfbdd7e263c,network=Network(74933e47-dccc-47d3-8c5c-a355abc6d0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a2c8701-e5') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG os_vif [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:d3:c1,bridge_name='br-int',has_traffic_filtering=True,id=6a2c8701-e54c-4ad6-b508-bbfbdd7e263c,network=Network(74933e47-dccc-47d3-8c5c-a355abc6d0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a2c8701-e5') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c9684966-58dc-55f6-a389-a524b1e1682f', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a2c8701-e5, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a2c8701-e5, col_values=(('qos', UUID('d0c3b168-030b-4fb4-83ac-49a240756aad')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a2c8701-e5, col_values=(('external_ids', {'iface-id': '6a2c8701-e54c-4ad6-b508-bbfbdd7e263c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:d3:c1', 'vm-uuid': '60762562-adbd-4af6-8c0e-d6363a4111d2'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: INFO os_vif [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:d3:c1,bridge_name='br-int',has_traffic_filtering=True,id=6a2c8701-e54c-4ad6-b508-bbfbdd7e263c,network=Network(74933e47-dccc-47d3-8c5c-a355abc6d0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a2c8701-e5')
Nov 15 02:47:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539282742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539282742',id=20,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKza1whiTyjorzZVhyM5Da4n8+g8hKkFF6P0kflNEQ+1nL/QCauJlu23FgG5vnkGFXLe4gXIyZt4E7kXz1Lx1BPYqrYXAg8ZGX9DrYKxZncH5Sd0WgI2mhhpCQa/hbpklw==',key_name='tempest-keypair-1303500730',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70ba612613604fa38f1bb4ec29602cac',ramdisk_id='',reservation_id='r-edo4xu27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-408717637',owner_user_name='tempest-TaggedBootDevicesTest_v242-408717637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4380b18a109e458f9b08a5154dfd5d27',uuid=60762562-adbd-4af6-8c0e-d6363a4111d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b870665b-9254-4608-bd91-7aa46ed614d8", "address": "fa:16:3e:51:a0:67", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb870665b-92", "ovs_interfaceid": "b870665b-9254-4608-bd91-7aa46ed614d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converting VIF {"id": "b870665b-9254-4608-bd91-7aa46ed614d8", "address": "fa:16:3e:51:a0:67", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb870665b-92", "ovs_interfaceid": "b870665b-9254-4608-bd91-7aa46ed614d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:a0:67,bridge_name='br-int',has_traffic_filtering=True,id=b870665b-9254-4608-bd91-7aa46ed614d8,network=Network(74933e47-dccc-47d3-8c5c-a355abc6d0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb870665b-92') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG os_vif [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:a0:67,bridge_name='br-int',has_traffic_filtering=True,id=b870665b-9254-4608-bd91-7aa46ed614d8,network=Network(74933e47-dccc-47d3-8c5c-a355abc6d0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb870665b-92') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd301cbbd-bd34-549d-98e0-3de304757e2a', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb870665b-92, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb870665b-92, col_values=(('qos', UUID('75da5889-26ed-4601-b601-6ca1c52228a2')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb870665b-92, col_values=(('external_ids', {'iface-id': 'b870665b-9254-4608-bd91-7aa46ed614d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:a0:67', 'vm-uuid': '60762562-adbd-4af6-8c0e-d6363a4111d2'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: INFO os_vif [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:a0:67,bridge_name='br-int',has_traffic_filtering=True,id=b870665b-9254-4608-bd91-7aa46ed614d8,network=Network(74933e47-dccc-47d3-8c5c-a355abc6d0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb870665b-92')
Nov 15 02:47:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539282742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539282742',id=20,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKza1whiTyjorzZVhyM5Da4n8+g8hKkFF6P0kflNEQ+1nL/QCauJlu23FgG5vnkGFXLe4gXIyZt4E7kXz1Lx1BPYqrYXAg8ZGX9DrYKxZncH5Sd0WgI2mhhpCQa/hbpklw==',key_name='tempest-keypair-1303500730',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70ba612613604fa38f1bb4ec29602cac',ramdisk_id='',reservation_id='r-edo4xu27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-408717637',owner_user_name='tempest-TaggedBootDevicesTest_v242-408717637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4380b18a109e458f9b08a5154dfd5d27',uuid=60762562-adbd-4af6-8c0e-d6363a4111d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "973cfe4a-ca5b-463e-b8e1-3477e73b20fb", "address": "fa:16:3e:1a:d1:fc", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973cfe4a-ca", "ovs_interfaceid": "973cfe4a-ca5b-463e-b8e1-3477e73b20fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converting VIF {"id": "973cfe4a-ca5b-463e-b8e1-3477e73b20fb", "address": "fa:16:3e:1a:d1:fc", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973cfe4a-ca", "ovs_interfaceid": "973cfe4a-ca5b-463e-b8e1-3477e73b20fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:d1:fc,bridge_name='br-int',has_traffic_filtering=True,id=973cfe4a-ca5b-463e-b8e1-3477e73b20fb,network=Network(74933e47-dccc-47d3-8c5c-a355abc6d0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap973cfe4a-ca') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG os_vif [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:d1:fc,bridge_name='br-int',has_traffic_filtering=True,id=973cfe4a-ca5b-463e-b8e1-3477e73b20fb,network=Network(74933e47-dccc-47d3-8c5c-a355abc6d0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap973cfe4a-ca') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6ccac67-bc39-5c88-a3ab-431b0c596925', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap973cfe4a-ca, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap973cfe4a-ca, col_values=(('qos', UUID('ffa37f56-6fac-4fae-8213-582135e9c177')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap973cfe4a-ca, col_values=(('external_ids', {'iface-id': '973cfe4a-ca5b-463e-b8e1-3477e73b20fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:d1:fc', 'vm-uuid': '60762562-adbd-4af6-8c0e-d6363a4111d2'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: INFO os_vif [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:d1:fc,bridge_name='br-int',has_traffic_filtering=True,id=973cfe4a-ca5b-463e-b8e1-3477e73b20fb,network=Network(74933e47-dccc-47d3-8c5c-a355abc6d0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap973cfe4a-ca')
Nov 15 02:47:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539282742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539282742',id=20,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKza1whiTyjorzZVhyM5Da4n8+g8hKkFF6P0kflNEQ+1nL/QCauJlu23FgG5vnkGFXLe4gXIyZt4E7kXz1Lx1BPYqrYXAg8ZGX9DrYKxZncH5Sd0WgI2mhhpCQa/hbpklw==',key_name='tempest-keypair-1303500730',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70ba612613604fa38f1bb4ec29602cac',ramdisk_id='',reservation_id='r-edo4xu27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-408717637',owner_user_name='tempest-TaggedBootDevicesTest_v242-408717637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4380b18a109e458f9b08a5154dfd5d27',uuid=60762562-adbd-4af6-8c0e-d6363a4111d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2", "address": "fa:16:3e:fd:5f:e6", "network": {"id": "b2951d9f-4d4e-49b4-86db-e6d3b1460558", "bridge": "br-int", "label": "tempest-device-tagging-net2-258791214", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c79b81c-4b", "ovs_interfaceid": "4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converting VIF {"id": "4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2", "address": "fa:16:3e:fd:5f:e6", "network": {"id": "b2951d9f-4d4e-49b4-86db-e6d3b1460558", "bridge": "br-int", "label": "tempest-device-tagging-net2-258791214", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c79b81c-4b", "ovs_interfaceid": "4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:5f:e6,bridge_name='br-int',has_traffic_filtering=True,id=4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2,network=Network(b2951d9f-4d4e-49b4-86db-e6d3b1460558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c79b81c-4b') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG os_vif [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:5f:e6,bridge_name='br-int',has_traffic_filtering=True,id=4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2,network=Network(b2951d9f-4d4e-49b4-86db-e6d3b1460558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c79b81c-4b') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2e51a3c4-3fc6-59fb-aebe-994e5357e94e', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c79b81c-4b, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c79b81c-4b, col_values=(('qos', UUID('a4d45eae-0078-4dbc-83a1-e6c9920d3350')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c79b81c-4b, col_values=(('external_ids', {'iface-id': '4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:5f:e6', 'vm-uuid': '60762562-adbd-4af6-8c0e-d6363a4111d2'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: INFO os_vif [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:5f:e6,bridge_name='br-int',has_traffic_filtering=True,id=4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2,network=Network(b2951d9f-4d4e-49b4-86db-e6d3b1460558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c79b81c-4b')
Nov 15 02:47:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539282742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539282742',id=20,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKza1whiTyjorzZVhyM5Da4n8+g8hKkFF6P0kflNEQ+1nL/QCauJlu23FgG5vnkGFXLe4gXIyZt4E7kXz1Lx1BPYqrYXAg8ZGX9DrYKxZncH5Sd0WgI2mhhpCQa/hbpklw==',key_name='tempest-keypair-1303500730',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70ba612613604fa38f1bb4ec29602cac',ramdisk_id='',reservation_id='r-edo4xu27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-408717637',owner_user_name='tempest-TaggedBootDevicesTest_v242-408717637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4380b18a109e458f9b08a5154dfd5d27',uuid=60762562-adbd-4af6-8c0e-d6363a4111d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d91f58e8-8742-4077-9536-9e7f4cf22a8c", "address": "fa:16:3e:1a:e8:a6", "network": {"id": "b2951d9f-4d4e-49b4-86db-e6d3b1460558", "bridge": "br-int", "label": "tempest-device-tagging-net2-258791214", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd91f58e8-87", "ovs_interfaceid": "d91f58e8-8742-4077-9536-9e7f4cf22a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converting VIF {"id": "d91f58e8-8742-4077-9536-9e7f4cf22a8c", "address": "fa:16:3e:1a:e8:a6", "network": {"id": "b2951d9f-4d4e-49b4-86db-e6d3b1460558", "bridge": "br-int", "label": "tempest-device-tagging-net2-258791214", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd91f58e8-87", "ovs_interfaceid": "d91f58e8-8742-4077-9536-9e7f4cf22a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:e8:a6,bridge_name='br-int',has_traffic_filtering=True,id=d91f58e8-8742-4077-9536-9e7f4cf22a8c,network=Network(b2951d9f-4d4e-49b4-86db-e6d3b1460558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd91f58e8-87') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG os_vif [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:e8:a6,bridge_name='br-int',has_traffic_filtering=True,id=d91f58e8-8742-4077-9536-9e7f4cf22a8c,network=Network(b2951d9f-4d4e-49b4-86db-e6d3b1460558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd91f58e8-87') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15452054-83c3-532f-b7bb-876a7f00d3a5', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG nova.network.neutron [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Port c9643afc-4454-4d29-b8a2-5422753857b0 binding to destination host user is already ACTIVE {{(pid=75391) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "refresh_cache-ebb7e616-3c05-4d99-a0b3-76dc1723e82d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquired lock "refresh_cache-ebb7e616-3c05-4d99-a0b3-76dc1723e82d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG nova.network.neutron [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd91f58e8-87, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd91f58e8-87, col_values=(('qos', UUID('9b435c20-2cf4-4ab6-95f1-a55394a97d99')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd91f58e8-87, col_values=(('external_ids', {'iface-id': 'd91f58e8-8742-4077-9536-9e7f4cf22a8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:e8:a6', 'vm-uuid': '60762562-adbd-4af6-8c0e-d6363a4111d2'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:39 user nova-compute[75391]: INFO os_vif [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:e8:a6,bridge_name='br-int',has_traffic_filtering=True,id=d91f58e8-8742-4077-9536-9e7f4cf22a8c,network=Network(b2951d9f-4d4e-49b4-86db-e6d3b1460558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd91f58e8-87')
Nov 15 02:47:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] No BDM found with device name hda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] No VIF found with MAC fa:16:3e:11:89:27, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] No VIF found with MAC fa:16:3e:1a:d1:fc, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:47:39 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Using config drive
Nov 15 02:47:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG nova.objects.instance [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'flavor' on Instance uuid da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:47:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:40 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Creating config drive at /opt/stack/data/nova/instances/60762562-adbd-4af6-8c0e-d6363a4111d2/disk.config
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/60762562-adbd-4af6-8c0e-d6363a4111d2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfto4q3h2 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG nova.network.neutron [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Updating instance_info_cache with network_info: [{"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/60762562-adbd-4af6-8c0e-d6363a4111d2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfto4q3h2" returned: 0 in 0.063s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Releasing lock "refresh_cache-ebb7e616-3c05-4d99-a0b3-76dc1723e82d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Creating tmpfile /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/tmpjz7p8cwe to verify with other compute node that the instance is on the same shared storage. {{(pid=75391) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:40 user nova-compute[75391]: INFO nova.compute.manager [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Attaching volume 48cae43a-b3bd-4e69-b14c-d2104d2065c8 to /dev/vdb
Nov 15 02:47:40 user nova-compute[75391]: DEBUG os_brick.utils [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a51bf93-ad58-4370-93b4-fcb6c0d43522]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[499f63d1-bb68-4944-8480-04355840912a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[84724920-85a6-43c4-8248-421e77413f49]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e16ba53-89da-400a-a834-d003eab8dfaa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:47:40 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb080265-2043-4665-932f-4f165725ffef]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG os_brick.utils [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Updating existing volume attachment record: 99c42c94-0b92-4310-b379-36ce081d2169 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG nova.compute.manager [req-10e3f5ee-6fd7-4916-9cd1-e07dcb9c4e36 req-246203d9-61e2-4fca-a3e2-03635c6da50b service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Received event network-vif-unplugged-c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-10e3f5ee-6fd7-4916-9cd1-e07dcb9c4e36 req-246203d9-61e2-4fca-a3e2-03635c6da50b service nova] Acquiring lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-10e3f5ee-6fd7-4916-9cd1-e07dcb9c4e36 req-246203d9-61e2-4fca-a3e2-03635c6da50b service nova] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-10e3f5ee-6fd7-4916-9cd1-e07dcb9c4e36 req-246203d9-61e2-4fca-a3e2-03635c6da50b service nova] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG nova.compute.manager [req-10e3f5ee-6fd7-4916-9cd1-e07dcb9c4e36 req-246203d9-61e2-4fca-a3e2-03635c6da50b service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] No waiting events found dispatching network-vif-unplugged-c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:40 user nova-compute[75391]: WARNING nova.compute.manager [req-10e3f5ee-6fd7-4916-9cd1-e07dcb9c4e36 req-246203d9-61e2-4fca-a3e2-03635c6da50b service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Received unexpected event network-vif-unplugged-c9643afc-4454-4d29-b8a2-5422753857b0 for instance with vm_state resized and task_state resize_reverting.
Nov 15 02:47:40 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JajWuoHZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:47:40 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:47:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:47:40 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:47:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:47:40 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ab15dd-fd69-4ddf-8fec-0b99dfd34b5c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:47:40 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[03008d53-f674-43fc-8529-b8901ebdc4ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea] added
Nov 15 02:47:40 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac0272c-1a30-417c-bcaa-d92a15462bb5]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Skipping network cache update for instance because it is Building. {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[99862121-fb74-401d-9c4d-7e55357b0525]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JajWuoHZ {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JajWuoHZ" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec2a225-7cc9-4542-9b6e-849bbc94edc4]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JajWuoHZ'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be51b65-1a8e-4a0a-a253-a2edbf99650c]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-9744c8a1-046e-4a00-92e0-92ebb3275ea9" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-9744c8a1-046e-4a00-92e0-92ebb3275ea9" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lazy-loading 'info_cache' on Instance uuid 9744c8a1-046e-4a00-92e0-92ebb3275ea9 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d9a688-01e7-4377-9982-b6272e1621f2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:40 user nova-compute[75391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:47:40 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:40 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:47:40 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:47:40 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:40 user nova-compute[75391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:47:40 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:40 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:47:40 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:47:40 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b3b9d0-ced5-4df5-b8bd-58237ea2e275]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea, portal: 172.16.0.220,3260]
Nov 15 02:47:40 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea, portal: 172.16.0.220,3260] successful.
Nov 15 02:47:40 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0a5051-8ad8-44e8-82d1-450994404182]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e62e38-b7df-4603-8bb8-92ffc1ab23f9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:40 user nova-compute[75391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:47:40 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:40 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:47:40 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:47:40 user nova-compute[75391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:47:40 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:40 user nova-compute[75391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:47:40 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:40 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:47:40 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:47:40 user nova-compute[75391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:47:40 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] HCTL ('38', '-', '-', 0) found on session 24 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:47:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1b676a-c8d7-43f2-9f71-1d0be10b92b3]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:41 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Searching for a device in session 24 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:47:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JajWuoHZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:47:41 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Updating instance_info_cache with network_info: [{"id": "dc4f904f-dd76-4f25-b9e6-41cc42493911", "address": "fa:16:3e:e6:ec:c3", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4f904f-dd", "ovs_interfaceid": "dc4f904f-dd76-4f25-b9e6-41cc42493911", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:47:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-9744c8a1-046e-4a00-92e0-92ebb3275ea9" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:47:41 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 02:47:41 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:47:41 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Cleaning up deleted instances {{(pid=75391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 02:47:41 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] There are 0 instances to clean {{(pid=75391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 02:47:41 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Instance destroyed successfully.
Nov 15 02:47:41 user nova-compute[75391]: DEBUG nova.objects.instance [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lazy-loading 'resources' on Instance uuid ebb7e616-3c05-4d99-a0b3-76dc1723e82d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:47:41 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-689614808',display_name='tempest-ServerActionsTestOtherB-server-689614808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-689614808',id=2,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2usIoDVXl+b9hE3o9jGzEYasMoeupEZWjgdC34QhkyFhqHaktIVO5IuSwbU0DElzd5MkeVTBrP68npXS/361ypXFAC7mDzbXraFDprW+Txm/mxv6ZY7FykX6U+2H5j7A==',key_name='tempest-keypair-1921719925',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:46:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dfefdbf9f31b47d4a76d8fb06414eb5a',ramdisk_id='',reservation_id='r-qacecpst',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-5763420',owner_user_name='tempest-ServerActionsTestOtherB-5763420-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:46:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34b23ed566024cc3a90f97206ea8162d',uuid=ebb7e616-3c05-4d99-a0b3-76dc1723e82d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:47:41 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Converting VIF {"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:47:41 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:35:a3,bridge_name='br-int',has_traffic_filtering=True,id=c9643afc-4454-4d29-b8a2-5422753857b0,network=Network(db549bf7-e039-4ea4-ac62-b5c090652e6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9643afc-44') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:47:41 user nova-compute[75391]: DEBUG os_vif [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:35:a3,bridge_name='br-int',has_traffic_filtering=True,id=c9643afc-4454-4d29-b8a2-5422753857b0,network=Network(db549bf7-e039-4ea4-ac62-b5c090652e6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9643afc-44') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:47:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9643afc-44, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:47:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd09968a-b26e-46bc-bd24-013d24cc825d) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:47:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:41 user nova-compute[75391]: INFO os_vif [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:35:a3,bridge_name='br-int',has_traffic_filtering=True,id=c9643afc-4454-4d29-b8a2-5422753857b0,network=Network(db549bf7-e039-4ea4-ac62-b5c090652e6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9643afc-44')
Nov 15 02:47:41 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:47:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dfGrvENV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:47:41 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:47:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:47:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23965613136346531', 'path': '/dev/sdg'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965613136346531', 'path': '/dev/sdg'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.309s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ff2fb0-292b-4e98-9afe-efcac0fec8d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:47:42 user nova-compute[75391]: No targets found.
Nov 15 02:47:42 user nova-compute[75391]: iSNS:
Nov 15 02:47:42 user nova-compute[75391]: No targets found.
Nov 15 02:47:42 user nova-compute[75391]: STATIC:
Nov 15 02:47:42 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18
Nov 15 02:47:42 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:47:42 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:47:42 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103
Nov 15 02:47:42 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:47:42 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:47:42 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a
Nov 15 02:47:42 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:47:42 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:47:42 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:47:42 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:47:42 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:47:42 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4
Nov 15 02:47:42 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:47:42 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:47:42 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea
Nov 15 02:47:42 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:47:42 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:47:42 user nova-compute[75391]: FIRMWARE:
Nov 15 02:47:42 user nova-compute[75391]: No targets found.
Nov 15 02:47:42 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:47:42 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:47:42 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fb02f8-cfc8-44db-9cac-8e7d03945fb2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG nova.objects.instance [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lazy-loading 'flavor' on Instance uuid a4171d96-bb26-473f-a322-178dadbaab0a {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[454d0822-dc58-4f32-88c5-e34b96903117]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:42 user nova-compute[75391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:47:42 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:42 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:47:42 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:47:42 user nova-compute[75391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:47:42 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:42 user nova-compute[75391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:47:42 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:42 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:47:42 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:47:42 user nova-compute[75391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:47:42 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6244759c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a'): ({'sdc'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Removing single pathed devices sdc {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 02:47:42 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:47:42 user nova-compute[75391]:   <source dev="/dev/sdg"/>
Nov 15 02:47:42 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:47:42 user nova-compute[75391]:   <serial>400f1ca0-2998-4527-83c4-829f0cbe09ea</serial>
Nov 15 02:47:42 user nova-compute[75391]: </disk>
Nov 15 02:47:42 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da2455d-4db2-4782-bf2d-e41ff7891345]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[877a0f44-36f1-4e93-9040-a610093ba364]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Flushing IO for device /dev/sdc {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f7a67f-3e62-4329-8129-61ace9a87e80]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2f2765-ef45-40d0-95a6-d369d31a629b]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] SCSI volumes sdc have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a6f216-630b-48d3-98c7-5d9ef988a473]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fbb819-c4d5-4271-93e0-95c023848378]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a, portal: 172.16.0.220,3260]
Nov 15 02:47:42 user nova-compute[75391]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a, portal: 172.16.0.220,3260] successful.
Nov 15 02:47:42 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e669cb05-6aca-49d7-83ce-5fc8122bbb6c]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] <== disconnect_volume: return (720ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG nova.compute.manager [req-35c05b24-deda-4e53-b671-10a0cf634f9c req-2657d1d1-865c-4ec1-96e9-0a7b30be197a service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-plugged-d42541b2-a63d-470b-88ff-078657735d0a {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-35c05b24-deda-4e53-b671-10a0cf634f9c req-2657d1d1-865c-4ec1-96e9-0a7b30be197a service nova] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-35c05b24-deda-4e53-b671-10a0cf634f9c req-2657d1d1-865c-4ec1-96e9-0a7b30be197a service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-35c05b24-deda-4e53-b671-10a0cf634f9c req-2657d1d1-865c-4ec1-96e9-0a7b30be197a service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG nova.compute.manager [req-35c05b24-deda-4e53-b671-10a0cf634f9c req-2657d1d1-865c-4ec1-96e9-0a7b30be197a service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] No waiting events found dispatching network-vif-plugged-d42541b2-a63d-470b-88ff-078657735d0a {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:42 user nova-compute[75391]: WARNING nova.compute.manager [req-35c05b24-deda-4e53-b671-10a0cf634f9c req-2657d1d1-865c-4ec1-96e9-0a7b30be197a service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received unexpected event network-vif-plugged-d42541b2-a63d-470b-88ff-078657735d0a for instance with vm_state building and task_state spawning.
Nov 15 02:47:42 user nova-compute[75391]: DEBUG nova.compute.manager [req-bb28d862-b0fc-4923-9a8b-a90428428cc7 req-7df77192-7e82-45ac-bd02-4b1c68561bb0 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Received event network-vif-plugged-c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bb28d862-b0fc-4923-9a8b-a90428428cc7 req-7df77192-7e82-45ac-bd02-4b1c68561bb0 service nova] Acquiring lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bb28d862-b0fc-4923-9a8b-a90428428cc7 req-7df77192-7e82-45ac-bd02-4b1c68561bb0 service nova] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bb28d862-b0fc-4923-9a8b-a90428428cc7 req-7df77192-7e82-45ac-bd02-4b1c68561bb0 service nova] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG nova.compute.manager [req-bb28d862-b0fc-4923-9a8b-a90428428cc7 req-7df77192-7e82-45ac-bd02-4b1c68561bb0 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] No waiting events found dispatching network-vif-plugged-c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:42 user nova-compute[75391]: WARNING nova.compute.manager [req-bb28d862-b0fc-4923-9a8b-a90428428cc7 req-7df77192-7e82-45ac-bd02-4b1c68561bb0 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Received unexpected event network-vif-plugged-c9643afc-4454-4d29-b8a2-5422753857b0 for instance with vm_state resized and task_state resize_reverting.
Nov 15 02:47:42 user nova-compute[75391]: DEBUG nova.compute.manager [req-bb28d862-b0fc-4923-9a8b-a90428428cc7 req-7df77192-7e82-45ac-bd02-4b1c68561bb0 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-plugged-59301df7-815a-4047-b6e2-190a0e80b4d4 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bb28d862-b0fc-4923-9a8b-a90428428cc7 req-7df77192-7e82-45ac-bd02-4b1c68561bb0 service nova] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bb28d862-b0fc-4923-9a8b-a90428428cc7 req-7df77192-7e82-45ac-bd02-4b1c68561bb0 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bb28d862-b0fc-4923-9a8b-a90428428cc7 req-7df77192-7e82-45ac-bd02-4b1c68561bb0 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG nova.compute.manager [req-bb28d862-b0fc-4923-9a8b-a90428428cc7 req-7df77192-7e82-45ac-bd02-4b1c68561bb0 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] No waiting events found dispatching network-vif-plugged-59301df7-815a-4047-b6e2-190a0e80b4d4 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:42 user nova-compute[75391]: WARNING nova.compute.manager [req-bb28d862-b0fc-4923-9a8b-a90428428cc7 req-7df77192-7e82-45ac-bd02-4b1c68561bb0 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received unexpected event network-vif-plugged-59301df7-815a-4047-b6e2-190a0e80b4d4 for instance with vm_state building and task_state spawning.
Nov 15 02:47:42 user nova-compute[75391]: DEBUG nova.compute.manager [req-bb28d862-b0fc-4923-9a8b-a90428428cc7 req-7df77192-7e82-45ac-bd02-4b1c68561bb0 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-plugged-59301df7-815a-4047-b6e2-190a0e80b4d4 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bb28d862-b0fc-4923-9a8b-a90428428cc7 req-7df77192-7e82-45ac-bd02-4b1c68561bb0 service nova] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bb28d862-b0fc-4923-9a8b-a90428428cc7 req-7df77192-7e82-45ac-bd02-4b1c68561bb0 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bb28d862-b0fc-4923-9a8b-a90428428cc7 req-7df77192-7e82-45ac-bd02-4b1c68561bb0 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG nova.compute.manager [req-bb28d862-b0fc-4923-9a8b-a90428428cc7 req-7df77192-7e82-45ac-bd02-4b1c68561bb0 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] No waiting events found dispatching network-vif-plugged-59301df7-815a-4047-b6e2-190a0e80b4d4 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:42 user nova-compute[75391]: WARNING nova.compute.manager [req-bb28d862-b0fc-4923-9a8b-a90428428cc7 req-7df77192-7e82-45ac-bd02-4b1c68561bb0 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received unexpected event network-vif-plugged-59301df7-815a-4047-b6e2-190a0e80b4d4 for instance with vm_state building and task_state spawning.
Nov 15 02:47:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] No VIF found with MAC fa:16:3e:5b:49:f4, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-341c7ce5-956c-4520-93ec-4e15c8c16560 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "a4171d96-bb26-473f-a322-178dadbaab0a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.485s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:43 user nova-compute[75391]: DEBUG nova.objects.instance [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lazy-loading 'migration_context' on Instance uuid ebb7e616-3c05-4d99-a0b3-76dc1723e82d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:47:43 user nova-compute[75391]: DEBUG nova.objects.base [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Object Instance<ebb7e616-3c05-4d99-a0b3-76dc1723e82d> lazy-loaded attributes: resources,migration_context {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:47:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:43 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:47:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.782s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:44 user nova-compute[75391]: INFO nova.compute.manager [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Rebuilding instance
Nov 15 02:47:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG nova.compute.manager [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:47:44 user nova-compute[75391]: INFO nova.compute.manager [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Swapping old allocation on dict_keys(['fa8a32f4-c234-4e10-a8fe-db43b3c4c62e']) held by migration a73f9925-ea9d-478b-b203-b2a81800f8b9 for instance
Nov 15 02:47:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Overwriting current allocation {'allocations': {'fa8a32f4-c234-4e10-a8fe-db43b3c4c62e': {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}, 'generation': 24}}, 'project_id': 'dfefdbf9f31b47d4a76d8fb06414eb5a', 'user_id': '34b23ed566024cc3a90f97206ea8162d', 'consumer_generation': 1} on consumer ebb7e616-3c05-4d99-a0b3-76dc1723e82d {{(pid=75391) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-0f209f50-8fae-4b69-960b-e57cfe2f8123 req-80bfdd5f-62fa-4a5b-8286-b9a76eca962a service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-plugged-d42541b2-a63d-470b-88ff-078657735d0a {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0f209f50-8fae-4b69-960b-e57cfe2f8123 req-80bfdd5f-62fa-4a5b-8286-b9a76eca962a service nova] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0f209f50-8fae-4b69-960b-e57cfe2f8123 req-80bfdd5f-62fa-4a5b-8286-b9a76eca962a service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0f209f50-8fae-4b69-960b-e57cfe2f8123 req-80bfdd5f-62fa-4a5b-8286-b9a76eca962a service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-0f209f50-8fae-4b69-960b-e57cfe2f8123 req-80bfdd5f-62fa-4a5b-8286-b9a76eca962a service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] No waiting events found dispatching network-vif-plugged-d42541b2-a63d-470b-88ff-078657735d0a {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:44 user nova-compute[75391]: WARNING nova.compute.manager [req-0f209f50-8fae-4b69-960b-e57cfe2f8123 req-80bfdd5f-62fa-4a5b-8286-b9a76eca962a service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received unexpected event network-vif-plugged-d42541b2-a63d-470b-88ff-078657735d0a for instance with vm_state building and task_state spawning.
Nov 15 02:47:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-0f209f50-8fae-4b69-960b-e57cfe2f8123 req-80bfdd5f-62fa-4a5b-8286-b9a76eca962a service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-plugged-b870665b-9254-4608-bd91-7aa46ed614d8 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0f209f50-8fae-4b69-960b-e57cfe2f8123 req-80bfdd5f-62fa-4a5b-8286-b9a76eca962a service nova] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0f209f50-8fae-4b69-960b-e57cfe2f8123 req-80bfdd5f-62fa-4a5b-8286-b9a76eca962a service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0f209f50-8fae-4b69-960b-e57cfe2f8123 req-80bfdd5f-62fa-4a5b-8286-b9a76eca962a service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-0f209f50-8fae-4b69-960b-e57cfe2f8123 req-80bfdd5f-62fa-4a5b-8286-b9a76eca962a service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] No waiting events found dispatching network-vif-plugged-b870665b-9254-4608-bd91-7aa46ed614d8 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:44 user nova-compute[75391]: WARNING nova.compute.manager [req-0f209f50-8fae-4b69-960b-e57cfe2f8123 req-80bfdd5f-62fa-4a5b-8286-b9a76eca962a service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received unexpected event network-vif-plugged-b870665b-9254-4608-bd91-7aa46ed614d8 for instance with vm_state building and task_state spawning.
Nov 15 02:47:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-0f209f50-8fae-4b69-960b-e57cfe2f8123 req-80bfdd5f-62fa-4a5b-8286-b9a76eca962a service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-plugged-b870665b-9254-4608-bd91-7aa46ed614d8 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0f209f50-8fae-4b69-960b-e57cfe2f8123 req-80bfdd5f-62fa-4a5b-8286-b9a76eca962a service nova] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0f209f50-8fae-4b69-960b-e57cfe2f8123 req-80bfdd5f-62fa-4a5b-8286-b9a76eca962a service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0f209f50-8fae-4b69-960b-e57cfe2f8123 req-80bfdd5f-62fa-4a5b-8286-b9a76eca962a service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-0f209f50-8fae-4b69-960b-e57cfe2f8123 req-80bfdd5f-62fa-4a5b-8286-b9a76eca962a service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] No waiting events found dispatching network-vif-plugged-b870665b-9254-4608-bd91-7aa46ed614d8 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:44 user nova-compute[75391]: WARNING nova.compute.manager [req-0f209f50-8fae-4b69-960b-e57cfe2f8123 req-80bfdd5f-62fa-4a5b-8286-b9a76eca962a service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received unexpected event network-vif-plugged-b870665b-9254-4608-bd91-7aa46ed614d8 for instance with vm_state building and task_state spawning.
Nov 15 02:47:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-0f209f50-8fae-4b69-960b-e57cfe2f8123 req-80bfdd5f-62fa-4a5b-8286-b9a76eca962a service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-plugged-973cfe4a-ca5b-463e-b8e1-3477e73b20fb {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0f209f50-8fae-4b69-960b-e57cfe2f8123 req-80bfdd5f-62fa-4a5b-8286-b9a76eca962a service nova] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0f209f50-8fae-4b69-960b-e57cfe2f8123 req-80bfdd5f-62fa-4a5b-8286-b9a76eca962a service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0f209f50-8fae-4b69-960b-e57cfe2f8123 req-80bfdd5f-62fa-4a5b-8286-b9a76eca962a service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-0f209f50-8fae-4b69-960b-e57cfe2f8123 req-80bfdd5f-62fa-4a5b-8286-b9a76eca962a service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] No waiting events found dispatching network-vif-plugged-973cfe4a-ca5b-463e-b8e1-3477e73b20fb {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:44 user nova-compute[75391]: WARNING nova.compute.manager [req-0f209f50-8fae-4b69-960b-e57cfe2f8123 req-80bfdd5f-62fa-4a5b-8286-b9a76eca962a service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received unexpected event network-vif-plugged-973cfe4a-ca5b-463e-b8e1-3477e73b20fb for instance with vm_state building and task_state spawning.
Nov 15 02:47:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-9ac8a28a-dd26-4a59-81e1-239859ad27cb req-39f1287a-7324-41bd-afad-c3c723414369 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-plugged-6a2c8701-e54c-4ad6-b508-bbfbdd7e263c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9ac8a28a-dd26-4a59-81e1-239859ad27cb req-39f1287a-7324-41bd-afad-c3c723414369 service nova] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9ac8a28a-dd26-4a59-81e1-239859ad27cb req-39f1287a-7324-41bd-afad-c3c723414369 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9ac8a28a-dd26-4a59-81e1-239859ad27cb req-39f1287a-7324-41bd-afad-c3c723414369 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-9ac8a28a-dd26-4a59-81e1-239859ad27cb req-39f1287a-7324-41bd-afad-c3c723414369 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] No waiting events found dispatching network-vif-plugged-6a2c8701-e54c-4ad6-b508-bbfbdd7e263c {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:44 user nova-compute[75391]: WARNING nova.compute.manager [req-9ac8a28a-dd26-4a59-81e1-239859ad27cb req-39f1287a-7324-41bd-afad-c3c723414369 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received unexpected event network-vif-plugged-6a2c8701-e54c-4ad6-b508-bbfbdd7e263c for instance with vm_state building and task_state spawning.
Nov 15 02:47:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-9ac8a28a-dd26-4a59-81e1-239859ad27cb req-39f1287a-7324-41bd-afad-c3c723414369 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-plugged-6a2c8701-e54c-4ad6-b508-bbfbdd7e263c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9ac8a28a-dd26-4a59-81e1-239859ad27cb req-39f1287a-7324-41bd-afad-c3c723414369 service nova] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9ac8a28a-dd26-4a59-81e1-239859ad27cb req-39f1287a-7324-41bd-afad-c3c723414369 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9ac8a28a-dd26-4a59-81e1-239859ad27cb req-39f1287a-7324-41bd-afad-c3c723414369 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-9ac8a28a-dd26-4a59-81e1-239859ad27cb req-39f1287a-7324-41bd-afad-c3c723414369 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] No waiting events found dispatching network-vif-plugged-6a2c8701-e54c-4ad6-b508-bbfbdd7e263c {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:44 user nova-compute[75391]: WARNING nova.compute.manager [req-9ac8a28a-dd26-4a59-81e1-239859ad27cb req-39f1287a-7324-41bd-afad-c3c723414369 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received unexpected event network-vif-plugged-6a2c8701-e54c-4ad6-b508-bbfbdd7e263c for instance with vm_state building and task_state spawning.
Nov 15 02:47:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-9ac8a28a-dd26-4a59-81e1-239859ad27cb req-39f1287a-7324-41bd-afad-c3c723414369 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-plugged-4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9ac8a28a-dd26-4a59-81e1-239859ad27cb req-39f1287a-7324-41bd-afad-c3c723414369 service nova] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9ac8a28a-dd26-4a59-81e1-239859ad27cb req-39f1287a-7324-41bd-afad-c3c723414369 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9ac8a28a-dd26-4a59-81e1-239859ad27cb req-39f1287a-7324-41bd-afad-c3c723414369 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-9ac8a28a-dd26-4a59-81e1-239859ad27cb req-39f1287a-7324-41bd-afad-c3c723414369 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] No waiting events found dispatching network-vif-plugged-4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:44 user nova-compute[75391]: WARNING nova.compute.manager [req-9ac8a28a-dd26-4a59-81e1-239859ad27cb req-39f1287a-7324-41bd-afad-c3c723414369 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received unexpected event network-vif-plugged-4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2 for instance with vm_state building and task_state spawning.
Nov 15 02:47:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "refresh_cache-ebb7e616-3c05-4d99-a0b3-76dc1723e82d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquired lock "refresh_cache-ebb7e616-3c05-4d99-a0b3-76dc1723e82d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG nova.network.neutron [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:45 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Instance destroyed successfully.
Nov 15 02:47:45 user nova-compute[75391]: INFO nova.compute.manager [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Detaching volume 400f1ca0-2998-4527-83c4-829f0cbe09ea
Nov 15 02:47:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:45 user nova-compute[75391]: INFO nova.virt.block_device [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Attempting to driver detach volume 400f1ca0-2998-4527-83c4-829f0cbe09ea from mountpoint /dev/vdb
Nov 15 02:47:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Attempting to detach device vdb from instance a4171d96-bb26-473f-a322-178dadbaab0a from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:47:45 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:47:45 user nova-compute[75391]:   <source dev="/dev/sdg"/>
Nov 15 02:47:45 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:47:45 user nova-compute[75391]:   <serial>400f1ca0-2998-4527-83c4-829f0cbe09ea</serial>
Nov 15 02:47:45 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:47:45 user nova-compute[75391]: </disk>
Nov 15 02:47:45 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG nova.network.neutron [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Updating instance_info_cache with network_info: [{"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:47:45 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Successfully detached device vdb from instance a4171d96-bb26-473f-a322-178dadbaab0a from the persistent domain config.
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Releasing lock "refresh_cache-ebb7e616-3c05-4d99-a0b3-76dc1723e82d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG os_brick.utils [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JajWuoHZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:47:45 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 02:47:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b182806c-9096-47d0-b3ed-a81cfbd35093]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9205ee-4ed4-4657-803c-d586918556df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:47:45 user nova-compute[75391]: No targets found.
Nov 15 02:47:45 user nova-compute[75391]: iSNS:
Nov 15 02:47:45 user nova-compute[75391]: No targets found.
Nov 15 02:47:45 user nova-compute[75391]: STATIC:
Nov 15 02:47:45 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18
Nov 15 02:47:45 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:47:45 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:47:45 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103
Nov 15 02:47:45 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:47:45 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:47:45 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:47:45 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:47:45 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:47:45 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4
Nov 15 02:47:45 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:47:45 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:47:45 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea
Nov 15 02:47:45 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:47:45 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:47:45 user nova-compute[75391]: FIRMWARE:
Nov 15 02:47:45 user nova-compute[75391]: No targets found.
Nov 15 02:47:45 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:47:45 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:47:45 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1aec873-dca9-43d6-b67b-1f63b9b3ac64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbb457b-0450-4211-8171-e78aea9d3467]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf1922b-ee6a-4f6d-a0f0-f9360e9003cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ca44ff-7d1f-468d-940e-ca2661add6a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[48130dc6-4d9d-497e-b35d-c4f4abc78800]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:45 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:45 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:47:45 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:47:45 user nova-compute[75391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:47:45 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:45 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:45 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:47:45 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:47:45 user nova-compute[75391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:47:45 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f623c138790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea'): ({'sdg'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Removing single pathed devices sdg {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:47:45 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3983e33e-25d7-4316-9ecf-2a6e249b6f12]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG os_brick.utils [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[447bb685-e06d-4e10-a674-1be3f65ccf4a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8ecc2f-89dc-4e3a-b846-dcd322c81179]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Flushing IO for device /dev/sdg {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee23fc3b-2150-401b-8417-e5ecf75cb947]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.053s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb00d94-8ea7-4929-9c84-58e3b743d4a4]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] SCSI volumes sdg have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[553fcc4a-9cd1-441e-8a55-8abc1b29c8d2]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[db381f76-5e27-4ebd-a4cd-9df97abeb744]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea, portal: 172.16.0.220,3260]
Nov 15 02:47:46 user nova-compute[75391]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea, portal: 172.16.0.220,3260] successful.
Nov 15 02:47:46 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[99569e15-f07e-44cd-aff9-054cc3e49067]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] <== disconnect_volume: return (398ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GxWsSnDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:47:46 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:47:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:47:46 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:47:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:47:46 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e4f813-63e3-4b89-a7b2-3bc978f0f613]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:47:46 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[939ffd84-e528-4e26-8c2f-b1c36f17fa86]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8] added
Nov 15 02:47:46 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8dc5d83-868f-4d2c-866e-5e6d29fcb7a6]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23e864a-7b4e-44c2-ac1d-866d9a68d562]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GxWsSnDQ {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GxWsSnDQ" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[670ac195-e3a1-4cce-a739-f17419ff65aa]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GxWsSnDQ'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[67744d90-f633-4967-a3d1-15b760aa8504]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[983fd375-4734-486d-b24d-96e50a004a0d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:46 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:46 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:47:46 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:47:46 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:46 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:46 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:47:46 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:47:46 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[70af98df-3d2b-4e1d-ac3a-f93c78189a9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8, portal: 172.16.0.220,3260]
Nov 15 02:47:46 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8, portal: 172.16.0.220,3260] successful.
Nov 15 02:47:46 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6060b05c-a212-43ae-b610-5e44212b3f0d]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f412747-2e85-4012-83f5-35370142c05a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:46 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:46 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:47:46 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:47:46 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:47:46 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:46 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:46 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:47:46 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:47:46 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:47:46 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-5981f1ca-82c5-4b67-a6d8-2d8abf135fb8 req-ededc032-d071-43f9-815b-9a689bec3fe5 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-plugged-4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5981f1ca-82c5-4b67-a6d8-2d8abf135fb8 req-ededc032-d071-43f9-815b-9a689bec3fe5 service nova] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5981f1ca-82c5-4b67-a6d8-2d8abf135fb8 req-ededc032-d071-43f9-815b-9a689bec3fe5 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5981f1ca-82c5-4b67-a6d8-2d8abf135fb8 req-ededc032-d071-43f9-815b-9a689bec3fe5 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-5981f1ca-82c5-4b67-a6d8-2d8abf135fb8 req-ededc032-d071-43f9-815b-9a689bec3fe5 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] No waiting events found dispatching network-vif-plugged-4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:46 user nova-compute[75391]: WARNING nova.compute.manager [req-5981f1ca-82c5-4b67-a6d8-2d8abf135fb8 req-ededc032-d071-43f9-815b-9a689bec3fe5 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received unexpected event network-vif-plugged-4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2 for instance with vm_state building and task_state spawning.
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1288ad-5431-46a6-b803-bc828a439f5d]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GxWsSnDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-plugged-973cfe4a-ca5b-463e-b8e1-3477e73b20fb {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] No waiting events found dispatching network-vif-plugged-973cfe4a-ca5b-463e-b8e1-3477e73b20fb {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:46 user nova-compute[75391]: WARNING nova.compute.manager [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received unexpected event network-vif-plugged-973cfe4a-ca5b-463e-b8e1-3477e73b20fb for instance with vm_state building and task_state spawning.
Nov 15 02:47:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-plugged-d91f58e8-8742-4077-9536-9e7f4cf22a8c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] No waiting events found dispatching network-vif-plugged-d91f58e8-8742-4077-9536-9e7f4cf22a8c {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:46 user nova-compute[75391]: WARNING nova.compute.manager [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received unexpected event network-vif-plugged-d91f58e8-8742-4077-9536-9e7f4cf22a8c for instance with vm_state building and task_state spawning.
Nov 15 02:47:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-plugged-d91f58e8-8742-4077-9536-9e7f4cf22a8c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] No waiting events found dispatching network-vif-plugged-d91f58e8-8742-4077-9536-9e7f4cf22a8c {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:46 user nova-compute[75391]: WARNING nova.compute.manager [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received unexpected event network-vif-plugged-d91f58e8-8742-4077-9536-9e7f4cf22a8c for instance with vm_state building and task_state spawning.
Nov 15 02:47:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Received event network-vif-unplugged-2a223503-a5c6-4851-b555-f4b3c9ce26bf {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] Acquiring lock "a4171d96-bb26-473f-a322-178dadbaab0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] Lock "a4171d96-bb26-473f-a322-178dadbaab0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] Lock "a4171d96-bb26-473f-a322-178dadbaab0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] No waiting events found dispatching network-vif-unplugged-2a223503-a5c6-4851-b555-f4b3c9ce26bf {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:46 user nova-compute[75391]: WARNING nova.compute.manager [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Received unexpected event network-vif-unplugged-2a223503-a5c6-4851-b555-f4b3c9ce26bf for instance with vm_state active and task_state rebuilding.
Nov 15 02:47:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Received event network-vif-plugged-2a223503-a5c6-4851-b555-f4b3c9ce26bf {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] Acquiring lock "a4171d96-bb26-473f-a322-178dadbaab0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] Lock "a4171d96-bb26-473f-a322-178dadbaab0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] Lock "a4171d96-bb26-473f-a322-178dadbaab0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] No waiting events found dispatching network-vif-plugged-2a223503-a5c6-4851-b555-f4b3c9ce26bf {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:46 user nova-compute[75391]: WARNING nova.compute.manager [req-a963017e-9703-4e67-b66c-15c373b34789 req-a2285ac7-71c5-425e-b19b-551bfed2bf85 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Received unexpected event network-vif-plugged-2a223503-a5c6-4851-b555-f4b3c9ce26bf for instance with vm_state active and task_state rebuilding.
Nov 15 02:47:46 user nova-compute[75391]: DEBUG nova.compute.manager [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:47:46 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Instance spawned successfully.
Nov 15 02:47:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:47:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:47:47 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Instance destroyed successfully.
Nov 15 02:47:47 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-94225325',display_name='tempest-ServerActionsTestOtherA-server-528519161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-94225325',id=15,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmhK+EJhHmIDrZeRSNrf3UHZ5JLeQLAhGX/u9JkQb0ZIxg+Hha5DuE4jWuovQg5sU4I3Rt0gf/qTiKk2CMFhsxz1MyhTUWVIT75bqS2ShQt+vRSNlu3Pq6uyTO9HgnnNg==',key_name='tempest-keypair-537215865',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:45:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='81798f0465704c4d9c09d8c3d3175ac5',ramdisk_id='',reservation_id='r-9oodw1p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1177660790',owner_user_name='tempest-ServerActionsTestOtherA-1177660790-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:47:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ea5480ad1e49afa394e636c37e3b70',uuid=a4171d96-bb26-473f-a322-178dadbaab0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "address": "fa:16:3e:5b:49:f4", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a223503-a5", "ovs_interfaceid": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converting VIF {"id": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "address": "fa:16:3e:5b:49:f4", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a223503-a5", "ovs_interfaceid": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:49:f4,bridge_name='br-int',has_traffic_filtering=True,id=2a223503-a5c6-4851-b555-f4b3c9ce26bf,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a223503-a5') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG os_vif [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:49:f4,bridge_name='br-int',has_traffic_filtering=True,id=2a223503-a5c6-4851-b555-f4b3c9ce26bf,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a223503-a5') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a223503-a5, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=756f1423-01ed-426f-81aa-c43352c9d5f4) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:47 user nova-compute[75391]: INFO nova.compute.manager [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Took 12.50 seconds to spawn the instance on the hypervisor.
Nov 15 02:47:47 user nova-compute[75391]: DEBUG nova.compute.manager [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:47:47 user nova-compute[75391]: INFO os_vif [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:49:f4,bridge_name='br-int',has_traffic_filtering=True,id=2a223503-a5c6-4851-b555-f4b3c9ce26bf,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a223503-a5')
Nov 15 02:47:47 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JajWuoHZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:47:47 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 02:47:47 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:47:47 user nova-compute[75391]: INFO nova.compute.manager [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Took 31.24 seconds to build instance.
Nov 15 02:47:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-46410174-223b-443e-8240-d05eb09ef3ca tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.352s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26530353236336437', 'path': '/dev/sdc'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530353236336437', 'path': '/dev/sdc'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.752s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG nova.objects.instance [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'flavor' on Instance uuid da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ff2ef7-fcbf-482d-91a5-dadcda7ed4cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:47:47 user nova-compute[75391]: No targets found.
Nov 15 02:47:47 user nova-compute[75391]: iSNS:
Nov 15 02:47:47 user nova-compute[75391]: No targets found.
Nov 15 02:47:47 user nova-compute[75391]: STATIC:
Nov 15 02:47:47 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18
Nov 15 02:47:47 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:47:47 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:47:47 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103
Nov 15 02:47:47 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:47:47 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:47:47 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8
Nov 15 02:47:47 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:47:47 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:47:47 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:47:47 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:47:47 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:47:47 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4
Nov 15 02:47:47 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:47:47 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:47:47 user nova-compute[75391]: FIRMWARE:
Nov 15 02:47:47 user nova-compute[75391]: No targets found.
Nov 15 02:47:47 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:47:47 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:47:47 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 02:47:47 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:47:47 user nova-compute[75391]:   <source dev="/dev/sdc"/>
Nov 15 02:47:47 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:47:47 user nova-compute[75391]:   <serial>48cae43a-b3bd-4e69-b14c-d2104d2065c8</serial>
Nov 15 02:47:47 user nova-compute[75391]: </disk>
Nov 15 02:47:47 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e145025e-35d9-4696-8092-e0ea13f494f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d1a309-9fc0-4394-bed8-d9b142a9f979]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:47 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:47 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:47:47 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:47:47 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:47:47 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:47 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:47 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:47:47 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:47:47 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:47:47 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f623c139000>, {}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Disconnecting from: [] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.082s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] <== disconnect_volume: return (834ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:47:47 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:47:47 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Deleting instance files /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a_del
Nov 15 02:47:47 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Deletion of /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a_del complete
Nov 15 02:47:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:48 user nova-compute[75391]: INFO nova.virt.block_device [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Booting with volume 400f1ca0-2998-4527-83c4-829f0cbe09ea at /dev/vdb
Nov 15 02:47:48 user nova-compute[75391]: DEBUG os_brick.utils [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[719de8e3-c042-44cb-b256-a692943ce421]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] No VIF found with MAC fa:16:3e:1d:2d:fe, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9dd844-bc78-46ea-a44e-725931f40dfe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[500d287e-9974-4b9c-9567-a2b94b0f23c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65277df-0597-4da8-89f3-3c6cd7b55613]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:47:48 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:47:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bda6b8e-1876-4e32-9a9f-654deda65ff5]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG os_brick.utils [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Updating existing volume attachment record: 289271e3-2112-4048-8d6c-f383ccd12ee2 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7cc444be-c0ab-4b66-a42e-9a600de6335d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.408s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:47:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c684afe-4c7a-41f1-89fe-8977ae1b5f61/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c684afe-4c7a-41f1-89fe-8977ae1b5f61/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c684afe-4c7a-41f1-89fe-8977ae1b5f61/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-20713f73-5cb5-490f-9b4a-6712e273b729 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-20713f73-5cb5-490f-9b4a-6712e273b729 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:49 user nova-compute[75391]: DEBUG nova.compute.manager [None req-20713f73-5cb5-490f-9b4a-6712e273b729 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:47:49 user nova-compute[75391]: DEBUG nova.compute.manager [None req-20713f73-5cb5-490f-9b4a-6712e273b729 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75391) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 15 02:47:49 user nova-compute[75391]: DEBUG nova.objects.instance [None req-20713f73-5cb5-490f-9b4a-6712e273b729 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'flavor' on Instance uuid da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:47:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c684afe-4c7a-41f1-89fe-8977ae1b5f61/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:50 user nova-compute[75391]: DEBUG nova.compute.manager [req-18de0d3e-f3e4-470f-b65a-b554e02c13d4 req-fdfc67da-4e47-4e72-94e0-9c753bbead94 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received event network-vif-unplugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-18de0d3e-f3e4-470f-b65a-b554e02c13d4 req-fdfc67da-4e47-4e72-94e0-9c753bbead94 service nova] Acquiring lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-18de0d3e-f3e4-470f-b65a-b554e02c13d4 req-fdfc67da-4e47-4e72-94e0-9c753bbead94 service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-18de0d3e-f3e4-470f-b65a-b554e02c13d4 req-fdfc67da-4e47-4e72-94e0-9c753bbead94 service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:50 user nova-compute[75391]: DEBUG nova.compute.manager [req-18de0d3e-f3e4-470f-b65a-b554e02c13d4 req-fdfc67da-4e47-4e72-94e0-9c753bbead94 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] No waiting events found dispatching network-vif-unplugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:50 user nova-compute[75391]: WARNING nova.compute.manager [req-18de0d3e-f3e4-470f-b65a-b554e02c13d4 req-fdfc67da-4e47-4e72-94e0-9c753bbead94 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received unexpected event network-vif-unplugged-f3eff2a5-1256-4a92-969a-62aca65b7452 for instance with vm_state active and task_state powering-off.
Nov 15 02:47:50 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Instance destroyed successfully.
Nov 15 02:47:50 user nova-compute[75391]: DEBUG nova.compute.manager [None req-20713f73-5cb5-490f-9b4a-6712e273b729 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:47:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-20713f73-5cb5-490f-9b4a-6712e273b729 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.116s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:50 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b144078-2d2e-460c-b432-96d6309e338c/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Acquiring lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Acquiring lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:50 user nova-compute[75391]: INFO nova.compute.manager [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Terminating instance
Nov 15 02:47:50 user nova-compute[75391]: DEBUG nova.compute.manager [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:47:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b144078-2d2e-460c-b432-96d6309e338c/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b144078-2d2e-460c-b432-96d6309e338c/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:50 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:50 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:50 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b144078-2d2e-460c-b432-96d6309e338c/disk --force-share --output=json" returned: 0 in 0.385s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:51 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Instance destroyed successfully.
Nov 15 02:47:51 user nova-compute[75391]: DEBUG nova.objects.instance [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lazy-loading 'resources' on Instance uuid 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:42:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-439567025',display_name='tempest-VolumesAdminNegativeTest-server-439567025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-439567025',id=4,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMg5eEtMXdKfc7PFWzAV+AIelSB6Q9qOzaUk8uWrd3TtoLu7xrWJCMx+fxwoiekH4SGPErp3QN4SBcAbpps9eEHbjuimftpBd1SGDvpueZq3zEuNmogj4lbaz3907rsJsQ==',key_name='tempest-keypair-1446273857',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:42:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9265d1e4bccb467fbf0c738844d8735b',ramdisk_id='',reservation_id='r-9d4577kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1405215089',owner_user_name='tempest-VolumesAdminNegativeTest-1405215089-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:42:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f67781b1c37f4b7dbabdfa16d7b891d0',uuid=1ee84f40-ff95-41d2-97f6-2ef320cdf9f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ff5dedb-acb1-489b-a2dc-18a0f53f2933", "address": "fa:16:3e:2e:13:88", "network": {"id": "cb1a9e37-451d-43be-ab84-a0ebe7ab264b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500424491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9265d1e4bccb467fbf0c738844d8735b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff5dedb-ac", "ovs_interfaceid": "4ff5dedb-acb1-489b-a2dc-18a0f53f2933", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Converting VIF {"id": "4ff5dedb-acb1-489b-a2dc-18a0f53f2933", "address": "fa:16:3e:2e:13:88", "network": {"id": "cb1a9e37-451d-43be-ab84-a0ebe7ab264b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-500424491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9265d1e4bccb467fbf0c738844d8735b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff5dedb-ac", "ovs_interfaceid": "4ff5dedb-acb1-489b-a2dc-18a0f53f2933", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:13:88,bridge_name='br-int',has_traffic_filtering=True,id=4ff5dedb-acb1-489b-a2dc-18a0f53f2933,network=Network(cb1a9e37-451d-43be-ab84-a0ebe7ab264b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff5dedb-ac') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG os_vif [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:13:88,bridge_name='br-int',has_traffic_filtering=True,id=4ff5dedb-acb1-489b-a2dc-18a0f53f2933,network=Network(cb1a9e37-451d-43be-ab84-a0ebe7ab264b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff5dedb-ac') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ff5dedb-ac, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=00b15d7b-98b7-429d-85c6-d73a6a82e4b1) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:51 user nova-compute[75391]: INFO os_vif [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:13:88,bridge_name='br-int',has_traffic_filtering=True,id=4ff5dedb-acb1-489b-a2dc-18a0f53f2933,network=Network(cb1a9e37-451d-43be-ab84-a0ebe7ab264b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff5dedb-ac')
Nov 15 02:47:51 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Deleting instance files /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2_del
Nov 15 02:47:51 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Deletion of /opt/stack/data/nova/instances/1ee84f40-ff95-41d2-97f6-2ef320cdf9f2_del complete
Nov 15 02:47:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:51 user nova-compute[75391]: INFO nova.compute.manager [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 15 02:47:51 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Starting finish_revert_migration {{(pid=75391) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Start _get_guest_xml network_info=[{"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'adc718dc-1e57-417c-bb1f-c67aa0de18c2', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dfGrvENV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ebb7e616-3c05-4d99-a0b3-76dc1723e82d', 'attached_at': '2023-11-15T02:47:52.000000', 'detached_at': '', 'volume_id': '223d22cc-ebb2-4b73-8103-54aacfd3b44a', 'serial': '223d22cc-ebb2-4b73-8103-54aacfd3b44a'}, 'volume_type': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:47:51 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:47:51 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:47:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG nova.objects.instance [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lazy-loading 'vcpu_model' on Instance uuid ebb7e616-3c05-4d99-a0b3-76dc1723e82d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dfGrvENV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:47:51 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:47:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:47:51 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:47:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:47:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:47:51 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c4690b-e15c-4977-b902-a2b88ff4269c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:47:52 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[69eb4539-478f-4bac-ae08-759066d84111]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a] added
Nov 15 02:47:52 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e68920-e697-457c-945a-3ae58a787b71]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b44597-cf06-4ded-a0fa-54b25759b3c3]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dfGrvENV {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dfGrvENV" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[597b328d-6aaa-4668-8e67-9ec25a34c2e3]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dfGrvENV'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c1c9a3d-04de-4786-a263-dcf19a07e4bc/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fb22c0-6647-4a23-b93c-b78c3467636e]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG nova.compute.manager [req-8d5aae6e-cc47-4cda-843e-91bdf3d7c1f3 req-db8d9149-cc6b-43a9-ad2e-14395cd73396 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received event network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8d5aae6e-cc47-4cda-843e-91bdf3d7c1f3 req-db8d9149-cc6b-43a9-ad2e-14395cd73396 service nova] Acquiring lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8d5aae6e-cc47-4cda-843e-91bdf3d7c1f3 req-db8d9149-cc6b-43a9-ad2e-14395cd73396 service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8d5aae6e-cc47-4cda-843e-91bdf3d7c1f3 req-db8d9149-cc6b-43a9-ad2e-14395cd73396 service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG nova.compute.manager [req-8d5aae6e-cc47-4cda-843e-91bdf3d7c1f3 req-db8d9149-cc6b-43a9-ad2e-14395cd73396 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] No waiting events found dispatching network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:52 user nova-compute[75391]: WARNING nova.compute.manager [req-8d5aae6e-cc47-4cda-843e-91bdf3d7c1f3 req-db8d9149-cc6b-43a9-ad2e-14395cd73396 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received unexpected event network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 for instance with vm_state stopped and task_state None.
Nov 15 02:47:52 user nova-compute[75391]: DEBUG nova.compute.manager [req-8d5aae6e-cc47-4cda-843e-91bdf3d7c1f3 req-db8d9149-cc6b-43a9-ad2e-14395cd73396 service nova] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Received event network-vif-unplugged-4ff5dedb-acb1-489b-a2dc-18a0f53f2933 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8d5aae6e-cc47-4cda-843e-91bdf3d7c1f3 req-db8d9149-cc6b-43a9-ad2e-14395cd73396 service nova] Acquiring lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8d5aae6e-cc47-4cda-843e-91bdf3d7c1f3 req-db8d9149-cc6b-43a9-ad2e-14395cd73396 service nova] Lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8d5aae6e-cc47-4cda-843e-91bdf3d7c1f3 req-db8d9149-cc6b-43a9-ad2e-14395cd73396 service nova] Lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG nova.compute.manager [req-8d5aae6e-cc47-4cda-843e-91bdf3d7c1f3 req-db8d9149-cc6b-43a9-ad2e-14395cd73396 service nova] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] No waiting events found dispatching network-vif-unplugged-4ff5dedb-acb1-489b-a2dc-18a0f53f2933 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG nova.compute.manager [req-8d5aae6e-cc47-4cda-843e-91bdf3d7c1f3 req-db8d9149-cc6b-43a9-ad2e-14395cd73396 service nova] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Received event network-vif-unplugged-4ff5dedb-acb1-489b-a2dc-18a0f53f2933 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG nova.compute.manager [req-8d5aae6e-cc47-4cda-843e-91bdf3d7c1f3 req-db8d9149-cc6b-43a9-ad2e-14395cd73396 service nova] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Received event network-vif-plugged-4ff5dedb-acb1-489b-a2dc-18a0f53f2933 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8d5aae6e-cc47-4cda-843e-91bdf3d7c1f3 req-db8d9149-cc6b-43a9-ad2e-14395cd73396 service nova] Acquiring lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8d5aae6e-cc47-4cda-843e-91bdf3d7c1f3 req-db8d9149-cc6b-43a9-ad2e-14395cd73396 service nova] Lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8d5aae6e-cc47-4cda-843e-91bdf3d7c1f3 req-db8d9149-cc6b-43a9-ad2e-14395cd73396 service nova] Lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG nova.compute.manager [req-8d5aae6e-cc47-4cda-843e-91bdf3d7c1f3 req-db8d9149-cc6b-43a9-ad2e-14395cd73396 service nova] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] No waiting events found dispatching network-vif-plugged-4ff5dedb-acb1-489b-a2dc-18a0f53f2933 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:52 user nova-compute[75391]: WARNING nova.compute.manager [req-8d5aae6e-cc47-4cda-843e-91bdf3d7c1f3 req-db8d9149-cc6b-43a9-ad2e-14395cd73396 service nova] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Received unexpected event network-vif-plugged-4ff5dedb-acb1-489b-a2dc-18a0f53f2933 for instance with vm_state active and task_state deleting.
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[111e9192-5f21-4479-a5d6-35f57cc061a9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:52 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:52 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:47:52 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:47:52 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:47:52 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:52 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:52 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:47:52 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:47:52 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:47:52 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1196b3-7177-4d68-81e8-7aafd4f18c3a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a, portal: 172.16.0.220,3260]
Nov 15 02:47:52 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a, portal: 172.16.0.220,3260] successful.
Nov 15 02:47:52 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c1c9a3d-04de-4786-a263-dcf19a07e4bc/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c1c9a3d-04de-4786-a263-dcf19a07e4bc/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e51e95d-10ae-4e57-8750-f2e488a2bb4d]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fae6f2-3342-42d7-9717-41c8852f4d87]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:52 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:52 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:47:52 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:47:52 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:47:52 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:47:52 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:52 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:52 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:47:52 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:47:52 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:47:52 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:47:52 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.433s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] HCTL ('38', '-', '-', 0) found on session 26 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.030s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9edb35-a925-4795-8a39-05e36583369a]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Searching for a device in session 26 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dfGrvENV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c1c9a3d-04de-4786-a263-dcf19a07e4bc/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6400a5f3-0ec9-4484-930c-1f5061ae5374/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6400a5f3-0ec9-4484-930c-1f5061ae5374/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6400a5f3-0ec9-4484-930c-1f5061ae5374/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.496s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] <== connect_volume: return (1502ms) {'type': 'block', 'scsi_wwn': '26464616338383433', 'path': '/dev/sdg'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464616338383433', 'path': '/dev/sdg'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6400a5f3-0ec9-4484-930c-1f5061ae5374/disk.rescue --force-share --output=json" returned: 0 in 0.234s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-689614808',display_name='tempest-ServerActionsTestOtherB-server-689614808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-689614808',id=2,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2usIoDVXl+b9hE3o9jGzEYasMoeupEZWjgdC34QhkyFhqHaktIVO5IuSwbU0DElzd5MkeVTBrP68npXS/361ypXFAC7mDzbXraFDprW+Txm/mxv6ZY7FykX6U+2H5j7A==',key_name='tempest-keypair-1921719925',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:46:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dfefdbf9f31b47d4a76d8fb06414eb5a',ramdisk_id='',reservation_id='r-qacecpst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-5763420',owner_user_name='tempest-ServerActionsTestOtherB-5763420-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:47:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34b23ed566024cc3a90f97206ea8162d',uuid=ebb7e616-3c05-4d99-a0b3-76dc1723e82d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Converting VIF {"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:35:a3,bridge_name='br-int',has_traffic_filtering=True,id=c9643afc-4454-4d29-b8a2-5422753857b0,network=Network(db549bf7-e039-4ea4-ac62-b5c090652e6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9643afc-44') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:47:53 user nova-compute[75391]:   <uuid>ebb7e616-3c05-4d99-a0b3-76dc1723e82d</uuid>
Nov 15 02:47:53 user nova-compute[75391]:   <name>instance-00000002</name>
Nov 15 02:47:53 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:47:53 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:47:53 user nova-compute[75391]:   <metadata>
Nov 15 02:47:53 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:47:53 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:47:53 user nova-compute[75391]:       <nova:name>tempest-ServerActionsTestOtherB-server-689614808</nova:name>
Nov 15 02:47:53 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:47:51</nova:creationTime>
Nov 15 02:47:53 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:47:53 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:47:53 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:47:53 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:47:53 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:47:53 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:47:53 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:47:53 user nova-compute[75391]:       <nova:owner>
Nov 15 02:47:53 user nova-compute[75391]:         <nova:user uuid="34b23ed566024cc3a90f97206ea8162d">tempest-ServerActionsTestOtherB-5763420-project-member</nova:user>
Nov 15 02:47:53 user nova-compute[75391]:         <nova:project uuid="dfefdbf9f31b47d4a76d8fb06414eb5a">tempest-ServerActionsTestOtherB-5763420</nova:project>
Nov 15 02:47:53 user nova-compute[75391]:       </nova:owner>
Nov 15 02:47:53 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:47:53 user nova-compute[75391]:       <nova:ports>
Nov 15 02:47:53 user nova-compute[75391]:         <nova:port uuid="c9643afc-4454-4d29-b8a2-5422753857b0">
Nov 15 02:47:53 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 02:47:53 user nova-compute[75391]:         </nova:port>
Nov 15 02:47:53 user nova-compute[75391]:       </nova:ports>
Nov 15 02:47:53 user nova-compute[75391]:     </nova:instance>
Nov 15 02:47:53 user nova-compute[75391]:   </metadata>
Nov 15 02:47:53 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:47:53 user nova-compute[75391]:     <system>
Nov 15 02:47:53 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:47:53 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:47:53 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:47:53 user nova-compute[75391]:       <entry name="serial">ebb7e616-3c05-4d99-a0b3-76dc1723e82d</entry>
Nov 15 02:47:53 user nova-compute[75391]:       <entry name="uuid">ebb7e616-3c05-4d99-a0b3-76dc1723e82d</entry>
Nov 15 02:47:53 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:47:53 user nova-compute[75391]:     </system>
Nov 15 02:47:53 user nova-compute[75391]:   </sysinfo>
Nov 15 02:47:53 user nova-compute[75391]:   <os>
Nov 15 02:47:53 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:47:53 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:47:53 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:47:53 user nova-compute[75391]:   </os>
Nov 15 02:47:53 user nova-compute[75391]:   <features>
Nov 15 02:47:53 user nova-compute[75391]:     <acpi/>
Nov 15 02:47:53 user nova-compute[75391]:     <apic/>
Nov 15 02:47:53 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:47:53 user nova-compute[75391]:   </features>
Nov 15 02:47:53 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:47:53 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:47:53 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:47:53 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:47:53 user nova-compute[75391]:   </clock>
Nov 15 02:47:53 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:47:53 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:47:53 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:47:53 user nova-compute[75391]:   </cpu>
Nov 15 02:47:53 user nova-compute[75391]:   <devices>
Nov 15 02:47:53 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:47:53 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:47:53 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk"/>
Nov 15 02:47:53 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:47:53 user nova-compute[75391]:     </disk>
Nov 15 02:47:53 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 02:47:53 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:47:53 user nova-compute[75391]:       <source dev="/dev/sdg"/>
Nov 15 02:47:53 user nova-compute[75391]:       <target dev="vdb" bus="virtio"/>
Nov 15 02:47:53 user nova-compute[75391]:       <serial>223d22cc-ebb2-4b73-8103-54aacfd3b44a</serial>
Nov 15 02:47:53 user nova-compute[75391]:     </disk>
Nov 15 02:47:53 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:47:53 user nova-compute[75391]:       <mac address="fa:16:3e:79:35:a3"/>
Nov 15 02:47:53 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:47:53 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:47:53 user nova-compute[75391]:       <target dev="tapc9643afc-44"/>
Nov 15 02:47:53 user nova-compute[75391]:     </interface>
Nov 15 02:47:53 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:47:53 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/console.log" append="off"/>
Nov 15 02:47:53 user nova-compute[75391]:     </serial>
Nov 15 02:47:53 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:47:53 user nova-compute[75391]:     <video>
Nov 15 02:47:53 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:47:53 user nova-compute[75391]:     </video>
Nov 15 02:47:53 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:47:53 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:47:53 user nova-compute[75391]:     </rng>
Nov 15 02:47:53 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:47:53 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:47:53 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:47:53 user nova-compute[75391]:     </memballoon>
Nov 15 02:47:53 user nova-compute[75391]:   </devices>
Nov 15 02:47:53 user nova-compute[75391]: </domain>
Nov 15 02:47:53 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-689614808',display_name='tempest-ServerActionsTestOtherB-server-689614808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-689614808',id=2,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2usIoDVXl+b9hE3o9jGzEYasMoeupEZWjgdC34QhkyFhqHaktIVO5IuSwbU0DElzd5MkeVTBrP68npXS/361ypXFAC7mDzbXraFDprW+Txm/mxv6ZY7FykX6U+2H5j7A==',key_name='tempest-keypair-1921719925',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:46:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dfefdbf9f31b47d4a76d8fb06414eb5a',ramdisk_id='',reservation_id='r-qacecpst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-5763420',owner_user_name='tempest-ServerActionsTestOtherB-5763420-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:47:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34b23ed566024cc3a90f97206ea8162d',uuid=ebb7e616-3c05-4d99-a0b3-76dc1723e82d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Converting VIF {"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:35:a3,bridge_name='br-int',has_traffic_filtering=True,id=c9643afc-4454-4d29-b8a2-5422753857b0,network=Network(db549bf7-e039-4ea4-ac62-b5c090652e6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9643afc-44') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG os_vif [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:35:a3,bridge_name='br-int',has_traffic_filtering=True,id=c9643afc-4454-4d29-b8a2-5422753857b0,network=Network(db549bf7-e039-4ea4-ac62-b5c090652e6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9643afc-44') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0463733-cee5-5ff3-8620-fd8a83e092b2', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9643afc-44, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9643afc-44, col_values=(('qos', UUID('de326fa4-93f1-4bb2-9264-0f49a72d406b')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9643afc-44, col_values=(('external_ids', {'iface-id': 'c9643afc-4454-4d29-b8a2-5422753857b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:35:a3', 'vm-uuid': 'ebb7e616-3c05-4d99-a0b3-76dc1723e82d'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:53 user nova-compute[75391]: INFO os_vif [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:35:a3,bridge_name='br-int',has_traffic_filtering=True,id=c9643afc-4454-4d29-b8a2-5422753857b0,network=Network(db549bf7-e039-4ea4-ac62-b5c090652e6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9643afc-44')
Nov 15 02:47:53 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:47:53 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Took 1.99 seconds to deallocate network for instance.
Nov 15 02:47:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG nova.compute.manager [req-5e2e7a83-9c5e-4e6d-aee9-612e019a9d31 req-be986e36-37de-4b48-9053-29513bc70654 service nova] [instance: 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2] Received event network-vif-deleted-4ff5dedb-acb1-489b-a2dc-18a0f53f2933 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:54 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Refreshing inventories for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 02:47:54 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:47:54 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:47:54 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=7195MB free_disk=24.974346160888672GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:47:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:54 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Updating ProviderTree inventory for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 02:47:54 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Updating inventory in ProviderTree for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 02:47:54 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Refreshing aggregate associations for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e, aggregates: None {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Refreshing trait associations for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "5c684afe-4c7a-41f1-89fe-8977ae1b5f61" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "5c684afe-4c7a-41f1-89fe-8977ae1b5f61" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG nova.objects.instance [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lazy-loading 'flavor' on Instance uuid 5c684afe-4c7a-41f1-89fe-8977ae1b5f61 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:47:55 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Creating image(s)
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "/opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "/opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "5c684afe-4c7a-41f1-89fe-8977ae1b5f61" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.288s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.289s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "5c684afe-4c7a-41f1-89fe-8977ae1b5f61" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "5c684afe-4c7a-41f1-89fe-8977ae1b5f61" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:55 user nova-compute[75391]: INFO nova.compute.manager [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Attaching volume 69c109b6-7b85-484a-8799-3dc6c05a6787 to /dev/vdb
Nov 15 02:47:55 user nova-compute[75391]: DEBUG os_brick.utils [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa53503-becb-40ed-b15f-f953c3fd671a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.043s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7b7336-5259-4fc3-aad2-f9aeafc40275]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd8149a-d17a-461a-8450-bd04d4e1c212]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.283s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[510d830f-7a65-44c9-bd0d-f6167c30442d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG nova.compute.manager [req-7d3f6e67-d366-4fd0-9518-5a4e538d0c8d req-908708c6-92a4-44f6-af97-1dfad4f7c919 service nova] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Received event network-changed-e1d514f4-a89c-4f39-ad6e-77ade59a00f1 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG nova.compute.manager [req-7d3f6e67-d366-4fd0-9518-5a4e538d0c8d req-908708c6-92a4-44f6-af97-1dfad4f7c919 service nova] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Refreshing instance network info cache due to event network-changed-e1d514f4-a89c-4f39-ad6e-77ade59a00f1. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7d3f6e67-d366-4fd0-9518-5a4e538d0c8d req-908708c6-92a4-44f6-af97-1dfad4f7c919 service nova] Acquiring lock "refresh_cache-5c684afe-4c7a-41f1-89fe-8977ae1b5f61" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7d3f6e67-d366-4fd0-9518-5a4e538d0c8d req-908708c6-92a4-44f6-af97-1dfad4f7c919 service nova] Acquired lock "refresh_cache-5c684afe-4c7a-41f1-89fe-8977ae1b5f61" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG nova.network.neutron [req-7d3f6e67-d366-4fd0-9518-5a4e538d0c8d req-908708c6-92a4-44f6-af97-1dfad4f7c919 service nova] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Refreshing network info cache for port e1d514f4-a89c-4f39-ad6e-77ade59a00f1 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:47:55 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:47:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e28982f-bf82-4888-b6a6-f141e4adbafc]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk 1073741824" returned: 0 in 0.152s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.450s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG os_brick.utils [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] <== get_connector_properties: return (321ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Updating existing volume attachment record: 714bd56a-7c77-4ad5-82d5-a448d7ec8eab {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.340s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.336s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.211s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:56 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Deleted allocations for instance 1ee84f40-ff95-41d2-97f6-2ef320cdf9f2
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-df16fed0-98cb-4aa3-8d1c-66aff20f3bfb tempest-VolumesAdminNegativeTest-1405215089 tempest-VolumesAdminNegativeTest-1405215089-project-member] Lock "1ee84f40-ff95-41d2-97f6-2ef320cdf9f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.675s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Cannot resize image /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Ensure instance console log exists: /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Start _get_guest_xml network_info=[{"id": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "address": "fa:16:3e:5b:49:f4", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a223503-a5", "ovs_interfaceid": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '289271e3-2112-4048-8d6c-f383ccd12ee2', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JajWuoHZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a4171d96-bb26-473f-a322-178dadbaab0a', 'attached_at': '', 'detached_at': '', 'volume_id': '400f1ca0-2998-4527-83c4-829f0cbe09ea', 'serial': '400f1ca0-2998-4527-83c4-829f0cbe09ea'}, 'volume_type': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:47:56 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 02:47:56 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.objects.instance [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lazy-loading 'vcpu_model' on Instance uuid a4171d96-bb26-473f-a322-178dadbaab0a {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9744c8a1-046e-4a00-92e0-92ebb3275ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance fc9484c0-9083-4797-8ab1-2ad392822ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 38a63a30-a3bc-4556-9fb6-53522dbf2c68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 25884e14-afa3-4e5d-8154-a9e9eb455b94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6400a5f3-0ec9-4484-930c-1f5061ae5374 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance a4171d96-bb26-473f-a322-178dadbaab0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance ebb7e616-3c05-4d99-a0b3-76dc1723e82d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 5c684afe-4c7a-41f1-89fe-8977ae1b5f61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 2b144078-2d2e-460c-b432-96d6309e338c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 5c1c9a3d-04de-4786-a263-dcf19a07e4bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 60762562-adbd-4af6-8c0e-d6363a4111d2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JajWuoHZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:47:56 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 02:47:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:47:56 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 02:47:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:47:56 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d74bb48-0d9c-4668-a0a5-2fcb69e31221]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:47:56 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2ff660-cf5b-4897-bdcc-8318283e1d6e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea] added
Nov 15 02:47:56 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c54cbe-effb-4216-b0e9-89594e559976]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[773d3a22-839a-4803-bf75-e52f9b7d4403]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JajWuoHZ {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JajWuoHZ" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c57c041-0786-4255-9eac-e7c5bf4a153a]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JajWuoHZ'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.041s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6010259-eb28-4ba1-9f6b-9d6c19ea745c]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.network.neutron [req-7d3f6e67-d366-4fd0-9518-5a4e538d0c8d req-908708c6-92a4-44f6-af97-1dfad4f7c919 service nova] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Updated VIF entry in instance network info cache for port e1d514f4-a89c-4f39-ad6e-77ade59a00f1. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.network.neutron [req-7d3f6e67-d366-4fd0-9518-5a4e538d0c8d req-908708c6-92a4-44f6-af97-1dfad4f7c919 service nova] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Updating instance_info_cache with network_info: [{"id": "e1d514f4-a89c-4f39-ad6e-77ade59a00f1", "address": "fa:16:3e:08:2f:ea", "network": {"id": "5567560c-b3c5-4802-b758-92d672458351", "bridge": "br-int", "label": "tempest-TestStampPattern-268456575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e0ca1f6ce542a482164410c5e67e13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d514f4-a8", "ovs_interfaceid": "e1d514f4-a89c-4f39-ad6e-77ade59a00f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7d3f6e67-d366-4fd0-9518-5a4e538d0c8d req-908708c6-92a4-44f6-af97-1dfad4f7c919 service nova] Releasing lock "refresh_cache-5c684afe-4c7a-41f1-89fe-8977ae1b5f61" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.compute.manager [req-7d3f6e67-d366-4fd0-9518-5a4e538d0c8d req-908708c6-92a4-44f6-af97-1dfad4f7c919 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Received event network-vif-plugged-c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7d3f6e67-d366-4fd0-9518-5a4e538d0c8d req-908708c6-92a4-44f6-af97-1dfad4f7c919 service nova] Acquiring lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7d3f6e67-d366-4fd0-9518-5a4e538d0c8d req-908708c6-92a4-44f6-af97-1dfad4f7c919 service nova] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7d3f6e67-d366-4fd0-9518-5a4e538d0c8d req-908708c6-92a4-44f6-af97-1dfad4f7c919 service nova] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.compute.manager [req-7d3f6e67-d366-4fd0-9518-5a4e538d0c8d req-908708c6-92a4-44f6-af97-1dfad4f7c919 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] No waiting events found dispatching network-vif-plugged-c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:56 user nova-compute[75391]: WARNING nova.compute.manager [req-7d3f6e67-d366-4fd0-9518-5a4e538d0c8d req-908708c6-92a4-44f6-af97-1dfad4f7c919 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Received unexpected event network-vif-plugged-c9643afc-4454-4d29-b8a2-5422753857b0 for instance with vm_state resized and task_state resize_reverting.
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d0d394-b3ce-4057-983c-16f43eacaa88]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:56 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:56 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:47:56 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:47:56 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:47:56 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:47:56 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:56 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:56 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:47:56 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:47:56 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:47:56 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:47:56 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e4da6d85-2b90-48ed-a446-0a2449862130 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "25884e14-afa3-4e5d-8154-a9e9eb455b94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e4da6d85-2b90-48ed-a446-0a2449862130 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e4da6d85-2b90-48ed-a446-0a2449862130 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "25884e14-afa3-4e5d-8154-a9e9eb455b94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e4da6d85-2b90-48ed-a446-0a2449862130 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e4da6d85-2b90-48ed-a446-0a2449862130 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:56 user nova-compute[75391]: INFO nova.compute.manager [None req-e4da6d85-2b90-48ed-a446-0a2449862130 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Terminating instance
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.compute.manager [None req-e4da6d85-2b90-48ed-a446-0a2449862130 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --login" returned: 0 in 0.118s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9573ea-bfa7-401d-9b06-4ea5a42c75b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea, portal: 172.16.0.220,3260]
Nov 15 02:47:56 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea, portal: 172.16.0.220,3260] successful.
Nov 15 02:47:56 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab492cfa-aac5-47ba-a7b7-ab4a743bb584]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.838s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81ca431-4635-49d6-acc9-87419e2a9fd0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:57 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:57 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:47:57 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:47:57 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:47:57 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:47:57 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:47:57 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:47:57 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:47:57 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:47:57 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:47:57 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:47:57 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:47:57 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:47:57 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.501s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] HCTL ('39', '-', '-', 0) found on session 27 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39b030b-9ecd-44a7-92d3-85b9be5e822b]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Searching for a device in session 27 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JajWuoHZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:57 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Instance destroyed successfully.
Nov 15 02:47:57 user nova-compute[75391]: DEBUG nova.objects.instance [None req-e4da6d85-2b90-48ed-a446-0a2449862130 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lazy-loading 'resources' on Instance uuid 25884e14-afa3-4e5d-8154-a9e9eb455b94 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-e4da6d85-2b90-48ed-a446-0a2449862130 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:42:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-228689750',display_name='tempest-TestMinimumBasicScenario-server-228689750',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-228689750',id=12,image_ref='143f1837-4d6a-4e72-b7f3-8571cb18b9e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwK3j8HHIRg419cIoS1FnvOd+dER4MDrZCMWVzQif1BmXlSl8hZBKvaJ6w8P2cNF/xp+wN/TK/t6oiz+7Ge/xo4VPAisWnTlayJP8UXoEhk3eR07YIFuG12GEzrT+Hxxw==',key_name='tempest-TestMinimumBasicScenario-1293343834',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:43:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41caf593c4994c5c86570e1216c01337',ramdisk_id='',reservation_id='r-gxn3d76p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='143f1837-4d6a-4e72-b7f3-8571cb18b9e3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1859352909',owner_user_name='tempest-TestMinimumBasicScenario-1859352909-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:45:18Z,user_data=None,user_id='409532d98aae4e5b962d3b142981c79a',uuid=25884e14-afa3-4e5d-8154-a9e9eb455b94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "address": "fa:16:3e:6b:28:6d", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b8f74f5-6f", "ovs_interfaceid": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-e4da6d85-2b90-48ed-a446-0a2449862130 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Converting VIF {"id": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "address": "fa:16:3e:6b:28:6d", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b8f74f5-6f", "ovs_interfaceid": "6b8f74f5-6f5f-4946-afdb-80269c0d03b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-e4da6d85-2b90-48ed-a446-0a2449862130 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:28:6d,bridge_name='br-int',has_traffic_filtering=True,id=6b8f74f5-6f5f-4946-afdb-80269c0d03b1,network=Network(ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b8f74f5-6f') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG os_vif [None req-e4da6d85-2b90-48ed-a446-0a2449862130 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:28:6d,bridge_name='br-int',has_traffic_filtering=True,id=6b8f74f5-6f5f-4946-afdb-80269c0d03b1,network=Network(ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b8f74f5-6f') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b8f74f5-6f, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ead4424-aab6-4a8a-aff2-dbba3e510b97) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:57 user nova-compute[75391]: INFO os_vif [None req-e4da6d85-2b90-48ed-a446-0a2449862130 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:28:6d,bridge_name='br-int',has_traffic_filtering=True,id=6b8f74f5-6f5f-4946-afdb-80269c0d03b1,network=Network(ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b8f74f5-6f')
Nov 15 02:47:57 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-e4da6d85-2b90-48ed-a446-0a2449862130 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Deleting instance files /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94_del
Nov 15 02:47:57 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-e4da6d85-2b90-48ed-a446-0a2449862130 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Deletion of /opt/stack/data/nova/instances/25884e14-afa3-4e5d-8154-a9e9eb455b94_del complete
Nov 15 02:47:57 user nova-compute[75391]: INFO nova.compute.manager [None req-e4da6d85-2b90-48ed-a446-0a2449862130 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 15 02:47:57 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-e4da6d85-2b90-48ed-a446-0a2449862130 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:47:57 user nova-compute[75391]: DEBUG nova.compute.manager [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:47:57 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Instance running successfully.
Nov 15 02:47:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] finish_revert_migration finished successfully. {{(pid=75391) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG nova.compute.manager [req-228fca72-c5ce-4df3-ac8f-6be6151894e8 req-c43f196d-680c-4aca-89a4-1ec65cddf36d service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Received event network-vif-plugged-c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-228fca72-c5ce-4df3-ac8f-6be6151894e8 req-c43f196d-680c-4aca-89a4-1ec65cddf36d service nova] Acquiring lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-228fca72-c5ce-4df3-ac8f-6be6151894e8 req-c43f196d-680c-4aca-89a4-1ec65cddf36d service nova] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-228fca72-c5ce-4df3-ac8f-6be6151894e8 req-c43f196d-680c-4aca-89a4-1ec65cddf36d service nova] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG nova.compute.manager [req-228fca72-c5ce-4df3-ac8f-6be6151894e8 req-c43f196d-680c-4aca-89a4-1ec65cddf36d service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] No waiting events found dispatching network-vif-plugged-c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:58 user nova-compute[75391]: WARNING nova.compute.manager [req-228fca72-c5ce-4df3-ac8f-6be6151894e8 req-c43f196d-680c-4aca-89a4-1ec65cddf36d service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Received unexpected event network-vif-plugged-c9643afc-4454-4d29-b8a2-5422753857b0 for instance with vm_state resized and task_state resize_reverting.
Nov 15 02:47:58 user nova-compute[75391]: DEBUG nova.compute.manager [req-228fca72-c5ce-4df3-ac8f-6be6151894e8 req-c43f196d-680c-4aca-89a4-1ec65cddf36d service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Received event network-vif-unplugged-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-228fca72-c5ce-4df3-ac8f-6be6151894e8 req-c43f196d-680c-4aca-89a4-1ec65cddf36d service nova] Acquiring lock "25884e14-afa3-4e5d-8154-a9e9eb455b94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-228fca72-c5ce-4df3-ac8f-6be6151894e8 req-c43f196d-680c-4aca-89a4-1ec65cddf36d service nova] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-228fca72-c5ce-4df3-ac8f-6be6151894e8 req-c43f196d-680c-4aca-89a4-1ec65cddf36d service nova] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG nova.compute.manager [req-228fca72-c5ce-4df3-ac8f-6be6151894e8 req-c43f196d-680c-4aca-89a4-1ec65cddf36d service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] No waiting events found dispatching network-vif-unplugged-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG nova.compute.manager [req-228fca72-c5ce-4df3-ac8f-6be6151894e8 req-c43f196d-680c-4aca-89a4-1ec65cddf36d service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Received event network-vif-unplugged-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG nova.compute.manager [req-228fca72-c5ce-4df3-ac8f-6be6151894e8 req-c43f196d-680c-4aca-89a4-1ec65cddf36d service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Received event network-vif-plugged-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-228fca72-c5ce-4df3-ac8f-6be6151894e8 req-c43f196d-680c-4aca-89a4-1ec65cddf36d service nova] Acquiring lock "25884e14-afa3-4e5d-8154-a9e9eb455b94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-228fca72-c5ce-4df3-ac8f-6be6151894e8 req-c43f196d-680c-4aca-89a4-1ec65cddf36d service nova] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-228fca72-c5ce-4df3-ac8f-6be6151894e8 req-c43f196d-680c-4aca-89a4-1ec65cddf36d service nova] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG nova.compute.manager [req-228fca72-c5ce-4df3-ac8f-6be6151894e8 req-c43f196d-680c-4aca-89a4-1ec65cddf36d service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] No waiting events found dispatching network-vif-plugged-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:47:58 user nova-compute[75391]: WARNING nova.compute.manager [req-228fca72-c5ce-4df3-ac8f-6be6151894e8 req-c43f196d-680c-4aca-89a4-1ec65cddf36d service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Received unexpected event network-vif-plugged-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 for instance with vm_state active and task_state deleting.
Nov 15 02:47:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:58 user nova-compute[75391]: INFO nova.compute.manager [None req-bd93511c-015b-40d6-b2c9-3ef6fedac8b0 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Updating instance to original state: 'active'
Nov 15 02:47:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.610s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] <== connect_volume: return (1611ms) {'type': 'block', 'scsi_wwn': '23965613136346531', 'path': '/dev/sdh'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965613136346531', 'path': '/dev/sdh'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T02:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-94225325',display_name='tempest-ServerActionsTestOtherA-server-528519161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-94225325',id=15,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmhK+EJhHmIDrZeRSNrf3UHZ5JLeQLAhGX/u9JkQb0ZIxg+Hha5DuE4jWuovQg5sU4I3Rt0gf/qTiKk2CMFhsxz1MyhTUWVIT75bqS2ShQt+vRSNlu3Pq6uyTO9HgnnNg==',key_name='tempest-keypair-537215865',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:45:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='81798f0465704c4d9c09d8c3d3175ac5',ramdisk_id='',reservation_id='r-9oodw1p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1177660790',owner_user_name='tempest-ServerActionsTestOtherA-1177660790-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:47:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ea5480ad1e49afa394e636c37e3b70',uuid=a4171d96-bb26-473f-a322-178dadbaab0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "address": "fa:16:3e:5b:49:f4", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a223503-a5", "ovs_interfaceid": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converting VIF {"id": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "address": "fa:16:3e:5b:49:f4", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a223503-a5", "ovs_interfaceid": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:49:f4,bridge_name='br-int',has_traffic_filtering=True,id=2a223503-a5c6-4851-b555-f4b3c9ce26bf,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a223503-a5') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:47:58 user nova-compute[75391]:   <uuid>a4171d96-bb26-473f-a322-178dadbaab0a</uuid>
Nov 15 02:47:58 user nova-compute[75391]:   <name>instance-0000000f</name>
Nov 15 02:47:58 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:47:58 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:47:58 user nova-compute[75391]:   <metadata>
Nov 15 02:47:58 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:47:58 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:47:58 user nova-compute[75391]:       <nova:name>tempest-ServerActionsTestOtherA-server-528519161</nova:name>
Nov 15 02:47:58 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:47:56</nova:creationTime>
Nov 15 02:47:58 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:47:58 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:47:58 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:47:58 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:47:58 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:47:58 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:47:58 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:47:58 user nova-compute[75391]:       <nova:owner>
Nov 15 02:47:58 user nova-compute[75391]:         <nova:user uuid="f6ea5480ad1e49afa394e636c37e3b70">tempest-ServerActionsTestOtherA-1177660790-project-member</nova:user>
Nov 15 02:47:58 user nova-compute[75391]:         <nova:project uuid="81798f0465704c4d9c09d8c3d3175ac5">tempest-ServerActionsTestOtherA-1177660790</nova:project>
Nov 15 02:47:58 user nova-compute[75391]:       </nova:owner>
Nov 15 02:47:58 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:47:58 user nova-compute[75391]:       <nova:ports>
Nov 15 02:47:58 user nova-compute[75391]:         <nova:port uuid="2a223503-a5c6-4851-b555-f4b3c9ce26bf">
Nov 15 02:47:58 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 02:47:58 user nova-compute[75391]:         </nova:port>
Nov 15 02:47:58 user nova-compute[75391]:       </nova:ports>
Nov 15 02:47:58 user nova-compute[75391]:     </nova:instance>
Nov 15 02:47:58 user nova-compute[75391]:   </metadata>
Nov 15 02:47:58 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:47:58 user nova-compute[75391]:     <system>
Nov 15 02:47:58 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:47:58 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:47:58 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:47:58 user nova-compute[75391]:       <entry name="serial">a4171d96-bb26-473f-a322-178dadbaab0a</entry>
Nov 15 02:47:58 user nova-compute[75391]:       <entry name="uuid">a4171d96-bb26-473f-a322-178dadbaab0a</entry>
Nov 15 02:47:58 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:47:58 user nova-compute[75391]:     </system>
Nov 15 02:47:58 user nova-compute[75391]:   </sysinfo>
Nov 15 02:47:58 user nova-compute[75391]:   <os>
Nov 15 02:47:58 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:47:58 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:47:58 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:47:58 user nova-compute[75391]:   </os>
Nov 15 02:47:58 user nova-compute[75391]:   <features>
Nov 15 02:47:58 user nova-compute[75391]:     <acpi/>
Nov 15 02:47:58 user nova-compute[75391]:     <apic/>
Nov 15 02:47:58 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:47:58 user nova-compute[75391]:   </features>
Nov 15 02:47:58 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:47:58 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:47:58 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:47:58 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:47:58 user nova-compute[75391]:   </clock>
Nov 15 02:47:58 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:47:58 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:47:58 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:47:58 user nova-compute[75391]:   </cpu>
Nov 15 02:47:58 user nova-compute[75391]:   <devices>
Nov 15 02:47:58 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:47:58 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:47:58 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk"/>
Nov 15 02:47:58 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:47:58 user nova-compute[75391]:     </disk>
Nov 15 02:47:58 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 02:47:58 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:47:58 user nova-compute[75391]:       <source dev="/dev/sdh"/>
Nov 15 02:47:58 user nova-compute[75391]:       <target dev="vdb" bus="virtio"/>
Nov 15 02:47:58 user nova-compute[75391]:       <serial>400f1ca0-2998-4527-83c4-829f0cbe09ea</serial>
Nov 15 02:47:58 user nova-compute[75391]:     </disk>
Nov 15 02:47:58 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:47:58 user nova-compute[75391]:       <mac address="fa:16:3e:5b:49:f4"/>
Nov 15 02:47:58 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:47:58 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:47:58 user nova-compute[75391]:       <target dev="tap2a223503-a5"/>
Nov 15 02:47:58 user nova-compute[75391]:     </interface>
Nov 15 02:47:58 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:47:58 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/console.log" append="off"/>
Nov 15 02:47:58 user nova-compute[75391]:     </serial>
Nov 15 02:47:58 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:47:58 user nova-compute[75391]:     <video>
Nov 15 02:47:58 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:47:58 user nova-compute[75391]:     </video>
Nov 15 02:47:58 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:47:58 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:47:58 user nova-compute[75391]:     </rng>
Nov 15 02:47:58 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:47:58 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:47:58 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:47:58 user nova-compute[75391]:     </memballoon>
Nov 15 02:47:58 user nova-compute[75391]:   </devices>
Nov 15 02:47:58 user nova-compute[75391]: </domain>
Nov 15 02:47:58 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T02:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-94225325',display_name='tempest-ServerActionsTestOtherA-server-528519161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-94225325',id=15,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmhK+EJhHmIDrZeRSNrf3UHZ5JLeQLAhGX/u9JkQb0ZIxg+Hha5DuE4jWuovQg5sU4I3Rt0gf/qTiKk2CMFhsxz1MyhTUWVIT75bqS2ShQt+vRSNlu3Pq6uyTO9HgnnNg==',key_name='tempest-keypair-537215865',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:45:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='81798f0465704c4d9c09d8c3d3175ac5',ramdisk_id='',reservation_id='r-9oodw1p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1177660790',owner_user_name='tempest-ServerActionsTestOtherA-1177660790-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:47:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ea5480ad1e49afa394e636c37e3b70',uuid=a4171d96-bb26-473f-a322-178dadbaab0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "address": "fa:16:3e:5b:49:f4", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a223503-a5", "ovs_interfaceid": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converting VIF {"id": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "address": "fa:16:3e:5b:49:f4", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a223503-a5", "ovs_interfaceid": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:49:f4,bridge_name='br-int',has_traffic_filtering=True,id=2a223503-a5c6-4851-b555-f4b3c9ce26bf,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a223503-a5') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG os_vif [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:49:f4,bridge_name='br-int',has_traffic_filtering=True,id=2a223503-a5c6-4851-b555-f4b3c9ce26bf,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a223503-a5') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'edec79fc-5394-58d9-91ec-c1b55ff1580d', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a223503-a5, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a223503-a5, col_values=(('qos', UUID('0b1c7b7c-8146-471e-968f-5d1595f6aae5')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a223503-a5, col_values=(('external_ids', {'iface-id': '2a223503-a5c6-4851-b555-f4b3c9ce26bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:49:f4', 'vm-uuid': 'a4171d96-bb26-473f-a322-178dadbaab0a'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:58 user nova-compute[75391]: INFO os_vif [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:49:f4,bridge_name='br-int',has_traffic_filtering=True,id=2a223503-a5c6-4851-b555-f4b3c9ce26bf,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a223503-a5')
Nov 15 02:47:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] No VIF found with MAC fa:16:3e:5b:49:f4, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:47:58 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Took 0.58 seconds to deallocate network for instance.
Nov 15 02:47:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e4da6d85-2b90-48ed-a446-0a2449862130 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:47:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e4da6d85-2b90-48ed-a446-0a2449862130 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:47:59 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-e4da6d85-2b90-48ed-a446-0a2449862130 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:47:59 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-e4da6d85-2b90-48ed-a446-0a2449862130 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:47:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e4da6d85-2b90-48ed-a446-0a2449862130 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.611s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:59 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:47:59 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-e4da6d85-2b90-48ed-a446-0a2449862130 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Deleted allocations for instance 25884e14-afa3-4e5d-8154-a9e9eb455b94
Nov 15 02:47:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e4da6d85-2b90-48ed-a446-0a2449862130 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "25884e14-afa3-4e5d-8154-a9e9eb455b94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.452s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:47:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:47:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:00 user nova-compute[75391]: DEBUG nova.compute.manager [req-a4f08d8c-4f0f-4a9b-8379-cde8e83ca3cd req-4da2f367-6a1a-4399-ad57-c3b69a1341e2 service nova] [instance: 25884e14-afa3-4e5d-8154-a9e9eb455b94] Received event network-vif-deleted-6b8f74f5-6f5f-4946-afdb-80269c0d03b1 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:48:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "054d3064-549d-442e-85ea-4c7bfde518cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "054d3064-549d-442e-85ea-4c7bfde518cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:00 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:48:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:00 user nova-compute[75391]: DEBUG nova.compute.manager [req-160aad01-cc2f-44fa-acd8-e3472a15f309 req-f23a544d-17e3-4c57-9c5b-0e624bbba267 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Received event network-vif-plugged-2a223503-a5c6-4851-b555-f4b3c9ce26bf {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:48:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-160aad01-cc2f-44fa-acd8-e3472a15f309 req-f23a544d-17e3-4c57-9c5b-0e624bbba267 service nova] Acquiring lock "a4171d96-bb26-473f-a322-178dadbaab0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-160aad01-cc2f-44fa-acd8-e3472a15f309 req-f23a544d-17e3-4c57-9c5b-0e624bbba267 service nova] Lock "a4171d96-bb26-473f-a322-178dadbaab0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-160aad01-cc2f-44fa-acd8-e3472a15f309 req-f23a544d-17e3-4c57-9c5b-0e624bbba267 service nova] Lock "a4171d96-bb26-473f-a322-178dadbaab0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:00 user nova-compute[75391]: DEBUG nova.compute.manager [req-160aad01-cc2f-44fa-acd8-e3472a15f309 req-f23a544d-17e3-4c57-9c5b-0e624bbba267 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] No waiting events found dispatching network-vif-plugged-2a223503-a5c6-4851-b555-f4b3c9ce26bf {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:48:00 user nova-compute[75391]: WARNING nova.compute.manager [req-160aad01-cc2f-44fa-acd8-e3472a15f309 req-f23a544d-17e3-4c57-9c5b-0e624bbba267 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Received unexpected event network-vif-plugged-2a223503-a5c6-4851-b555-f4b3c9ce26bf for instance with vm_state active and task_state rebuild_spawning.
Nov 15 02:48:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:48:00 user nova-compute[75391]: INFO nova.compute.claims [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Claim successful on node user
Nov 15 02:48:01 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.648s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG nova.network.neutron [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:48:01 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:48:01 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG nova.policy [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0a5832ec3e834e4c8e11d671f7891cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a31c2c4cb4586857b6179adf48ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:48:01 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Creating image(s)
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "/opt/stack/data/nova/instances/054d3064-549d-442e-85ea-4c7bfde518cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "/opt/stack/data/nova/instances/054d3064-549d-442e-85ea-4c7bfde518cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "/opt/stack/data/nova/instances/054d3064-549d-442e-85ea-4c7bfde518cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bolXhtVM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:48:01 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:48:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:48:01 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:48:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:48:01 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a738b98a-8b6a-47fa-b6c1-6ef33de54805]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:48:01 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac02d02-f39b-4bf8-b818-2d5c921a0d24]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787] added
Nov 15 02:48:01 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.198s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88c00b6-72bd-4e2c-8a4d-40dee9cec0ff]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a20232a-3e98-4bb0-9831-8eec1dd15ad0]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bolXhtVM {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bolXhtVM" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d6d255-f21c-4205-9711-6fb2cb35ace3]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bolXhtVM'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a567e77-895a-4e97-828e-25f1457ce591]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82317f2-0134-4b68-9cb3-76a59e57d847]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:48:01 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:48:01 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:48:01 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:48:01 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:48:01 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:48:01 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:48:01 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:48:01 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:48:01 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:48:01 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:48:01 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:48:01 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:48:01 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:48:01 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.237s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/054d3064-549d-442e-85ea-4c7bfde518cb/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787 -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab97366-583f-4c45-ab17-d4e97c631dce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787, portal: 172.16.0.220,3260]
Nov 15 02:48:02 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787, portal: 172.16.0.220,3260] successful.
Nov 15 02:48:02 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/054d3064-549d-442e-85ea-4c7bfde518cb/disk 1073741824" returned: 0 in 0.062s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a92f29e-9224-4714-9d7f-a874c4d41352]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[794bed7a-26b4-4bb4-aa72-4556671070a3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:48:02 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:48:02 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:48:02 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:48:02 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:48:02 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:48:02 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:48:02 user nova-compute[75391]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787 (non-flash)
Nov 15 02:48:02 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:48:02 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:48:02 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:48:02 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:48:02 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:48:02 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:48:02 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:48:02 user nova-compute[75391]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787 (non-flash)
Nov 15 02:48:02 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.479s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] HCTL ('40', '-', '-', 0) found on session 28 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG nova.network.neutron [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Successfully created port: b4140c76-b437-46c4-b8f4-dfafb44d7431 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.036s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cf213c-01d5-48b7-a508-75f0b73bc184]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Searching for a device in session 28 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bolXhtVM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.206s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Checking if we can resize image /opt/stack/data/nova/instances/054d3064-549d-442e-85ea-4c7bfde518cb/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/054d3064-549d-442e-85ea-4c7bfde518cb/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/054d3064-549d-442e-85ea-4c7bfde518cb/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Cannot resize image /opt/stack/data/nova/instances/054d3064-549d-442e-85ea-4c7bfde518cb/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Ensure instance console log exists: /opt/stack/data/nova/instances/054d3064-549d-442e-85ea-4c7bfde518cb/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG nova.compute.manager [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:48:02 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Instance spawned successfully.
Nov 15 02:48:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG nova.compute.manager [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-cdcbb31a-5827-47bc-8972-e00601a681f4 req-64498744-8394-4ce2-9ced-583d40209332 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Received event network-vif-plugged-2a223503-a5c6-4851-b555-f4b3c9ce26bf {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-cdcbb31a-5827-47bc-8972-e00601a681f4 req-64498744-8394-4ce2-9ced-583d40209332 service nova] Acquiring lock "a4171d96-bb26-473f-a322-178dadbaab0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-cdcbb31a-5827-47bc-8972-e00601a681f4 req-64498744-8394-4ce2-9ced-583d40209332 service nova] Lock "a4171d96-bb26-473f-a322-178dadbaab0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-cdcbb31a-5827-47bc-8972-e00601a681f4 req-64498744-8394-4ce2-9ced-583d40209332 service nova] Lock "a4171d96-bb26-473f-a322-178dadbaab0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-cdcbb31a-5827-47bc-8972-e00601a681f4 req-64498744-8394-4ce2-9ced-583d40209332 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] No waiting events found dispatching network-vif-plugged-2a223503-a5c6-4851-b555-f4b3c9ce26bf {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:48:02 user nova-compute[75391]: WARNING nova.compute.manager [req-cdcbb31a-5827-47bc-8972-e00601a681f4 req-64498744-8394-4ce2-9ced-583d40209332 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Received unexpected event network-vif-plugged-2a223503-a5c6-4851-b555-f4b3c9ce26bf for instance with vm_state active and task_state rebuild_spawning.
Nov 15 02:48:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG nova.objects.instance [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75391) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 15 02:48:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8ec49e60-35d4-437e-9011-3db9a91c99bc tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.079s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.551s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] <== connect_volume: return (1554ms) {'type': 'block', 'scsi_wwn': '23466353431306664', 'path': '/dev/sdi'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466353431306664', 'path': '/dev/sdi'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.objects.instance [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lazy-loading 'flavor' on Instance uuid 5c684afe-4c7a-41f1-89fe-8977ae1b5f61 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.network.neutron [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Successfully updated port: b4140c76-b437-46c4-b8f4-dfafb44d7431 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "refresh_cache-054d3064-549d-442e-85ea-4c7bfde518cb" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquired lock "refresh_cache-054d3064-549d-442e-85ea-4c7bfde518cb" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.network.neutron [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.compute.manager [req-1d48d304-931d-45e1-a4df-0b60f38bbbf1 req-d11b655d-c6be-43b3-8324-8c6bffb06b19 service nova] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Received event network-changed-b4140c76-b437-46c4-b8f4-dfafb44d7431 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.compute.manager [req-1d48d304-931d-45e1-a4df-0b60f38bbbf1 req-d11b655d-c6be-43b3-8324-8c6bffb06b19 service nova] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Refreshing instance network info cache due to event network-changed-b4140c76-b437-46c4-b8f4-dfafb44d7431. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1d48d304-931d-45e1-a4df-0b60f38bbbf1 req-d11b655d-c6be-43b3-8324-8c6bffb06b19 service nova] Acquiring lock "refresh_cache-054d3064-549d-442e-85ea-4c7bfde518cb" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 02:48:03 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:48:03 user nova-compute[75391]:   <source dev="/dev/sdi"/>
Nov 15 02:48:03 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:48:03 user nova-compute[75391]:   <serial>69c109b6-7b85-484a-8799-3dc6c05a6787</serial>
Nov 15 02:48:03 user nova-compute[75391]: </disk>
Nov 15 02:48:03 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.network.neutron [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.network.neutron [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Updating instance_info_cache with network_info: [{"id": "b4140c76-b437-46c4-b8f4-dfafb44d7431", "address": "fa:16:3e:0c:35:87", "network": {"id": "07cd9e35-dfd4-4a08-ac37-52c7bfefa42e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1490748469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96a31c2c4cb4586857b6179adf48ec0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4140c76-b4", "ovs_interfaceid": "b4140c76-b437-46c4-b8f4-dfafb44d7431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Releasing lock "refresh_cache-054d3064-549d-442e-85ea-4c7bfde518cb" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Instance network_info: |[{"id": "b4140c76-b437-46c4-b8f4-dfafb44d7431", "address": "fa:16:3e:0c:35:87", "network": {"id": "07cd9e35-dfd4-4a08-ac37-52c7bfefa42e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1490748469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96a31c2c4cb4586857b6179adf48ec0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4140c76-b4", "ovs_interfaceid": "b4140c76-b437-46c4-b8f4-dfafb44d7431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1d48d304-931d-45e1-a4df-0b60f38bbbf1 req-d11b655d-c6be-43b3-8324-8c6bffb06b19 service nova] Acquired lock "refresh_cache-054d3064-549d-442e-85ea-4c7bfde518cb" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.network.neutron [req-1d48d304-931d-45e1-a4df-0b60f38bbbf1 req-d11b655d-c6be-43b3-8324-8c6bffb06b19 service nova] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Refreshing network info cache for port b4140c76-b437-46c4-b8f4-dfafb44d7431 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Start _get_guest_xml network_info=[{"id": "b4140c76-b437-46c4-b8f4-dfafb44d7431", "address": "fa:16:3e:0c:35:87", "network": {"id": "07cd9e35-dfd4-4a08-ac37-52c7bfefa42e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1490748469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96a31c2c4cb4586857b6179adf48ec0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4140c76-b4", "ovs_interfaceid": "b4140c76-b437-46c4-b8f4-dfafb44d7431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:48:03 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:48:03 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:47:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1698704570',display_name='tempest-VolumesSnapshotTestJSON-instance-1698704570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1698704570',id=21,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwgsG2kAX0YzxGKviRlSX9Du8AhDC3KYkFm4bxPVp18IP4rWRKvNzfm9Q1/uOMEvhPg3E0890taPOWtnUpr2+ZdF0RGy/rJJhxJpyFknH5tluoyZcMWc9bnEhSgUGR77w==',key_name='tempest-keypair-970550916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c96a31c2c4cb4586857b6179adf48ec0',ramdisk_id='',reservation_id='r-lll0pqkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1270812690',owner_user_name='tempest-VolumesSnapshotTestJSON-1270812690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:48:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a5832ec3e834e4c8e11d671f7891cdf',uuid=054d3064-549d-442e-85ea-4c7bfde518cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4140c76-b437-46c4-b8f4-dfafb44d7431", "address": "fa:16:3e:0c:35:87", "network": {"id": "07cd9e35-dfd4-4a08-ac37-52c7bfefa42e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1490748469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96a31c2c4cb4586857b6179adf48ec0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4140c76-b4", "ovs_interfaceid": "b4140c76-b437-46c4-b8f4-dfafb44d7431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Converting VIF {"id": "b4140c76-b437-46c4-b8f4-dfafb44d7431", "address": "fa:16:3e:0c:35:87", "network": {"id": "07cd9e35-dfd4-4a08-ac37-52c7bfefa42e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1490748469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96a31c2c4cb4586857b6179adf48ec0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4140c76-b4", "ovs_interfaceid": "b4140c76-b437-46c4-b8f4-dfafb44d7431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:35:87,bridge_name='br-int',has_traffic_filtering=True,id=b4140c76-b437-46c4-b8f4-dfafb44d7431,network=Network(07cd9e35-dfd4-4a08-ac37-52c7bfefa42e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4140c76-b4') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.objects.instance [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lazy-loading 'pci_devices' on Instance uuid 054d3064-549d-442e-85ea-4c7bfde518cb {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:48:03 user nova-compute[75391]:   <uuid>054d3064-549d-442e-85ea-4c7bfde518cb</uuid>
Nov 15 02:48:03 user nova-compute[75391]:   <name>instance-00000015</name>
Nov 15 02:48:03 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:48:03 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:48:03 user nova-compute[75391]:   <metadata>
Nov 15 02:48:03 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:48:03 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:48:03 user nova-compute[75391]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1698704570</nova:name>
Nov 15 02:48:03 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:48:03</nova:creationTime>
Nov 15 02:48:03 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:48:03 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:48:03 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:48:03 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:48:03 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:48:03 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:48:03 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:48:03 user nova-compute[75391]:       <nova:owner>
Nov 15 02:48:03 user nova-compute[75391]:         <nova:user uuid="0a5832ec3e834e4c8e11d671f7891cdf">tempest-VolumesSnapshotTestJSON-1270812690-project-member</nova:user>
Nov 15 02:48:03 user nova-compute[75391]:         <nova:project uuid="c96a31c2c4cb4586857b6179adf48ec0">tempest-VolumesSnapshotTestJSON-1270812690</nova:project>
Nov 15 02:48:03 user nova-compute[75391]:       </nova:owner>
Nov 15 02:48:03 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:48:03 user nova-compute[75391]:       <nova:ports>
Nov 15 02:48:03 user nova-compute[75391]:         <nova:port uuid="b4140c76-b437-46c4-b8f4-dfafb44d7431">
Nov 15 02:48:03 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 02:48:03 user nova-compute[75391]:         </nova:port>
Nov 15 02:48:03 user nova-compute[75391]:       </nova:ports>
Nov 15 02:48:03 user nova-compute[75391]:     </nova:instance>
Nov 15 02:48:03 user nova-compute[75391]:   </metadata>
Nov 15 02:48:03 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:48:03 user nova-compute[75391]:     <system>
Nov 15 02:48:03 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:48:03 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:48:03 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:48:03 user nova-compute[75391]:       <entry name="serial">054d3064-549d-442e-85ea-4c7bfde518cb</entry>
Nov 15 02:48:03 user nova-compute[75391]:       <entry name="uuid">054d3064-549d-442e-85ea-4c7bfde518cb</entry>
Nov 15 02:48:03 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:48:03 user nova-compute[75391]:     </system>
Nov 15 02:48:03 user nova-compute[75391]:   </sysinfo>
Nov 15 02:48:03 user nova-compute[75391]:   <os>
Nov 15 02:48:03 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:48:03 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:48:03 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:48:03 user nova-compute[75391]:   </os>
Nov 15 02:48:03 user nova-compute[75391]:   <features>
Nov 15 02:48:03 user nova-compute[75391]:     <acpi/>
Nov 15 02:48:03 user nova-compute[75391]:     <apic/>
Nov 15 02:48:03 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:48:03 user nova-compute[75391]:   </features>
Nov 15 02:48:03 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:48:03 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:48:03 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:48:03 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:48:03 user nova-compute[75391]:   </clock>
Nov 15 02:48:03 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:48:03 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:48:03 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:48:03 user nova-compute[75391]:   </cpu>
Nov 15 02:48:03 user nova-compute[75391]:   <devices>
Nov 15 02:48:03 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:48:03 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:48:03 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/054d3064-549d-442e-85ea-4c7bfde518cb/disk"/>
Nov 15 02:48:03 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:48:03 user nova-compute[75391]:     </disk>
Nov 15 02:48:03 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:48:03 user nova-compute[75391]:       <mac address="fa:16:3e:0c:35:87"/>
Nov 15 02:48:03 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:48:03 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:48:03 user nova-compute[75391]:       <target dev="tapb4140c76-b4"/>
Nov 15 02:48:03 user nova-compute[75391]:     </interface>
Nov 15 02:48:03 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:48:03 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/054d3064-549d-442e-85ea-4c7bfde518cb/console.log" append="off"/>
Nov 15 02:48:03 user nova-compute[75391]:     </serial>
Nov 15 02:48:03 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:48:03 user nova-compute[75391]:     <video>
Nov 15 02:48:03 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:48:03 user nova-compute[75391]:     </video>
Nov 15 02:48:03 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:48:03 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:48:03 user nova-compute[75391]:     </rng>
Nov 15 02:48:03 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:48:03 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:48:03 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:48:03 user nova-compute[75391]:     </memballoon>
Nov 15 02:48:03 user nova-compute[75391]:   </devices>
Nov 15 02:48:03 user nova-compute[75391]: </domain>
Nov 15 02:48:03 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:47:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1698704570',display_name='tempest-VolumesSnapshotTestJSON-instance-1698704570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1698704570',id=21,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwgsG2kAX0YzxGKviRlSX9Du8AhDC3KYkFm4bxPVp18IP4rWRKvNzfm9Q1/uOMEvhPg3E0890taPOWtnUpr2+ZdF0RGy/rJJhxJpyFknH5tluoyZcMWc9bnEhSgUGR77w==',key_name='tempest-keypair-970550916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c96a31c2c4cb4586857b6179adf48ec0',ramdisk_id='',reservation_id='r-lll0pqkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1270812690',owner_user_name='tempest-VolumesSnapshotTestJSON-1270812690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:48:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a5832ec3e834e4c8e11d671f7891cdf',uuid=054d3064-549d-442e-85ea-4c7bfde518cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4140c76-b437-46c4-b8f4-dfafb44d7431", "address": "fa:16:3e:0c:35:87", "network": {"id": "07cd9e35-dfd4-4a08-ac37-52c7bfefa42e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1490748469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96a31c2c4cb4586857b6179adf48ec0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4140c76-b4", "ovs_interfaceid": "b4140c76-b437-46c4-b8f4-dfafb44d7431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Converting VIF {"id": "b4140c76-b437-46c4-b8f4-dfafb44d7431", "address": "fa:16:3e:0c:35:87", "network": {"id": "07cd9e35-dfd4-4a08-ac37-52c7bfefa42e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1490748469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96a31c2c4cb4586857b6179adf48ec0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4140c76-b4", "ovs_interfaceid": "b4140c76-b437-46c4-b8f4-dfafb44d7431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:35:87,bridge_name='br-int',has_traffic_filtering=True,id=b4140c76-b437-46c4-b8f4-dfafb44d7431,network=Network(07cd9e35-dfd4-4a08-ac37-52c7bfefa42e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4140c76-b4') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG os_vif [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:35:87,bridge_name='br-int',has_traffic_filtering=True,id=b4140c76-b437-46c4-b8f4-dfafb44d7431,network=Network(07cd9e35-dfd4-4a08-ac37-52c7bfefa42e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4140c76-b4') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7acac5cb-877f-5b6c-aaa0-60579c5e3398', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4140c76-b4, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4140c76-b4, col_values=(('qos', UUID('cd455c2b-d5d1-4b66-b668-93f89a0ca98a')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4140c76-b4, col_values=(('external_ids', {'iface-id': 'b4140c76-b437-46c4-b8f4-dfafb44d7431', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:35:87', 'vm-uuid': '054d3064-549d-442e-85ea-4c7bfde518cb'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] No VIF found with MAC fa:16:3e:08:2f:ea, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:03 user nova-compute[75391]: INFO os_vif [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:35:87,bridge_name='br-int',has_traffic_filtering=True,id=b4140c76-b437-46c4-b8f4-dfafb44d7431,network=Network(07cd9e35-dfd4-4a08-ac37-52c7bfefa42e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4140c76-b4')
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:48:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] No VIF found with MAC fa:16:3e:0c:35:87, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:48:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a3802f1d-bfc1-4d25-8d79-1a5a754d4a1b tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "5c684afe-4c7a-41f1-89fe-8977ae1b5f61" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.374s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:04 user nova-compute[75391]: DEBUG nova.network.neutron [req-1d48d304-931d-45e1-a4df-0b60f38bbbf1 req-d11b655d-c6be-43b3-8324-8c6bffb06b19 service nova] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Updated VIF entry in instance network info cache for port b4140c76-b437-46c4-b8f4-dfafb44d7431. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:48:04 user nova-compute[75391]: DEBUG nova.network.neutron [req-1d48d304-931d-45e1-a4df-0b60f38bbbf1 req-d11b655d-c6be-43b3-8324-8c6bffb06b19 service nova] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Updating instance_info_cache with network_info: [{"id": "b4140c76-b437-46c4-b8f4-dfafb44d7431", "address": "fa:16:3e:0c:35:87", "network": {"id": "07cd9e35-dfd4-4a08-ac37-52c7bfefa42e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1490748469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96a31c2c4cb4586857b6179adf48ec0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4140c76-b4", "ovs_interfaceid": "b4140c76-b437-46c4-b8f4-dfafb44d7431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:48:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1d48d304-931d-45e1-a4df-0b60f38bbbf1 req-d11b655d-c6be-43b3-8324-8c6bffb06b19 service nova] Releasing lock "refresh_cache-054d3064-549d-442e-85ea-4c7bfde518cb" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:48:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-d4a91b98-a92e-4887-acbe-91c58b16a334 req-0ee6121f-142f-4401-b7d3-8a98540a30bd service nova] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Received event network-vif-plugged-b4140c76-b437-46c4-b8f4-dfafb44d7431 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:48:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d4a91b98-a92e-4887-acbe-91c58b16a334 req-0ee6121f-142f-4401-b7d3-8a98540a30bd service nova] Acquiring lock "054d3064-549d-442e-85ea-4c7bfde518cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d4a91b98-a92e-4887-acbe-91c58b16a334 req-0ee6121f-142f-4401-b7d3-8a98540a30bd service nova] Lock "054d3064-549d-442e-85ea-4c7bfde518cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d4a91b98-a92e-4887-acbe-91c58b16a334 req-0ee6121f-142f-4401-b7d3-8a98540a30bd service nova] Lock "054d3064-549d-442e-85ea-4c7bfde518cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-d4a91b98-a92e-4887-acbe-91c58b16a334 req-0ee6121f-142f-4401-b7d3-8a98540a30bd service nova] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] No waiting events found dispatching network-vif-plugged-b4140c76-b437-46c4-b8f4-dfafb44d7431 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:48:05 user nova-compute[75391]: WARNING nova.compute.manager [req-d4a91b98-a92e-4887-acbe-91c58b16a334 req-0ee6121f-142f-4401-b7d3-8a98540a30bd service nova] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Received unexpected event network-vif-plugged-b4140c76-b437-46c4-b8f4-dfafb44d7431 for instance with vm_state building and task_state spawning.
Nov 15 02:48:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "5c684afe-4c7a-41f1-89fe-8977ae1b5f61" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "5c684afe-4c7a-41f1-89fe-8977ae1b5f61" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:07 user nova-compute[75391]: INFO nova.compute.manager [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Detaching volume 69c109b6-7b85-484a-8799-3dc6c05a6787
Nov 15 02:48:07 user nova-compute[75391]: INFO nova.virt.block_device [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Attempting to driver detach volume 69c109b6-7b85-484a-8799-3dc6c05a6787 from mountpoint /dev/vdb
Nov 15 02:48:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Attempting to detach device vdb from instance 5c684afe-4c7a-41f1-89fe-8977ae1b5f61 from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:48:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:48:07 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:48:07 user nova-compute[75391]:   <source dev="/dev/sdi"/>
Nov 15 02:48:07 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:48:07 user nova-compute[75391]:   <serial>69c109b6-7b85-484a-8799-3dc6c05a6787</serial>
Nov 15 02:48:07 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:48:07 user nova-compute[75391]: </disk>
Nov 15 02:48:07 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:48:07 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Successfully detached device vdb from instance 5c684afe-4c7a-41f1-89fe-8977ae1b5f61 from the persistent domain config.
Nov 15 02:48:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5c684afe-4c7a-41f1-89fe-8977ae1b5f61 from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 02:48:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:48:07 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:48:07 user nova-compute[75391]:   <source dev="/dev/sdi"/>
Nov 15 02:48:07 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:48:07 user nova-compute[75391]:   <serial>69c109b6-7b85-484a-8799-3dc6c05a6787</serial>
Nov 15 02:48:07 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:48:07 user nova-compute[75391]: </disk>
Nov 15 02:48:07 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:48:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5c684afe-4c7a-41f1-89fe-8977ae1b5f61 {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 02:48:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-8896946d-59c1-4d18-9c61-fed3b97446df req-73b277c7-c79b-4fa3-bcc8-24db1570a8f8 service nova] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Received event network-vif-plugged-b4140c76-b437-46c4-b8f4-dfafb44d7431 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:48:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8896946d-59c1-4d18-9c61-fed3b97446df req-73b277c7-c79b-4fa3-bcc8-24db1570a8f8 service nova] Acquiring lock "054d3064-549d-442e-85ea-4c7bfde518cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8896946d-59c1-4d18-9c61-fed3b97446df req-73b277c7-c79b-4fa3-bcc8-24db1570a8f8 service nova] Lock "054d3064-549d-442e-85ea-4c7bfde518cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8896946d-59c1-4d18-9c61-fed3b97446df req-73b277c7-c79b-4fa3-bcc8-24db1570a8f8 service nova] Lock "054d3064-549d-442e-85ea-4c7bfde518cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-8896946d-59c1-4d18-9c61-fed3b97446df req-73b277c7-c79b-4fa3-bcc8-24db1570a8f8 service nova] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] No waiting events found dispatching network-vif-plugged-b4140c76-b437-46c4-b8f4-dfafb44d7431 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:48:07 user nova-compute[75391]: WARNING nova.compute.manager [req-8896946d-59c1-4d18-9c61-fed3b97446df req-73b277c7-c79b-4fa3-bcc8-24db1570a8f8 service nova] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Received unexpected event network-vif-plugged-b4140c76-b437-46c4-b8f4-dfafb44d7431 for instance with vm_state building and task_state spawning.
Nov 15 02:48:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:08 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:48:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:48:08 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Instance spawned successfully.
Nov 15 02:48:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:48:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:48:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:48:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:48:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:48:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:48:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:48:08 user nova-compute[75391]: INFO nova.compute.manager [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Took 6.79 seconds to spawn the instance on the hypervisor.
Nov 15 02:48:08 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:48:08 user nova-compute[75391]: INFO nova.compute.manager [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Took 7.85 seconds to build instance.
Nov 15 02:48:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5cd98939-e74f-4462-9517-1b2439a7d84d tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "054d3064-549d-442e-85ea-4c7bfde518cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.027s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:27 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5c684afe-4c7a-41f1-89fe-8977ae1b5f61 is timed out.
Nov 15 02:48:27 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Successfully detached device vdb from instance 5c684afe-4c7a-41f1-89fe-8977ae1b5f61 from the live domain config.
Nov 15 02:48:27 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:48:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bolXhtVM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:48:27 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:48:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:48:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:48:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[959d269e-4ac5-43c9-bb47-3c48dca80a81]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:48:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:48:27 user nova-compute[75391]: No targets found.
Nov 15 02:48:27 user nova-compute[75391]: iSNS:
Nov 15 02:48:27 user nova-compute[75391]: No targets found.
Nov 15 02:48:27 user nova-compute[75391]: STATIC:
Nov 15 02:48:27 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787
Nov 15 02:48:27 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:48:27 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:48:27 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18
Nov 15 02:48:27 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:48:27 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:48:27 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103
Nov 15 02:48:27 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:48:27 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:48:27 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8
Nov 15 02:48:27 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:48:27 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:48:27 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a
Nov 15 02:48:27 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:48:27 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:48:27 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:48:27 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:48:27 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:48:27 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4
Nov 15 02:48:27 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:48:27 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:48:27 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea
Nov 15 02:48:27 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:48:27 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:48:27 user nova-compute[75391]: FIRMWARE:
Nov 15 02:48:27 user nova-compute[75391]: No targets found.
Nov 15 02:48:27 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:48:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:48:27 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:48:27 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:48:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:48:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b038ef-82d4-4b8f-b026-74fbba9c3c84]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:48:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab12212b-c0fb-415b-a9e7-88656212b819]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:48:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:48:27 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:48:27 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:48:27 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:48:27 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:48:27 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:48:27 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:48:27 user nova-compute[75391]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787 (non-flash)
Nov 15 02:48:27 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:48:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:48:27 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:48:27 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:48:27 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:48:27 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:48:27 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:48:27 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:48:27 user nova-compute[75391]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787 (non-flash)
Nov 15 02:48:27 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:48:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f623c1420e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787'): ({'sdi'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:48:27 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Removing single pathed devices sdi {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:48:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3742fa3-f163-438f-b5ff-6a025137bb91]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:48:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[160f5dd7-d6cc-4c7b-898e-0b63c6d91e57]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:48:27 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Flushing IO for device /dev/sdi {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:48:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2160f8-722e-477e-9f65-1c9f31f9dc1b]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:48:28 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:48:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.033s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d189f19d-c652-4b0f-b323-e09bf708968f]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:48:28 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:48:28 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] SCSI volumes sdi have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:48:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:48:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24a774d-0e9a-4110-8ddd-8979ba1711da]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:48:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:48:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9cc5ec-4126-4a52-a4ae-6e02bdf49d55]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:48:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787, portal: 172.16.0.220,3260]
Nov 15 02:48:28 user nova-compute[75391]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787, portal: 172.16.0.220,3260] successful.
Nov 15 02:48:28 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:48:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c109b6-7b85-484a-8799-3dc6c05a6787 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f325bbcf-731d-4312-83eb-0a8d481978cd]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:48:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:48:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:48:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] <== disconnect_volume: return (331ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:48:28 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:48:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:28 user nova-compute[75391]: DEBUG nova.objects.instance [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lazy-loading 'flavor' on Instance uuid 5c684afe-4c7a-41f1-89fe-8977ae1b5f61 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:48:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a830a1d5-09e6-4954-8a3b-b9aba83cd6c2 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "5c684afe-4c7a-41f1-89fe-8977ae1b5f61" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.793s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:29 user nova-compute[75391]: INFO nova.compute.manager [None req-9f8679e4-e4a3-4bf5-92dd-cb7ea61ddb84 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Unrescuing
Nov 15 02:48:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9f8679e4-e4a3-4bf5-92dd-cb7ea61ddb84 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "refresh_cache-6400a5f3-0ec9-4484-930c-1f5061ae5374" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:48:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9f8679e4-e4a3-4bf5-92dd-cb7ea61ddb84 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquired lock "refresh_cache-6400a5f3-0ec9-4484-930c-1f5061ae5374" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:48:29 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9f8679e4-e4a3-4bf5-92dd-cb7ea61ddb84 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:48:29 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9f8679e4-e4a3-4bf5-92dd-cb7ea61ddb84 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Updating instance_info_cache with network_info: [{"id": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "address": "fa:16:3e:84:8e:2f", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f803b5-4e", "ovs_interfaceid": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:48:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9f8679e4-e4a3-4bf5-92dd-cb7ea61ddb84 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Releasing lock "refresh_cache-6400a5f3-0ec9-4484-930c-1f5061ae5374" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:48:29 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9f8679e4-e4a3-4bf5-92dd-cb7ea61ddb84 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lazy-loading 'flavor' on Instance uuid 6400a5f3-0ec9-4484-930c-1f5061ae5374 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:48:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:30 user nova-compute[75391]: DEBUG nova.compute.manager [req-afff9636-7525-471f-bb0b-4e3e0675f6c0 req-2664baed-b8e9-4709-8c56-88c0091b7743 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Received event network-vif-unplugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:48:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-afff9636-7525-471f-bb0b-4e3e0675f6c0 req-2664baed-b8e9-4709-8c56-88c0091b7743 service nova] Acquiring lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-afff9636-7525-471f-bb0b-4e3e0675f6c0 req-2664baed-b8e9-4709-8c56-88c0091b7743 service nova] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-afff9636-7525-471f-bb0b-4e3e0675f6c0 req-2664baed-b8e9-4709-8c56-88c0091b7743 service nova] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:30 user nova-compute[75391]: DEBUG nova.compute.manager [req-afff9636-7525-471f-bb0b-4e3e0675f6c0 req-2664baed-b8e9-4709-8c56-88c0091b7743 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] No waiting events found dispatching network-vif-unplugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:48:30 user nova-compute[75391]: WARNING nova.compute.manager [req-afff9636-7525-471f-bb0b-4e3e0675f6c0 req-2664baed-b8e9-4709-8c56-88c0091b7743 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Received unexpected event network-vif-unplugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 for instance with vm_state rescued and task_state unrescuing.
Nov 15 02:48:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:30 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Instance destroyed successfully.
Nov 15 02:48:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:32 user nova-compute[75391]: DEBUG nova.compute.manager [req-9582ecf8-7db8-46d6-97ec-6696d0fa5503 req-63caeb60-470e-472e-8bb0-396eeeb1f861 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Received event network-vif-plugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:48:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9582ecf8-7db8-46d6-97ec-6696d0fa5503 req-63caeb60-470e-472e-8bb0-396eeeb1f861 service nova] Acquiring lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9582ecf8-7db8-46d6-97ec-6696d0fa5503 req-63caeb60-470e-472e-8bb0-396eeeb1f861 service nova] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9582ecf8-7db8-46d6-97ec-6696d0fa5503 req-63caeb60-470e-472e-8bb0-396eeeb1f861 service nova] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:32 user nova-compute[75391]: DEBUG nova.compute.manager [req-9582ecf8-7db8-46d6-97ec-6696d0fa5503 req-63caeb60-470e-472e-8bb0-396eeeb1f861 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] No waiting events found dispatching network-vif-plugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:48:32 user nova-compute[75391]: WARNING nova.compute.manager [req-9582ecf8-7db8-46d6-97ec-6696d0fa5503 req-63caeb60-470e-472e-8bb0-396eeeb1f861 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Received unexpected event network-vif-plugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 for instance with vm_state rescued and task_state unrescuing.
Nov 15 02:48:32 user nova-compute[75391]: DEBUG nova.compute.manager [req-9582ecf8-7db8-46d6-97ec-6696d0fa5503 req-63caeb60-470e-472e-8bb0-396eeeb1f861 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Received event network-vif-plugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:48:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9582ecf8-7db8-46d6-97ec-6696d0fa5503 req-63caeb60-470e-472e-8bb0-396eeeb1f861 service nova] Acquiring lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9582ecf8-7db8-46d6-97ec-6696d0fa5503 req-63caeb60-470e-472e-8bb0-396eeeb1f861 service nova] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9582ecf8-7db8-46d6-97ec-6696d0fa5503 req-63caeb60-470e-472e-8bb0-396eeeb1f861 service nova] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:32 user nova-compute[75391]: DEBUG nova.compute.manager [req-9582ecf8-7db8-46d6-97ec-6696d0fa5503 req-63caeb60-470e-472e-8bb0-396eeeb1f861 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] No waiting events found dispatching network-vif-plugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:48:32 user nova-compute[75391]: WARNING nova.compute.manager [req-9582ecf8-7db8-46d6-97ec-6696d0fa5503 req-63caeb60-470e-472e-8bb0-396eeeb1f861 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Received unexpected event network-vif-plugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 for instance with vm_state rescued and task_state unrescuing.
Nov 15 02:48:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:34 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9f8679e4-e4a3-4bf5-92dd-cb7ea61ddb84 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:48:34 user nova-compute[75391]: DEBUG nova.compute.manager [req-42a59a18-cacd-478c-9c50-213da225b5c0 req-c3b52d34-7ecb-4b0e-99c7-be055a06a1bf service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Received event network-vif-plugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:48:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-42a59a18-cacd-478c-9c50-213da225b5c0 req-c3b52d34-7ecb-4b0e-99c7-be055a06a1bf service nova] Acquiring lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-42a59a18-cacd-478c-9c50-213da225b5c0 req-c3b52d34-7ecb-4b0e-99c7-be055a06a1bf service nova] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-42a59a18-cacd-478c-9c50-213da225b5c0 req-c3b52d34-7ecb-4b0e-99c7-be055a06a1bf service nova] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:34 user nova-compute[75391]: DEBUG nova.compute.manager [req-42a59a18-cacd-478c-9c50-213da225b5c0 req-c3b52d34-7ecb-4b0e-99c7-be055a06a1bf service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] No waiting events found dispatching network-vif-plugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:48:34 user nova-compute[75391]: WARNING nova.compute.manager [req-42a59a18-cacd-478c-9c50-213da225b5c0 req-c3b52d34-7ecb-4b0e-99c7-be055a06a1bf service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Received unexpected event network-vif-plugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 for instance with vm_state active and task_state None.
Nov 15 02:48:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:42 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:48:42 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:48:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-ebb7e616-3c05-4d99-a0b3-76dc1723e82d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:48:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-ebb7e616-3c05-4d99-a0b3-76dc1723e82d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:48:42 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 02:48:43 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Updating instance_info_cache with network_info: [{"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:48:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-ebb7e616-3c05-4d99-a0b3-76dc1723e82d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:48:43 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 02:48:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:45 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:48:46 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:48:46 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:48:46 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_power_states {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid 9744c8a1-046e-4a00-92e0-92ebb3275ea9 {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid ebb7e616-3c05-4d99-a0b3-76dc1723e82d {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid fc9484c0-9083-4797-8ab1-2ad392822ce8 {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid 38a63a30-a3bc-4556-9fb6-53522dbf2c68 {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid 6400a5f3-0ec9-4484-930c-1f5061ae5374 {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid a4171d96-bb26-473f-a322-178dadbaab0a {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid 5c684afe-4c7a-41f1-89fe-8977ae1b5f61 {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid 2b144078-2d2e-460c-b432-96d6309e338c {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid 5c1c9a3d-04de-4786-a263-dcf19a07e4bc {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid 60762562-adbd-4af6-8c0e-d6363a4111d2 {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid 054d3064-549d-442e-85ea-4c7bfde518cb {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "9744c8a1-046e-4a00-92e0-92ebb3275ea9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "9744c8a1-046e-4a00-92e0-92ebb3275ea9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "fc9484c0-9083-4797-8ab1-2ad392822ce8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "fc9484c0-9083-4797-8ab1-2ad392822ce8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "6400a5f3-0ec9-4484-930c-1f5061ae5374" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "a4171d96-bb26-473f-a322-178dadbaab0a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "a4171d96-bb26-473f-a322-178dadbaab0a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "5c684afe-4c7a-41f1-89fe-8977ae1b5f61" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "5c684afe-4c7a-41f1-89fe-8977ae1b5f61" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "2b144078-2d2e-460c-b432-96d6309e338c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "2b144078-2d2e-460c-b432-96d6309e338c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "5c1c9a3d-04de-4786-a263-dcf19a07e4bc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "5c1c9a3d-04de-4786-a263-dcf19a07e4bc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "054d3064-549d-442e-85ea-4c7bfde518cb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "054d3064-549d-442e-85ea-4c7bfde518cb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "fc9484c0-9083-4797-8ab1-2ad392822ce8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "9744c8a1-046e-4a00-92e0-92ebb3275ea9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "a4171d96-bb26-473f-a322-178dadbaab0a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "5c684afe-4c7a-41f1-89fe-8977ae1b5f61" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "2b144078-2d2e-460c-b432-96d6309e338c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "5c1c9a3d-04de-4786-a263-dcf19a07e4bc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "054d3064-549d-442e-85ea-4c7bfde518cb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:48 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:48:48 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:48:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:49 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:48:50 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:48:50 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:48:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:50 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:48:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c684afe-4c7a-41f1-89fe-8977ae1b5f61/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "4ab2dd85-9758-4ea9-8282-9396a2653393" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:50 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:48:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c684afe-4c7a-41f1-89fe-8977ae1b5f61/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c684afe-4c7a-41f1-89fe-8977ae1b5f61/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:51 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:48:51 user nova-compute[75391]: INFO nova.compute.claims [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Claim successful on node user
Nov 15 02:48:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c684afe-4c7a-41f1-89fe-8977ae1b5f61/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:51 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:48:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:48:51 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:48:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.600s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:51 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:48:51 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:48:51 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:48:51 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:48:51 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:48:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:51 user nova-compute[75391]: DEBUG nova.policy [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '409532d98aae4e5b962d3b142981c79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41caf593c4994c5c86570e1216c01337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:48:52 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:48:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:48:52 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Creating image(s)
Nov 15 02:48:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "/opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "/opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.055s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "923b1fc7693da022cb3fdad817192ec139f94293" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "923b1fc7693da022cb3fdad817192ec139f94293" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b144078-2d2e-460c-b432-96d6309e338c/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/923b1fc7693da022cb3fdad817192ec139f94293.part --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:52 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Successfully created port: 70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:48:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b144078-2d2e-460c-b432-96d6309e338c/disk --force-share --output=json" returned: 0 in 0.589s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b144078-2d2e-460c-b432-96d6309e338c/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/923b1fc7693da022cb3fdad817192ec139f94293.part --force-share --output=json" returned: 0 in 0.183s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:52 user nova-compute[75391]: DEBUG nova.virt.images [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] 81210a1c-ce92-4866-971a-db9d10db76fe was qcow2, converting to raw {{(pid=75391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 02:48:52 user nova-compute[75391]: DEBUG nova.privsep.utils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 02:48:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/923b1fc7693da022cb3fdad817192ec139f94293.part /opt/stack/data/nova/instances/_base/923b1fc7693da022cb3fdad817192ec139f94293.converted {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b144078-2d2e-460c-b432-96d6309e338c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/923b1fc7693da022cb3fdad817192ec139f94293.part /opt/stack/data/nova/instances/_base/923b1fc7693da022cb3fdad817192ec139f94293.converted" returned: 0 in 0.198s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/923b1fc7693da022cb3fdad817192ec139f94293.converted --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG nova.compute.manager [req-bd40435e-17f2-4505-a02a-f5132f1b6e38 req-c6929222-9a51-4971-9a9e-dd92d18822ed service nova] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Received event network-changed-5cf32d19-328e-4636-85cf-9055b9dc516b {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG nova.compute.manager [req-bd40435e-17f2-4505-a02a-f5132f1b6e38 req-c6929222-9a51-4971-9a9e-dd92d18822ed service nova] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Refreshing instance network info cache due to event network-changed-5cf32d19-328e-4636-85cf-9055b9dc516b. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bd40435e-17f2-4505-a02a-f5132f1b6e38 req-c6929222-9a51-4971-9a9e-dd92d18822ed service nova] Acquiring lock "refresh_cache-2b144078-2d2e-460c-b432-96d6309e338c" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bd40435e-17f2-4505-a02a-f5132f1b6e38 req-c6929222-9a51-4971-9a9e-dd92d18822ed service nova] Acquired lock "refresh_cache-2b144078-2d2e-460c-b432-96d6309e338c" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG nova.network.neutron [req-bd40435e-17f2-4505-a02a-f5132f1b6e38 req-c6929222-9a51-4971-9a9e-dd92d18822ed service nova] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Refreshing network info cache for port 5cf32d19-328e-4636-85cf-9055b9dc516b {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/923b1fc7693da022cb3fdad817192ec139f94293.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "923b1fc7693da022cb3fdad817192ec139f94293" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.162s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/923b1fc7693da022cb3fdad817192ec139f94293 --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/923b1fc7693da022cb3fdad817192ec139f94293 --force-share --output=json" returned: 0 in 0.176s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "923b1fc7693da022cb3fdad817192ec139f94293" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "923b1fc7693da022cb3fdad817192ec139f94293" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/923b1fc7693da022cb3fdad817192ec139f94293 --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Successfully updated port: 70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "refresh_cache-4ab2dd85-9758-4ea9-8282-9396a2653393" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquired lock "refresh_cache-4ab2dd85-9758-4ea9-8282-9396a2653393" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/923b1fc7693da022cb3fdad817192ec139f94293 --force-share --output=json" returned: 0 in 0.186s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/923b1fc7693da022cb3fdad817192ec139f94293,backing_fmt=raw /opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG nova.compute.manager [req-78fefe6f-7852-4b6f-9008-c41aa7b5b7f5 req-82d83f75-acf3-4ab9-89be-cb4b10b32c18 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Received event network-changed-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG nova.compute.manager [req-78fefe6f-7852-4b6f-9008-c41aa7b5b7f5 req-82d83f75-acf3-4ab9-89be-cb4b10b32c18 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Refreshing instance network info cache due to event network-changed-70574492-ddbc-47cd-b32c-cd5cb88b8ff7. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-78fefe6f-7852-4b6f-9008-c41aa7b5b7f5 req-82d83f75-acf3-4ab9-89be-cb4b10b32c18 service nova] Acquiring lock "refresh_cache-4ab2dd85-9758-4ea9-8282-9396a2653393" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/923b1fc7693da022cb3fdad817192ec139f94293,backing_fmt=raw /opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393/disk 1073741824" returned: 0 in 0.054s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "923b1fc7693da022cb3fdad817192ec139f94293" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/923b1fc7693da022cb3fdad817192ec139f94293 --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c1c9a3d-04de-4786-a263-dcf19a07e4bc/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/923b1fc7693da022cb3fdad817192ec139f94293 --force-share --output=json" returned: 0 in 0.177s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c1c9a3d-04de-4786-a263-dcf19a07e4bc/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c1c9a3d-04de-4786-a263-dcf19a07e4bc/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Cannot resize image /opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Ensure instance console log exists: /opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c1c9a3d-04de-4786-a263-dcf19a07e4bc/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.network.neutron [req-bd40435e-17f2-4505-a02a-f5132f1b6e38 req-c6929222-9a51-4971-9a9e-dd92d18822ed service nova] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Updated VIF entry in instance network info cache for port 5cf32d19-328e-4636-85cf-9055b9dc516b. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.network.neutron [req-bd40435e-17f2-4505-a02a-f5132f1b6e38 req-c6929222-9a51-4971-9a9e-dd92d18822ed service nova] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Updating instance_info_cache with network_info: [{"id": "5cf32d19-328e-4636-85cf-9055b9dc516b", "address": "fa:16:3e:88:86:50", "network": {"id": "a072f3fa-a5c1-47ad-9521-79920d593ad0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-16679141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4593a86a9104dadb43fce4e25e62b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cf32d19-32", "ovs_interfaceid": "5cf32d19-328e-4636-85cf-9055b9dc516b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bd40435e-17f2-4505-a02a-f5132f1b6e38 req-c6929222-9a51-4971-9a9e-dd92d18822ed service nova] Releasing lock "refresh_cache-2b144078-2d2e-460c-b432-96d6309e338c" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Updating instance_info_cache with network_info: [{"id": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "address": "fa:16:3e:f2:fd:21", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70574492-dd", "ovs_interfaceid": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Releasing lock "refresh_cache-4ab2dd85-9758-4ea9-8282-9396a2653393" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Instance network_info: |[{"id": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "address": "fa:16:3e:f2:fd:21", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70574492-dd", "ovs_interfaceid": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-78fefe6f-7852-4b6f-9008-c41aa7b5b7f5 req-82d83f75-acf3-4ab9-89be-cb4b10b32c18 service nova] Acquired lock "refresh_cache-4ab2dd85-9758-4ea9-8282-9396a2653393" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.network.neutron [req-78fefe6f-7852-4b6f-9008-c41aa7b5b7f5 req-82d83f75-acf3-4ab9-89be-cb4b10b32c18 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Refreshing network info cache for port 70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Start _get_guest_xml network_info=[{"id": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "address": "fa:16:3e:f2:fd:21", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70574492-dd", "ovs_interfaceid": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:48:48Z,direct_url=<?>,disk_format='qcow2',id=81210a1c-ce92-4866-971a-db9d10db76fe,min_disk=0,min_ram=0,name='tempest-scenario-img--244892687',owner='41caf593c4994c5c86570e1216c01337',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:48:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '81210a1c-ce92-4866-971a-db9d10db76fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:54 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:48:54 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:48:48Z,direct_url=<?>,disk_format='qcow2',id=81210a1c-ce92-4866-971a-db9d10db76fe,min_disk=0,min_ram=0,name='tempest-scenario-img--244892687',owner='41caf593c4994c5c86570e1216c01337',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:48:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-394727341',display_name='tempest-TestMinimumBasicScenario-server-394727341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-394727341',id=22,image_ref='81210a1c-ce92-4866-971a-db9d10db76fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZ6EZGLN+EfGp8fJzRNzetOOVWEcuY7sCt4aTMJodPjsJ4aU1LFlPaFJdI5KK4bUycNMY3Xt3trSwZiPJXcT1DuBf6OazrURjmNbp8MnXJppH2o7Lhni/4VA5UukcUi9w==',key_name='tempest-TestMinimumBasicScenario-860918913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41caf593c4994c5c86570e1216c01337',ramdisk_id='',reservation_id='r-g0cgyuhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='81210a1c-ce92-4866-971a-db9d10db76fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1859352909',owner_user_name='tempest-TestMinimumBasicScenario-1859352909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:48:52Z,user_data=None,user_id='409532d98aae4e5b962d3b142981c79a',uuid=4ab2dd85-9758-4ea9-8282-9396a2653393,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "address": "fa:16:3e:f2:fd:21", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70574492-dd", "ovs_interfaceid": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Converting VIF {"id": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "address": "fa:16:3e:f2:fd:21", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70574492-dd", "ovs_interfaceid": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:fd:21,bridge_name='br-int',has_traffic_filtering=True,id=70574492-ddbc-47cd-b32c-cd5cb88b8ff7,network=Network(ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70574492-dd') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.objects.instance [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ab2dd85-9758-4ea9-8282-9396a2653393 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:48:54 user nova-compute[75391]:   <uuid>4ab2dd85-9758-4ea9-8282-9396a2653393</uuid>
Nov 15 02:48:54 user nova-compute[75391]:   <name>instance-00000016</name>
Nov 15 02:48:54 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:48:54 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:48:54 user nova-compute[75391]:   <metadata>
Nov 15 02:48:54 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:48:54 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:48:54 user nova-compute[75391]:       <nova:name>tempest-TestMinimumBasicScenario-server-394727341</nova:name>
Nov 15 02:48:54 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:48:54</nova:creationTime>
Nov 15 02:48:54 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:48:54 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:48:54 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:48:54 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:48:54 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:48:54 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:48:54 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:48:54 user nova-compute[75391]:       <nova:owner>
Nov 15 02:48:54 user nova-compute[75391]:         <nova:user uuid="409532d98aae4e5b962d3b142981c79a">tempest-TestMinimumBasicScenario-1859352909-project-member</nova:user>
Nov 15 02:48:54 user nova-compute[75391]:         <nova:project uuid="41caf593c4994c5c86570e1216c01337">tempest-TestMinimumBasicScenario-1859352909</nova:project>
Nov 15 02:48:54 user nova-compute[75391]:       </nova:owner>
Nov 15 02:48:54 user nova-compute[75391]:       <nova:root type="image" uuid="81210a1c-ce92-4866-971a-db9d10db76fe"/>
Nov 15 02:48:54 user nova-compute[75391]:       <nova:ports>
Nov 15 02:48:54 user nova-compute[75391]:         <nova:port uuid="70574492-ddbc-47cd-b32c-cd5cb88b8ff7">
Nov 15 02:48:54 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 02:48:54 user nova-compute[75391]:         </nova:port>
Nov 15 02:48:54 user nova-compute[75391]:       </nova:ports>
Nov 15 02:48:54 user nova-compute[75391]:     </nova:instance>
Nov 15 02:48:54 user nova-compute[75391]:   </metadata>
Nov 15 02:48:54 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:48:54 user nova-compute[75391]:     <system>
Nov 15 02:48:54 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:48:54 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:48:54 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:48:54 user nova-compute[75391]:       <entry name="serial">4ab2dd85-9758-4ea9-8282-9396a2653393</entry>
Nov 15 02:48:54 user nova-compute[75391]:       <entry name="uuid">4ab2dd85-9758-4ea9-8282-9396a2653393</entry>
Nov 15 02:48:54 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:48:54 user nova-compute[75391]:     </system>
Nov 15 02:48:54 user nova-compute[75391]:   </sysinfo>
Nov 15 02:48:54 user nova-compute[75391]:   <os>
Nov 15 02:48:54 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:48:54 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:48:54 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:48:54 user nova-compute[75391]:   </os>
Nov 15 02:48:54 user nova-compute[75391]:   <features>
Nov 15 02:48:54 user nova-compute[75391]:     <acpi/>
Nov 15 02:48:54 user nova-compute[75391]:     <apic/>
Nov 15 02:48:54 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:48:54 user nova-compute[75391]:   </features>
Nov 15 02:48:54 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:48:54 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:48:54 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:48:54 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:48:54 user nova-compute[75391]:   </clock>
Nov 15 02:48:54 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:48:54 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:48:54 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:48:54 user nova-compute[75391]:   </cpu>
Nov 15 02:48:54 user nova-compute[75391]:   <devices>
Nov 15 02:48:54 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:48:54 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:48:54 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393/disk"/>
Nov 15 02:48:54 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:48:54 user nova-compute[75391]:     </disk>
Nov 15 02:48:54 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:48:54 user nova-compute[75391]:       <mac address="fa:16:3e:f2:fd:21"/>
Nov 15 02:48:54 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:48:54 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:48:54 user nova-compute[75391]:       <target dev="tap70574492-dd"/>
Nov 15 02:48:54 user nova-compute[75391]:     </interface>
Nov 15 02:48:54 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:48:54 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393/console.log" append="off"/>
Nov 15 02:48:54 user nova-compute[75391]:     </serial>
Nov 15 02:48:54 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:48:54 user nova-compute[75391]:     <video>
Nov 15 02:48:54 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:48:54 user nova-compute[75391]:     </video>
Nov 15 02:48:54 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:48:54 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:48:54 user nova-compute[75391]:     </rng>
Nov 15 02:48:54 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:48:54 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:48:54 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:48:54 user nova-compute[75391]:     </memballoon>
Nov 15 02:48:54 user nova-compute[75391]:   </devices>
Nov 15 02:48:54 user nova-compute[75391]: </domain>
Nov 15 02:48:54 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-394727341',display_name='tempest-TestMinimumBasicScenario-server-394727341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-394727341',id=22,image_ref='81210a1c-ce92-4866-971a-db9d10db76fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZ6EZGLN+EfGp8fJzRNzetOOVWEcuY7sCt4aTMJodPjsJ4aU1LFlPaFJdI5KK4bUycNMY3Xt3trSwZiPJXcT1DuBf6OazrURjmNbp8MnXJppH2o7Lhni/4VA5UukcUi9w==',key_name='tempest-TestMinimumBasicScenario-860918913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41caf593c4994c5c86570e1216c01337',ramdisk_id='',reservation_id='r-g0cgyuhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='81210a1c-ce92-4866-971a-db9d10db76fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1859352909',owner_user_name='tempest-TestMinimumBasicScenario-1859352909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:48:52Z,user_data=None,user_id='409532d98aae4e5b962d3b142981c79a',uuid=4ab2dd85-9758-4ea9-8282-9396a2653393,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "address": "fa:16:3e:f2:fd:21", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70574492-dd", "ovs_interfaceid": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Converting VIF {"id": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "address": "fa:16:3e:f2:fd:21", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70574492-dd", "ovs_interfaceid": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:fd:21,bridge_name='br-int',has_traffic_filtering=True,id=70574492-ddbc-47cd-b32c-cd5cb88b8ff7,network=Network(ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70574492-dd') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG os_vif [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:fd:21,bridge_name='br-int',has_traffic_filtering=True,id=70574492-ddbc-47cd-b32c-cd5cb88b8ff7,network=Network(ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70574492-dd') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c044502a-0cb4-5e49-bbca-a2b839046eb6', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70574492-dd, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70574492-dd, col_values=(('qos', UUID('e76d5da0-4f6a-4718-b31e-3d5eccbf9c9f')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70574492-dd, col_values=(('external_ids', {'iface-id': '70574492-ddbc-47cd-b32c-cd5cb88b8ff7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:fd:21', 'vm-uuid': '4ab2dd85-9758-4ea9-8282-9396a2653393'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:54 user nova-compute[75391]: INFO os_vif [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:fd:21,bridge_name='br-int',has_traffic_filtering=True,id=70574492-ddbc-47cd-b32c-cd5cb88b8ff7,network=Network(ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70574492-dd')
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] No VIF found with MAC fa:16:3e:f2:fd:21, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/054d3064-549d-442e-85ea-4c7bfde518cb/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:55 user nova-compute[75391]: DEBUG nova.network.neutron [req-78fefe6f-7852-4b6f-9008-c41aa7b5b7f5 req-82d83f75-acf3-4ab9-89be-cb4b10b32c18 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Updated VIF entry in instance network info cache for port 70574492-ddbc-47cd-b32c-cd5cb88b8ff7. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:48:55 user nova-compute[75391]: DEBUG nova.network.neutron [req-78fefe6f-7852-4b6f-9008-c41aa7b5b7f5 req-82d83f75-acf3-4ab9-89be-cb4b10b32c18 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Updating instance_info_cache with network_info: [{"id": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "address": "fa:16:3e:f2:fd:21", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70574492-dd", "ovs_interfaceid": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:48:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/054d3064-549d-442e-85ea-4c7bfde518cb/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/054d3064-549d-442e-85ea-4c7bfde518cb/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-78fefe6f-7852-4b6f-9008-c41aa7b5b7f5 req-82d83f75-acf3-4ab9-89be-cb4b10b32c18 service nova] Releasing lock "refresh_cache-4ab2dd85-9758-4ea9-8282-9396a2653393" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:48:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Acquiring lock "2b144078-2d2e-460c-b432-96d6309e338c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lock "2b144078-2d2e-460c-b432-96d6309e338c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:55 user nova-compute[75391]: DEBUG nova.objects.instance [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lazy-loading 'flavor' on Instance uuid 2b144078-2d2e-460c-b432-96d6309e338c {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:48:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/054d3064-549d-442e-85ea-4c7bfde518cb/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lock "2b144078-2d2e-460c-b432-96d6309e338c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.compute.manager [req-456c1174-fe61-4593-a5d3-56daafc3f2b3 req-44913da6-99d5-46c0-81bc-3e03cf141482 service nova] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Received event network-changed-e1d514f4-a89c-4f39-ad6e-77ade59a00f1 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.compute.manager [req-456c1174-fe61-4593-a5d3-56daafc3f2b3 req-44913da6-99d5-46c0-81bc-3e03cf141482 service nova] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Refreshing instance network info cache due to event network-changed-e1d514f4-a89c-4f39-ad6e-77ade59a00f1. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-456c1174-fe61-4593-a5d3-56daafc3f2b3 req-44913da6-99d5-46c0-81bc-3e03cf141482 service nova] Acquiring lock "refresh_cache-5c684afe-4c7a-41f1-89fe-8977ae1b5f61" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-456c1174-fe61-4593-a5d3-56daafc3f2b3 req-44913da6-99d5-46c0-81bc-3e03cf141482 service nova] Acquired lock "refresh_cache-5c684afe-4c7a-41f1-89fe-8977ae1b5f61" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.network.neutron [req-456c1174-fe61-4593-a5d3-56daafc3f2b3 req-44913da6-99d5-46c0-81bc-3e03cf141482 service nova] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Refreshing network info cache for port e1d514f4-a89c-4f39-ad6e-77ade59a00f1 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Acquiring lock "d51ffdd2-a462-4360-bc03-49f91c2ef45a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lock "d51ffdd2-a462-4360-bc03-49f91c2ef45a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:58 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Instance spawned successfully.
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-50705e12-3349-4228-a422-8ef1c2218ab1 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "5c684afe-4c7a-41f1-89fe-8977ae1b5f61" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-50705e12-3349-4228-a422-8ef1c2218ab1 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "5c684afe-4c7a-41f1-89fe-8977ae1b5f61" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-50705e12-3349-4228-a422-8ef1c2218ab1 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "5c684afe-4c7a-41f1-89fe-8977ae1b5f61-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-50705e12-3349-4228-a422-8ef1c2218ab1 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "5c684afe-4c7a-41f1-89fe-8977ae1b5f61-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-50705e12-3349-4228-a422-8ef1c2218ab1 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "5c684afe-4c7a-41f1-89fe-8977ae1b5f61-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:58 user nova-compute[75391]: INFO nova.compute.manager [None req-50705e12-3349-4228-a422-8ef1c2218ab1 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Terminating instance
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.compute.manager [None req-50705e12-3349-4228-a422-8ef1c2218ab1 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:48:58 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:48:58 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=7188MB free_disk=25.006919860839844GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Acquiring lock "2b144078-2d2e-460c-b432-96d6309e338c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lock "2b144078-2d2e-460c-b432-96d6309e338c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:58 user nova-compute[75391]: INFO nova.compute.manager [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Attaching volume 5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 to /dev/vdb
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.compute.manager [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG os_brick.utils [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f19607b-2924-44ec-848e-1093242dd5ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a858e331-93c2-4dfd-9732-3fadecc3a6b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:48:58 user nova-compute[75391]: INFO nova.compute.manager [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Took 6.73 seconds to spawn the instance on the hypervisor.
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7deb68c-27b0-44ca-b464-54c411c31b9e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26cdc9f-3412-41be-85d5-1426f0bc7adf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:48:58 user nova-compute[75391]: INFO nova.compute.manager [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Took 7.79 seconds to build instance.
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:48:58 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efe57ed-49b9-4ccf-9b95-703d14a56e8c]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG os_brick.utils [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Updating existing volume attachment record: 6d8613e3-3c9d-4103-b9bb-fd46ebff0e1d {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9744c8a1-046e-4a00-92e0-92ebb3275ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance fc9484c0-9083-4797-8ab1-2ad392822ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 38a63a30-a3bc-4556-9fb6-53522dbf2c68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6400a5f3-0ec9-4484-930c-1f5061ae5374 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance a4171d96-bb26-473f-a322-178dadbaab0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance ebb7e616-3c05-4d99-a0b3-76dc1723e82d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 5c684afe-4c7a-41f1-89fe-8977ae1b5f61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 2b144078-2d2e-460c-b432-96d6309e338c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 5c1c9a3d-04de-4786-a263-dcf19a07e4bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 60762562-adbd-4af6-8c0e-d6363a4111d2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 054d3064-549d-442e-85ea-4c7bfde518cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 4ab2dd85-9758-4ea9-8282-9396a2653393 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f024be37-d5da-4b79-81e4-a547f38dd5d1 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.924s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance d51ffdd2-a462-4360-bc03-49f91c2ef45a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:59 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:48:59 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:48:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:48:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.769s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.620s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:48:59 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:48:59 user nova-compute[75391]: INFO nova.compute.claims [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Claim successful on node user
Nov 15 02:48:59 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Instance destroyed successfully.
Nov 15 02:48:59 user nova-compute[75391]: DEBUG nova.objects.instance [None req-50705e12-3349-4228-a422-8ef1c2218ab1 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lazy-loading 'resources' on Instance uuid 5c684afe-4c7a-41f1-89fe-8977ae1b5f61 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:48:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-50705e12-3349-4228-a422-8ef1c2218ab1 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:45:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-249908960',display_name='tempest-TestStampPattern-server-249908960',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-249908960',id=17,image_ref='3bc600dd-86d7-496d-bff0-2e6c93fc3952',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3B/LEgcjzrDXoVcTjod3suFtQaJB7/AKBOdUne7T90RZ2Rsek9XiExDiKs3DHc1kAHMCNWLEQyKPOAYwsFFBz1wohZQQ7UNT2IOBVNPlD2nJvR8+6i+tJnL4hmFgKSyA==',key_name='tempest-TestStampPattern-587335042',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:46:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49e0ca1f6ce542a482164410c5e67e13',ramdisk_id='',reservation_id='r-uiuyv58g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='38a63a30-a3bc-4556-9fb6-53522dbf2c68',image_min_disk='1',image_min_ram='0',image_owner_id='49e0ca1f6ce542a482164410c5e67e13',image_owner_project_name='tempest-TestStampPattern-1142812634',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1142812634-project-member',image_user_id='80bf1a1698dc420799dbaf2e254e5d74',owner_project_name='tempest-TestStampPattern-1142812634',owner_user_name='tempest-TestStampPattern-1142812634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:46:08Z,user_data=None,user_id='80bf1a1698dc420799dbaf2e254e5d74',uuid=5c684afe-4c7a-41f1-89fe-8977ae1b5f61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1d514f4-a89c-4f39-ad6e-77ade59a00f1", "address": "fa:16:3e:08:2f:ea", "network": {"id": "5567560c-b3c5-4802-b758-92d672458351", "bridge": "br-int", "label": "tempest-TestStampPattern-268456575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e0ca1f6ce542a482164410c5e67e13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d514f4-a8", "ovs_interfaceid": "e1d514f4-a89c-4f39-ad6e-77ade59a00f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:48:59 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-50705e12-3349-4228-a422-8ef1c2218ab1 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Converting VIF {"id": "e1d514f4-a89c-4f39-ad6e-77ade59a00f1", "address": "fa:16:3e:08:2f:ea", "network": {"id": "5567560c-b3c5-4802-b758-92d672458351", "bridge": "br-int", "label": "tempest-TestStampPattern-268456575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e0ca1f6ce542a482164410c5e67e13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d514f4-a8", "ovs_interfaceid": "e1d514f4-a89c-4f39-ad6e-77ade59a00f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:48:59 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-50705e12-3349-4228-a422-8ef1c2218ab1 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:2f:ea,bridge_name='br-int',has_traffic_filtering=True,id=e1d514f4-a89c-4f39-ad6e-77ade59a00f1,network=Network(5567560c-b3c5-4802-b758-92d672458351),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d514f4-a8') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:48:59 user nova-compute[75391]: DEBUG os_vif [None req-50705e12-3349-4228-a422-8ef1c2218ab1 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:2f:ea,bridge_name='br-int',has_traffic_filtering=True,id=e1d514f4-a89c-4f39-ad6e-77ade59a00f1,network=Network(5567560c-b3c5-4802-b758-92d672458351),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d514f4-a8') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:48:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1d514f4-a8, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:48:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:48:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a41cd7b9-6845-43cc-af8d-ca974db337a6) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:48:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:48:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:48:59 user nova-compute[75391]: INFO os_vif [None req-50705e12-3349-4228-a422-8ef1c2218ab1 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:2f:ea,bridge_name='br-int',has_traffic_filtering=True,id=e1d514f4-a89c-4f39-ad6e-77ade59a00f1,network=Network(5567560c-b3c5-4802-b758-92d672458351),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d514f4-a8')
Nov 15 02:48:59 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-50705e12-3349-4228-a422-8ef1c2218ab1 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Deleting instance files /opt/stack/data/nova/instances/5c684afe-4c7a-41f1-89fe-8977ae1b5f61_del
Nov 15 02:48:59 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-50705e12-3349-4228-a422-8ef1c2218ab1 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Deletion of /opt/stack/data/nova/instances/5c684afe-4c7a-41f1-89fe-8977ae1b5f61_del complete
Nov 15 02:48:59 user nova-compute[75391]: DEBUG nova.network.neutron [req-456c1174-fe61-4593-a5d3-56daafc3f2b3 req-44913da6-99d5-46c0-81bc-3e03cf141482 service nova] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Updated VIF entry in instance network info cache for port e1d514f4-a89c-4f39-ad6e-77ade59a00f1. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:48:59 user nova-compute[75391]: DEBUG nova.network.neutron [req-456c1174-fe61-4593-a5d3-56daafc3f2b3 req-44913da6-99d5-46c0-81bc-3e03cf141482 service nova] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Updating instance_info_cache with network_info: [{"id": "e1d514f4-a89c-4f39-ad6e-77ade59a00f1", "address": "fa:16:3e:08:2f:ea", "network": {"id": "5567560c-b3c5-4802-b758-92d672458351", "bridge": "br-int", "label": "tempest-TestStampPattern-268456575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e0ca1f6ce542a482164410c5e67e13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d514f4-a8", "ovs_interfaceid": "e1d514f4-a89c-4f39-ad6e-77ade59a00f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:48:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-456c1174-fe61-4593-a5d3-56daafc3f2b3 req-44913da6-99d5-46c0-81bc-3e03cf141482 service nova] Releasing lock "refresh_cache-5c684afe-4c7a-41f1-89fe-8977ae1b5f61" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:48:59 user nova-compute[75391]: INFO nova.compute.manager [None req-50705e12-3349-4228-a422-8ef1c2218ab1 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 15 02:48:59 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-50705e12-3349-4228-a422-8ef1c2218ab1 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:48:59 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:48:59 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:48:59 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:48:59 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:48:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:48:59 user nova-compute[75391]: DEBUG nova.compute.manager [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:49:00 user nova-compute[75391]: DEBUG nova.compute.manager [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:49:00 user nova-compute[75391]: DEBUG nova.network.neutron [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:49:00 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:49:00 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:49:00 user nova-compute[75391]: DEBUG nova.compute.manager [req-64c84968-6687-423f-84f6-b4805b12be00 req-2ca69207-1b6b-44e9-ad98-5f77e47e52eb service nova] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Received event network-vif-deleted-e1d514f4-a89c-4f39-ad6e-77ade59a00f1 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:00 user nova-compute[75391]: INFO nova.compute.manager [req-64c84968-6687-423f-84f6-b4805b12be00 req-2ca69207-1b6b-44e9-ad98-5f77e47e52eb service nova] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Neutron deleted interface e1d514f4-a89c-4f39-ad6e-77ade59a00f1; detaching it from the instance and deleting it from the info cache
Nov 15 02:49:00 user nova-compute[75391]: DEBUG nova.network.neutron [req-64c84968-6687-423f-84f6-b4805b12be00 req-2ca69207-1b6b-44e9-ad98-5f77e47e52eb service nova] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:49:00 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Took 0.58 seconds to deallocate network for instance.
Nov 15 02:49:00 user nova-compute[75391]: DEBUG nova.compute.manager [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:49:00 user nova-compute[75391]: DEBUG nova.compute.manager [req-64c84968-6687-423f-84f6-b4805b12be00 req-2ca69207-1b6b-44e9-ad98-5f77e47e52eb service nova] [instance: 5c684afe-4c7a-41f1-89fe-8977ae1b5f61] Detach interface failed, port_id=e1d514f4-a89c-4f39-ad6e-77ade59a00f1, reason: Instance 5c684afe-4c7a-41f1-89fe-8977ae1b5f61 could not be found. {{(pid=75391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 02:49:00 user nova-compute[75391]: DEBUG nova.policy [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '261877700997440592893f3f56ad6219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6fd7f1be6840779673284167a8b26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:49:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-50705e12-3349-4228-a422-8ef1c2218ab1 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-50705e12-3349-4228-a422-8ef1c2218ab1 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:00 user nova-compute[75391]: DEBUG nova.compute.manager [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:49:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:49:00 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Creating image(s)
Nov 15 02:49:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Acquiring lock "/opt/stack/data/nova/instances/d51ffdd2-a462-4360-bc03-49f91c2ef45a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lock "/opt/stack/data/nova/instances/d51ffdd2-a462-4360-bc03-49f91c2ef45a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lock "/opt/stack/data/nova/instances/d51ffdd2-a462-4360-bc03-49f91c2ef45a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.193s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.184s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/d51ffdd2-a462-4360-bc03-49f91c2ef45a/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:00 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-50705e12-3349-4228-a422-8ef1c2218ab1 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:49:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/d51ffdd2-a462-4360-bc03-49f91c2ef45a/disk 1073741824" returned: 0 in 0.062s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:00 user nova-compute[75391]: DEBUG nova.network.neutron [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Successfully created port: a0049ee3-4dd2-44f9-a1ec-21124057a196 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:49:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:00 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-50705e12-3349-4228-a422-8ef1c2218ab1 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:49:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-50705e12-3349-4228-a422-8ef1c2218ab1 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.610s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:00 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-50705e12-3349-4228-a422-8ef1c2218ab1 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Deleted allocations for instance 5c684afe-4c7a-41f1-89fe-8977ae1b5f61
Nov 15 02:49:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.195s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:00 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d51ffdd2-a462-4360-bc03-49f91c2ef45a/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:49:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51ffdd2-a462-4360-bc03-49f91c2ef45a/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-50705e12-3349-4228-a422-8ef1c2218ab1 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "5c684afe-4c7a-41f1-89fe-8977ae1b5f61" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.382s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51ffdd2-a462-4360-bc03-49f91c2ef45a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Cannot resize image /opt/stack/data/nova/instances/d51ffdd2-a462-4360-bc03-49f91c2ef45a/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Ensure instance console log exists: /opt/stack/data/nova/instances/d51ffdd2-a462-4360-bc03-49f91c2ef45a/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.network.neutron [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Successfully updated port: a0049ee3-4dd2-44f9-a1ec-21124057a196 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Acquiring lock "refresh_cache-d51ffdd2-a462-4360-bc03-49f91c2ef45a" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Acquired lock "refresh_cache-d51ffdd2-a462-4360-bc03-49f91c2ef45a" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.network.neutron [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.network.neutron [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.network.neutron [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Updating instance_info_cache with network_info: [{"id": "a0049ee3-4dd2-44f9-a1ec-21124057a196", "address": "fa:16:3e:25:63:85", "network": {"id": "f5f7ca9d-040f-4350-8824-3d647c168282", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1458266999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6fd7f1be6840779673284167a8b26b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0049ee3-4d", "ovs_interfaceid": "a0049ee3-4dd2-44f9-a1ec-21124057a196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Releasing lock "refresh_cache-d51ffdd2-a462-4360-bc03-49f91c2ef45a" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.compute.manager [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Instance network_info: |[{"id": "a0049ee3-4dd2-44f9-a1ec-21124057a196", "address": "fa:16:3e:25:63:85", "network": {"id": "f5f7ca9d-040f-4350-8824-3d647c168282", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1458266999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6fd7f1be6840779673284167a8b26b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0049ee3-4d", "ovs_interfaceid": "a0049ee3-4dd2-44f9-a1ec-21124057a196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Start _get_guest_xml network_info=[{"id": "a0049ee3-4dd2-44f9-a1ec-21124057a196", "address": "fa:16:3e:25:63:85", "network": {"id": "f5f7ca9d-040f-4350-8824-3d647c168282", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1458266999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6fd7f1be6840779673284167a8b26b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0049ee3-4d", "ovs_interfaceid": "a0049ee3-4dd2-44f9-a1ec-21124057a196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:49:01 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:49:01 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:48:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-519251436',display_name='tempest-DeleteServersTestJSON-server-519251436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-519251436',id=23,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c6fd7f1be6840779673284167a8b26b',ramdisk_id='',reservation_id='r-sdedsm4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-886416817',owner_user_name='tempest-DeleteServersTestJSON-886416817-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:49:00Z,user_data=None,user_id='261877700997440592893f3f56ad6219',uuid=d51ffdd2-a462-4360-bc03-49f91c2ef45a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0049ee3-4dd2-44f9-a1ec-21124057a196", "address": "fa:16:3e:25:63:85", "network": {"id": "f5f7ca9d-040f-4350-8824-3d647c168282", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1458266999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6fd7f1be6840779673284167a8b26b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0049ee3-4d", "ovs_interfaceid": "a0049ee3-4dd2-44f9-a1ec-21124057a196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Converting VIF {"id": "a0049ee3-4dd2-44f9-a1ec-21124057a196", "address": "fa:16:3e:25:63:85", "network": {"id": "f5f7ca9d-040f-4350-8824-3d647c168282", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1458266999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6fd7f1be6840779673284167a8b26b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0049ee3-4d", "ovs_interfaceid": "a0049ee3-4dd2-44f9-a1ec-21124057a196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:63:85,bridge_name='br-int',has_traffic_filtering=True,id=a0049ee3-4dd2-44f9-a1ec-21124057a196,network=Network(f5f7ca9d-040f-4350-8824-3d647c168282),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0049ee3-4d') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.objects.instance [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lazy-loading 'pci_devices' on Instance uuid d51ffdd2-a462-4360-bc03-49f91c2ef45a {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:49:01 user nova-compute[75391]:   <uuid>d51ffdd2-a462-4360-bc03-49f91c2ef45a</uuid>
Nov 15 02:49:01 user nova-compute[75391]:   <name>instance-00000017</name>
Nov 15 02:49:01 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:49:01 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:49:01 user nova-compute[75391]:   <metadata>
Nov 15 02:49:01 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:49:01 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:49:01 user nova-compute[75391]:       <nova:name>tempest-DeleteServersTestJSON-server-519251436</nova:name>
Nov 15 02:49:01 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:49:01</nova:creationTime>
Nov 15 02:49:01 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:49:01 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:49:01 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:49:01 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:49:01 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:49:01 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:49:01 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:49:01 user nova-compute[75391]:       <nova:owner>
Nov 15 02:49:01 user nova-compute[75391]:         <nova:user uuid="261877700997440592893f3f56ad6219">tempest-DeleteServersTestJSON-886416817-project-member</nova:user>
Nov 15 02:49:01 user nova-compute[75391]:         <nova:project uuid="0c6fd7f1be6840779673284167a8b26b">tempest-DeleteServersTestJSON-886416817</nova:project>
Nov 15 02:49:01 user nova-compute[75391]:       </nova:owner>
Nov 15 02:49:01 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:49:01 user nova-compute[75391]:       <nova:ports>
Nov 15 02:49:01 user nova-compute[75391]:         <nova:port uuid="a0049ee3-4dd2-44f9-a1ec-21124057a196">
Nov 15 02:49:01 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 02:49:01 user nova-compute[75391]:         </nova:port>
Nov 15 02:49:01 user nova-compute[75391]:       </nova:ports>
Nov 15 02:49:01 user nova-compute[75391]:     </nova:instance>
Nov 15 02:49:01 user nova-compute[75391]:   </metadata>
Nov 15 02:49:01 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:49:01 user nova-compute[75391]:     <system>
Nov 15 02:49:01 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:49:01 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:49:01 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:49:01 user nova-compute[75391]:       <entry name="serial">d51ffdd2-a462-4360-bc03-49f91c2ef45a</entry>
Nov 15 02:49:01 user nova-compute[75391]:       <entry name="uuid">d51ffdd2-a462-4360-bc03-49f91c2ef45a</entry>
Nov 15 02:49:01 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:49:01 user nova-compute[75391]:     </system>
Nov 15 02:49:01 user nova-compute[75391]:   </sysinfo>
Nov 15 02:49:01 user nova-compute[75391]:   <os>
Nov 15 02:49:01 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:49:01 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:49:01 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:49:01 user nova-compute[75391]:   </os>
Nov 15 02:49:01 user nova-compute[75391]:   <features>
Nov 15 02:49:01 user nova-compute[75391]:     <acpi/>
Nov 15 02:49:01 user nova-compute[75391]:     <apic/>
Nov 15 02:49:01 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:49:01 user nova-compute[75391]:   </features>
Nov 15 02:49:01 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:49:01 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:49:01 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:49:01 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:49:01 user nova-compute[75391]:   </clock>
Nov 15 02:49:01 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:49:01 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:49:01 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:49:01 user nova-compute[75391]:   </cpu>
Nov 15 02:49:01 user nova-compute[75391]:   <devices>
Nov 15 02:49:01 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:49:01 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:49:01 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/d51ffdd2-a462-4360-bc03-49f91c2ef45a/disk"/>
Nov 15 02:49:01 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:49:01 user nova-compute[75391]:     </disk>
Nov 15 02:49:01 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:49:01 user nova-compute[75391]:       <mac address="fa:16:3e:25:63:85"/>
Nov 15 02:49:01 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:49:01 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:49:01 user nova-compute[75391]:       <target dev="tapa0049ee3-4d"/>
Nov 15 02:49:01 user nova-compute[75391]:     </interface>
Nov 15 02:49:01 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:49:01 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/d51ffdd2-a462-4360-bc03-49f91c2ef45a/console.log" append="off"/>
Nov 15 02:49:01 user nova-compute[75391]:     </serial>
Nov 15 02:49:01 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:49:01 user nova-compute[75391]:     <video>
Nov 15 02:49:01 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:49:01 user nova-compute[75391]:     </video>
Nov 15 02:49:01 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:49:01 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:49:01 user nova-compute[75391]:     </rng>
Nov 15 02:49:01 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:49:01 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:49:01 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:49:01 user nova-compute[75391]:     </memballoon>
Nov 15 02:49:01 user nova-compute[75391]:   </devices>
Nov 15 02:49:01 user nova-compute[75391]: </domain>
Nov 15 02:49:01 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:48:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-519251436',display_name='tempest-DeleteServersTestJSON-server-519251436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-519251436',id=23,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c6fd7f1be6840779673284167a8b26b',ramdisk_id='',reservation_id='r-sdedsm4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-886416817',owner_user_name='tempest-DeleteServersTestJSON-886416817-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:49:00Z,user_data=None,user_id='261877700997440592893f3f56ad6219',uuid=d51ffdd2-a462-4360-bc03-49f91c2ef45a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0049ee3-4dd2-44f9-a1ec-21124057a196", "address": "fa:16:3e:25:63:85", "network": {"id": "f5f7ca9d-040f-4350-8824-3d647c168282", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1458266999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6fd7f1be6840779673284167a8b26b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0049ee3-4d", "ovs_interfaceid": "a0049ee3-4dd2-44f9-a1ec-21124057a196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Converting VIF {"id": "a0049ee3-4dd2-44f9-a1ec-21124057a196", "address": "fa:16:3e:25:63:85", "network": {"id": "f5f7ca9d-040f-4350-8824-3d647c168282", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1458266999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6fd7f1be6840779673284167a8b26b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0049ee3-4d", "ovs_interfaceid": "a0049ee3-4dd2-44f9-a1ec-21124057a196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:63:85,bridge_name='br-int',has_traffic_filtering=True,id=a0049ee3-4dd2-44f9-a1ec-21124057a196,network=Network(f5f7ca9d-040f-4350-8824-3d647c168282),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0049ee3-4d') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG os_vif [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:63:85,bridge_name='br-int',has_traffic_filtering=True,id=a0049ee3-4dd2-44f9-a1ec-21124057a196,network=Network(f5f7ca9d-040f-4350-8824-3d647c168282),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0049ee3-4d') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c2b763b-30e1-57d1-bca1-6be158454a66', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0049ee3-4d, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa0049ee3-4d, col_values=(('qos', UUID('22cc6d6d-4831-47f4-a6be-0c238409a8d9')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa0049ee3-4d, col_values=(('external_ids', {'iface-id': 'a0049ee3-4dd2-44f9-a1ec-21124057a196', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:63:85', 'vm-uuid': 'd51ffdd2-a462-4360-bc03-49f91c2ef45a'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:01 user nova-compute[75391]: INFO os_vif [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:63:85,bridge_name='br-int',has_traffic_filtering=True,id=a0049ee3-4dd2-44f9-a1ec-21124057a196,network=Network(f5f7ca9d-040f-4350-8824-3d647c168282),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0049ee3-4d')
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:49:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] No VIF found with MAC fa:16:3e:25:63:85, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:49:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-769dbaf7-3cdc-4d60-895b-793c9a60502a req-d5e97ad0-9d77-4641-b527-f937a1516873 service nova] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Received event network-changed-a0049ee3-4dd2-44f9-a1ec-21124057a196 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-769dbaf7-3cdc-4d60-895b-793c9a60502a req-d5e97ad0-9d77-4641-b527-f937a1516873 service nova] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Refreshing instance network info cache due to event network-changed-a0049ee3-4dd2-44f9-a1ec-21124057a196. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:49:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-769dbaf7-3cdc-4d60-895b-793c9a60502a req-d5e97ad0-9d77-4641-b527-f937a1516873 service nova] Acquiring lock "refresh_cache-d51ffdd2-a462-4360-bc03-49f91c2ef45a" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:49:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-769dbaf7-3cdc-4d60-895b-793c9a60502a req-d5e97ad0-9d77-4641-b527-f937a1516873 service nova] Acquired lock "refresh_cache-d51ffdd2-a462-4360-bc03-49f91c2ef45a" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:49:02 user nova-compute[75391]: DEBUG nova.network.neutron [req-769dbaf7-3cdc-4d60-895b-793c9a60502a req-d5e97ad0-9d77-4641-b527-f937a1516873 service nova] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Refreshing network info cache for port a0049ee3-4dd2-44f9-a1ec-21124057a196 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:49:02 user nova-compute[75391]: DEBUG nova.network.neutron [req-769dbaf7-3cdc-4d60-895b-793c9a60502a req-d5e97ad0-9d77-4641-b527-f937a1516873 service nova] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Updated VIF entry in instance network info cache for port a0049ee3-4dd2-44f9-a1ec-21124057a196. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:49:02 user nova-compute[75391]: DEBUG nova.network.neutron [req-769dbaf7-3cdc-4d60-895b-793c9a60502a req-d5e97ad0-9d77-4641-b527-f937a1516873 service nova] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Updating instance_info_cache with network_info: [{"id": "a0049ee3-4dd2-44f9-a1ec-21124057a196", "address": "fa:16:3e:25:63:85", "network": {"id": "f5f7ca9d-040f-4350-8824-3d647c168282", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1458266999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6fd7f1be6840779673284167a8b26b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0049ee3-4d", "ovs_interfaceid": "a0049ee3-4dd2-44f9-a1ec-21124057a196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:49:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-769dbaf7-3cdc-4d60-895b-793c9a60502a req-d5e97ad0-9d77-4641-b527-f937a1516873 service nova] Releasing lock "refresh_cache-d51ffdd2-a462-4360-bc03-49f91c2ef45a" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:49:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:03 user nova-compute[75391]: DEBUG nova.compute.manager [req-79d6ec93-bf0c-4e99-80ca-e3b8ab492b7f req-42caffb8-71c4-4476-99e1-26eb6846495a service nova] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Received event network-vif-plugged-a0049ee3-4dd2-44f9-a1ec-21124057a196 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-79d6ec93-bf0c-4e99-80ca-e3b8ab492b7f req-42caffb8-71c4-4476-99e1-26eb6846495a service nova] Acquiring lock "d51ffdd2-a462-4360-bc03-49f91c2ef45a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-79d6ec93-bf0c-4e99-80ca-e3b8ab492b7f req-42caffb8-71c4-4476-99e1-26eb6846495a service nova] Lock "d51ffdd2-a462-4360-bc03-49f91c2ef45a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-79d6ec93-bf0c-4e99-80ca-e3b8ab492b7f req-42caffb8-71c4-4476-99e1-26eb6846495a service nova] Lock "d51ffdd2-a462-4360-bc03-49f91c2ef45a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:03 user nova-compute[75391]: DEBUG nova.compute.manager [req-79d6ec93-bf0c-4e99-80ca-e3b8ab492b7f req-42caffb8-71c4-4476-99e1-26eb6846495a service nova] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] No waiting events found dispatching network-vif-plugged-a0049ee3-4dd2-44f9-a1ec-21124057a196 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:49:03 user nova-compute[75391]: WARNING nova.compute.manager [req-79d6ec93-bf0c-4e99-80ca-e3b8ab492b7f req-42caffb8-71c4-4476-99e1-26eb6846495a service nova] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Received unexpected event network-vif-plugged-a0049ee3-4dd2-44f9-a1ec-21124057a196 for instance with vm_state building and task_state spawning.
Nov 15 02:49:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:49:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TDBMlJav', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:49:03 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:49:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:49:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:49:03 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:49:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:49:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:49:03 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:49:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:03 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b920d5ee-a38a-4cce-92de-b96f85cb4f69]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:49:03 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[442d26cc-9ab1-40ca-919e-ecb3806f608a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3] added
Nov 15 02:49:04 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[acca3b3c-5bb9-4a45-a348-5e208c1b9129]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a48bd2-c78f-42b0-9f49-4e94c1589db2]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TDBMlJav {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TDBMlJav" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02b3957-df6d-4720-8790-2a2aee015b13]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TDBMlJav'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef776d5-81cd-492c-a7aa-663df91f575e]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8db66b-dbf0-42b8-bc0a-8f70c1d6263b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:49:04 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:49:04 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:49:04 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:49:04 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:49:04 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:49:04 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:49:04 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:49:04 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:49:04 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:49:04 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:49:04 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:49:04 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:49:04 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:49:04 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d764fbd-4604-423a-aec3-8303a3dcc986]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3, portal: 172.16.0.220,3260]
Nov 15 02:49:04 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3, portal: 172.16.0.220,3260] successful.
Nov 15 02:49:04 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[261d10e2-9dc6-4bf7-a25a-19aafed93604]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-d7e76df1-14dd-46ef-bd77-a9273d008266 req-e0a1c1eb-49e9-4455-b343-fb7e3c0b9d30 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Received event network-vif-plugged-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d7e76df1-14dd-46ef-bd77-a9273d008266 req-e0a1c1eb-49e9-4455-b343-fb7e3c0b9d30 service nova] Acquiring lock "4ab2dd85-9758-4ea9-8282-9396a2653393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d7e76df1-14dd-46ef-bd77-a9273d008266 req-e0a1c1eb-49e9-4455-b343-fb7e3c0b9d30 service nova] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d7e76df1-14dd-46ef-bd77-a9273d008266 req-e0a1c1eb-49e9-4455-b343-fb7e3c0b9d30 service nova] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-d7e76df1-14dd-46ef-bd77-a9273d008266 req-e0a1c1eb-49e9-4455-b343-fb7e3c0b9d30 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] No waiting events found dispatching network-vif-plugged-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:49:04 user nova-compute[75391]: WARNING nova.compute.manager [req-d7e76df1-14dd-46ef-bd77-a9273d008266 req-e0a1c1eb-49e9-4455-b343-fb7e3c0b9d30 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Received unexpected event network-vif-plugged-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 for instance with vm_state active and task_state None.
Nov 15 02:49:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-d7e76df1-14dd-46ef-bd77-a9273d008266 req-e0a1c1eb-49e9-4455-b343-fb7e3c0b9d30 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Received event network-vif-plugged-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d7e76df1-14dd-46ef-bd77-a9273d008266 req-e0a1c1eb-49e9-4455-b343-fb7e3c0b9d30 service nova] Acquiring lock "4ab2dd85-9758-4ea9-8282-9396a2653393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d7e76df1-14dd-46ef-bd77-a9273d008266 req-e0a1c1eb-49e9-4455-b343-fb7e3c0b9d30 service nova] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d7e76df1-14dd-46ef-bd77-a9273d008266 req-e0a1c1eb-49e9-4455-b343-fb7e3c0b9d30 service nova] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-d7e76df1-14dd-46ef-bd77-a9273d008266 req-e0a1c1eb-49e9-4455-b343-fb7e3c0b9d30 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] No waiting events found dispatching network-vif-plugged-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:49:04 user nova-compute[75391]: WARNING nova.compute.manager [req-d7e76df1-14dd-46ef-bd77-a9273d008266 req-e0a1c1eb-49e9-4455-b343-fb7e3c0b9d30 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Received unexpected event network-vif-plugged-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 for instance with vm_state active and task_state None.
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e59122-3f26-46d1-993e-eaa28e95e2b2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:49:04 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:49:04 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:49:04 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:49:04 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:49:04 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:49:04 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:49:04 user nova-compute[75391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 (non-flash)
Nov 15 02:49:04 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:49:04 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:49:04 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:49:04 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:49:04 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:49:04 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:49:04 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:49:04 user nova-compute[75391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 (non-flash)
Nov 15 02:49:04 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] HCTL ('40', '-', '-', 0) found on session 29 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d68cea4-2b64-4625-b2e1-44f02ddaf53b]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Searching for a device in session 29 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:49:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TDBMlJav', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:49:05 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:49:05 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23163373831353839', 'path': '/dev/sdi'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:49:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163373831353839', 'path': '/dev/sdi'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:49:05 user nova-compute[75391]: DEBUG nova.objects.instance [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lazy-loading 'flavor' on Instance uuid 2b144078-2d2e-460c-b432-96d6309e338c {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:49:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 02:49:05 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:49:05 user nova-compute[75391]:   <source dev="/dev/sdi"/>
Nov 15 02:49:05 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:49:05 user nova-compute[75391]:   <serial>5b54d619-56be-4a7c-a0fa-1c4a8598f3b3</serial>
Nov 15 02:49:05 user nova-compute[75391]: </disk>
Nov 15 02:49:05 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:49:05 user nova-compute[75391]: DEBUG nova.compute.manager [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:49:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:49:05 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Instance spawned successfully.
Nov 15 02:49:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:49:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:49:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:49:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:49:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:49:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:49:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:49:05 user nova-compute[75391]: INFO nova.compute.manager [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 15 02:49:05 user nova-compute[75391]: DEBUG nova.compute.manager [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:49:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-3d5414b9-0d5d-463f-8393-db0ddae3ac7e req-fe8fe78f-57c9-43d7-b188-2b76df75af6a service nova] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Received event network-vif-plugged-a0049ee3-4dd2-44f9-a1ec-21124057a196 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3d5414b9-0d5d-463f-8393-db0ddae3ac7e req-fe8fe78f-57c9-43d7-b188-2b76df75af6a service nova] Acquiring lock "d51ffdd2-a462-4360-bc03-49f91c2ef45a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3d5414b9-0d5d-463f-8393-db0ddae3ac7e req-fe8fe78f-57c9-43d7-b188-2b76df75af6a service nova] Lock "d51ffdd2-a462-4360-bc03-49f91c2ef45a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3d5414b9-0d5d-463f-8393-db0ddae3ac7e req-fe8fe78f-57c9-43d7-b188-2b76df75af6a service nova] Lock "d51ffdd2-a462-4360-bc03-49f91c2ef45a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-3d5414b9-0d5d-463f-8393-db0ddae3ac7e req-fe8fe78f-57c9-43d7-b188-2b76df75af6a service nova] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] No waiting events found dispatching network-vif-plugged-a0049ee3-4dd2-44f9-a1ec-21124057a196 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:49:05 user nova-compute[75391]: WARNING nova.compute.manager [req-3d5414b9-0d5d-463f-8393-db0ddae3ac7e req-fe8fe78f-57c9-43d7-b188-2b76df75af6a service nova] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Received unexpected event network-vif-plugged-a0049ee3-4dd2-44f9-a1ec-21124057a196 for instance with vm_state building and task_state spawning.
Nov 15 02:49:05 user nova-compute[75391]: INFO nova.compute.manager [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Took 6.97 seconds to build instance.
Nov 15 02:49:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cac0bbca-6517-4767-97ad-af0a2aabd738 tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lock "d51ffdd2-a462-4360-bc03-49f91c2ef45a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.124s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:49:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:49:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] No VIF found with MAC fa:16:3e:88:86:50, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:49:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-04ceb4c1-8263-4c8b-a83c-975d80c2211e tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Acquiring lock "5c1c9a3d-04de-4786-a263-dcf19a07e4bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-04ceb4c1-8263-4c8b-a83c-975d80c2211e tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "5c1c9a3d-04de-4786-a263-dcf19a07e4bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-04ceb4c1-8263-4c8b-a83c-975d80c2211e tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Acquiring lock "5c1c9a3d-04de-4786-a263-dcf19a07e4bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-04ceb4c1-8263-4c8b-a83c-975d80c2211e tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "5c1c9a3d-04de-4786-a263-dcf19a07e4bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-04ceb4c1-8263-4c8b-a83c-975d80c2211e tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "5c1c9a3d-04de-4786-a263-dcf19a07e4bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:05 user nova-compute[75391]: INFO nova.compute.manager [None req-04ceb4c1-8263-4c8b-a83c-975d80c2211e tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Terminating instance
Nov 15 02:49:05 user nova-compute[75391]: DEBUG nova.compute.manager [None req-04ceb4c1-8263-4c8b-a83c-975d80c2211e tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:49:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0313d6a4-deed-4be1-b59f-dcb7dab258b5 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lock "2b144078-2d2e-460c-b432-96d6309e338c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.372s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:06 user nova-compute[75391]: DEBUG nova.compute.manager [req-c94f1cc5-8d44-4d35-80cc-cd218dd52ae2 req-f128a4a1-f916-4d36-a20a-04f383c44201 service nova] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Received event network-vif-unplugged-ba20e243-e5f1-4bbe-bac2-6163b07e850f {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c94f1cc5-8d44-4d35-80cc-cd218dd52ae2 req-f128a4a1-f916-4d36-a20a-04f383c44201 service nova] Acquiring lock "5c1c9a3d-04de-4786-a263-dcf19a07e4bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c94f1cc5-8d44-4d35-80cc-cd218dd52ae2 req-f128a4a1-f916-4d36-a20a-04f383c44201 service nova] Lock "5c1c9a3d-04de-4786-a263-dcf19a07e4bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c94f1cc5-8d44-4d35-80cc-cd218dd52ae2 req-f128a4a1-f916-4d36-a20a-04f383c44201 service nova] Lock "5c1c9a3d-04de-4786-a263-dcf19a07e4bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:06 user nova-compute[75391]: DEBUG nova.compute.manager [req-c94f1cc5-8d44-4d35-80cc-cd218dd52ae2 req-f128a4a1-f916-4d36-a20a-04f383c44201 service nova] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] No waiting events found dispatching network-vif-unplugged-ba20e243-e5f1-4bbe-bac2-6163b07e850f {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:49:06 user nova-compute[75391]: DEBUG nova.compute.manager [req-c94f1cc5-8d44-4d35-80cc-cd218dd52ae2 req-f128a4a1-f916-4d36-a20a-04f383c44201 service nova] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Received event network-vif-unplugged-ba20e243-e5f1-4bbe-bac2-6163b07e850f for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:49:06 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Instance destroyed successfully.
Nov 15 02:49:06 user nova-compute[75391]: DEBUG nova.objects.instance [None req-04ceb4c1-8263-4c8b-a83c-975d80c2211e tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lazy-loading 'resources' on Instance uuid 5c1c9a3d-04de-4786-a263-dcf19a07e4bc {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:49:06 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-04ceb4c1-8263-4c8b-a83c-975d80c2211e tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1720822387',display_name='tempest-VolumesActionsTest-instance-1720822387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1720822387',id=19,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:47:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='238e9fdacbfe47c7bdd8c638872c6ca2',ramdisk_id='',reservation_id='r-9f0ndmdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-712553389',owner_user_name='tempest-VolumesActionsTest-712553389-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:47:23Z,user_data=None,user_id='6725c61101204b09be4fd561231c4123',uuid=5c1c9a3d-04de-4786-a263-dcf19a07e4bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba20e243-e5f1-4bbe-bac2-6163b07e850f", "address": "fa:16:3e:d8:43:3b", "network": {"id": "fe3b43e0-6135-45f0-97ec-8b2af5fa26fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1391931283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "238e9fdacbfe47c7bdd8c638872c6ca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba20e243-e5", "ovs_interfaceid": "ba20e243-e5f1-4bbe-bac2-6163b07e850f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:49:06 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-04ceb4c1-8263-4c8b-a83c-975d80c2211e tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Converting VIF {"id": "ba20e243-e5f1-4bbe-bac2-6163b07e850f", "address": "fa:16:3e:d8:43:3b", "network": {"id": "fe3b43e0-6135-45f0-97ec-8b2af5fa26fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1391931283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "238e9fdacbfe47c7bdd8c638872c6ca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba20e243-e5", "ovs_interfaceid": "ba20e243-e5f1-4bbe-bac2-6163b07e850f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:49:06 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-04ceb4c1-8263-4c8b-a83c-975d80c2211e tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:43:3b,bridge_name='br-int',has_traffic_filtering=True,id=ba20e243-e5f1-4bbe-bac2-6163b07e850f,network=Network(fe3b43e0-6135-45f0-97ec-8b2af5fa26fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba20e243-e5') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:49:06 user nova-compute[75391]: DEBUG os_vif [None req-04ceb4c1-8263-4c8b-a83c-975d80c2211e tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:43:3b,bridge_name='br-int',has_traffic_filtering=True,id=ba20e243-e5f1-4bbe-bac2-6163b07e850f,network=Network(fe3b43e0-6135-45f0-97ec-8b2af5fa26fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba20e243-e5') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:49:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba20e243-e5, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:49:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e0f94e4-1b2e-407a-9479-138441d0db4d) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:49:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:06 user nova-compute[75391]: INFO os_vif [None req-04ceb4c1-8263-4c8b-a83c-975d80c2211e tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:43:3b,bridge_name='br-int',has_traffic_filtering=True,id=ba20e243-e5f1-4bbe-bac2-6163b07e850f,network=Network(fe3b43e0-6135-45f0-97ec-8b2af5fa26fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba20e243-e5')
Nov 15 02:49:06 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-04ceb4c1-8263-4c8b-a83c-975d80c2211e tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Deleting instance files /opt/stack/data/nova/instances/5c1c9a3d-04de-4786-a263-dcf19a07e4bc_del
Nov 15 02:49:06 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-04ceb4c1-8263-4c8b-a83c-975d80c2211e tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Deletion of /opt/stack/data/nova/instances/5c1c9a3d-04de-4786-a263-dcf19a07e4bc_del complete
Nov 15 02:49:06 user nova-compute[75391]: INFO nova.compute.manager [None req-04ceb4c1-8263-4c8b-a83c-975d80c2211e tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 15 02:49:06 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-04ceb4c1-8263-4c8b-a83c-975d80c2211e tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:49:06 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:49:06 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:49:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-54e50e46-c995-48d4-b22d-af22c06f9f4a req-eff3e022-00ac-4b31-a408-fc37fbee0690 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-changed-59301df7-815a-4047-b6e2-190a0e80b4d4 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-54e50e46-c995-48d4-b22d-af22c06f9f4a req-eff3e022-00ac-4b31-a408-fc37fbee0690 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Refreshing instance network info cache due to event network-changed-59301df7-815a-4047-b6e2-190a0e80b4d4. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:49:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-54e50e46-c995-48d4-b22d-af22c06f9f4a req-eff3e022-00ac-4b31-a408-fc37fbee0690 service nova] Acquiring lock "refresh_cache-60762562-adbd-4af6-8c0e-d6363a4111d2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:49:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-54e50e46-c995-48d4-b22d-af22c06f9f4a req-eff3e022-00ac-4b31-a408-fc37fbee0690 service nova] Acquired lock "refresh_cache-60762562-adbd-4af6-8c0e-d6363a4111d2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:49:07 user nova-compute[75391]: DEBUG nova.network.neutron [req-54e50e46-c995-48d4-b22d-af22c06f9f4a req-eff3e022-00ac-4b31-a408-fc37fbee0690 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Refreshing network info cache for port 59301df7-815a-4047-b6e2-190a0e80b4d4 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:49:07 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:49:07 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Took 0.87 seconds to deallocate network for instance.
Nov 15 02:49:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-04ceb4c1-8263-4c8b-a83c-975d80c2211e tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-04ceb4c1-8263-4c8b-a83c-975d80c2211e tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Acquiring lock "2b144078-2d2e-460c-b432-96d6309e338c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lock "2b144078-2d2e-460c-b432-96d6309e338c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:08 user nova-compute[75391]: INFO nova.compute.manager [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Detaching volume 5b54d619-56be-4a7c-a0fa-1c4a8598f3b3
Nov 15 02:49:08 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-04ceb4c1-8263-4c8b-a83c-975d80c2211e tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:49:08 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-04ceb4c1-8263-4c8b-a83c-975d80c2211e tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:49:08 user nova-compute[75391]: INFO nova.virt.block_device [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Attempting to driver detach volume 5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 from mountpoint /dev/vdb
Nov 15 02:49:08 user nova-compute[75391]: DEBUG nova.network.neutron [req-54e50e46-c995-48d4-b22d-af22c06f9f4a req-eff3e022-00ac-4b31-a408-fc37fbee0690 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Updated VIF entry in instance network info cache for port 59301df7-815a-4047-b6e2-190a0e80b4d4. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:49:08 user nova-compute[75391]: DEBUG nova.network.neutron [req-54e50e46-c995-48d4-b22d-af22c06f9f4a req-eff3e022-00ac-4b31-a408-fc37fbee0690 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Updating instance_info_cache with network_info: [{"id": "59301df7-815a-4047-b6e2-190a0e80b4d4", "address": "fa:16:3e:11:89:27", "network": {"id": "e4f300b0-c84b-4d12-9cd9-b2b92726d342", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1598402766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59301df7-81", "ovs_interfaceid": "59301df7-815a-4047-b6e2-190a0e80b4d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d42541b2-a63d-470b-88ff-078657735d0a", "address": "fa:16:3e:ef:72:46", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42541b2-a6", "ovs_interfaceid": "d42541b2-a63d-470b-88ff-078657735d0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a2c8701-e54c-4ad6-b508-bbfbdd7e263c", "address": "fa:16:3e:ba:d3:c1", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a2c8701-e5", "ovs_interfaceid": "6a2c8701-e54c-4ad6-b508-bbfbdd7e263c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b870665b-9254-4608-bd91-7aa46ed614d8", "address": "fa:16:3e:51:a0:67", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb870665b-92", "ovs_interfaceid": "b870665b-9254-4608-bd91-7aa46ed614d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "973cfe4a-ca5b-463e-b8e1-3477e73b20fb", "address": "fa:16:3e:1a:d1:fc", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973cfe4a-ca", "ovs_interfaceid": "973cfe4a-ca5b-463e-b8e1-3477e73b20fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2", "address": "fa:16:3e:fd:5f:e6", "network": {"id": "b2951d9f-4d4e-49b4-86db-e6d3b1460558", "bridge": "br-int", "label": "tempest-device-tagging-net2-258791214", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c79b81c-4b", "ovs_interfaceid": "4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d91f58e8-8742-4077-9536-9e7f4cf22a8c", "address": "fa:16:3e:1a:e8:a6", "network": {"id": "b2951d9f-4d4e-49b4-86db-e6d3b1460558", "bridge": "br-int", "label": "tempest-device-tagging-net2-258791214", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd91f58e8-87", "ovs_interfaceid": "d91f58e8-8742-4077-9536-9e7f4cf22a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:49:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-04ceb4c1-8263-4c8b-a83c-975d80c2211e tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.466s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Attempting to detach device vdb from instance 2b144078-2d2e-460c-b432-96d6309e338c from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:49:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:49:08 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:49:08 user nova-compute[75391]:   <source dev="/dev/sdi"/>
Nov 15 02:49:08 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:49:08 user nova-compute[75391]:   <serial>5b54d619-56be-4a7c-a0fa-1c4a8598f3b3</serial>
Nov 15 02:49:08 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:49:08 user nova-compute[75391]: </disk>
Nov 15 02:49:08 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:49:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-54e50e46-c995-48d4-b22d-af22c06f9f4a req-eff3e022-00ac-4b31-a408-fc37fbee0690 service nova] Releasing lock "refresh_cache-60762562-adbd-4af6-8c0e-d6363a4111d2" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:49:08 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Successfully detached device vdb from instance 2b144078-2d2e-460c-b432-96d6309e338c from the persistent domain config.
Nov 15 02:49:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2b144078-2d2e-460c-b432-96d6309e338c from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 02:49:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:49:08 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:49:08 user nova-compute[75391]:   <source dev="/dev/sdi"/>
Nov 15 02:49:08 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:49:08 user nova-compute[75391]:   <serial>5b54d619-56be-4a7c-a0fa-1c4a8598f3b3</serial>
Nov 15 02:49:08 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:49:08 user nova-compute[75391]: </disk>
Nov 15 02:49:08 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:49:08 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-04ceb4c1-8263-4c8b-a83c-975d80c2211e tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Deleted allocations for instance 5c1c9a3d-04de-4786-a263-dcf19a07e4bc
Nov 15 02:49:08 user nova-compute[75391]: DEBUG nova.compute.manager [req-cbb56e4b-3d56-430f-8fa0-ff0afbe7a3fb req-182088b8-3890-474c-8136-7559388d2eec service nova] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Received event network-vif-plugged-ba20e243-e5f1-4bbe-bac2-6163b07e850f {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-cbb56e4b-3d56-430f-8fa0-ff0afbe7a3fb req-182088b8-3890-474c-8136-7559388d2eec service nova] Acquiring lock "5c1c9a3d-04de-4786-a263-dcf19a07e4bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-cbb56e4b-3d56-430f-8fa0-ff0afbe7a3fb req-182088b8-3890-474c-8136-7559388d2eec service nova] Lock "5c1c9a3d-04de-4786-a263-dcf19a07e4bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-cbb56e4b-3d56-430f-8fa0-ff0afbe7a3fb req-182088b8-3890-474c-8136-7559388d2eec service nova] Lock "5c1c9a3d-04de-4786-a263-dcf19a07e4bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:08 user nova-compute[75391]: DEBUG nova.compute.manager [req-cbb56e4b-3d56-430f-8fa0-ff0afbe7a3fb req-182088b8-3890-474c-8136-7559388d2eec service nova] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] No waiting events found dispatching network-vif-plugged-ba20e243-e5f1-4bbe-bac2-6163b07e850f {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:49:08 user nova-compute[75391]: WARNING nova.compute.manager [req-cbb56e4b-3d56-430f-8fa0-ff0afbe7a3fb req-182088b8-3890-474c-8136-7559388d2eec service nova] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Received unexpected event network-vif-plugged-ba20e243-e5f1-4bbe-bac2-6163b07e850f for instance with vm_state deleted and task_state None.
Nov 15 02:49:08 user nova-compute[75391]: DEBUG nova.compute.manager [req-cbb56e4b-3d56-430f-8fa0-ff0afbe7a3fb req-182088b8-3890-474c-8136-7559388d2eec service nova] [instance: 5c1c9a3d-04de-4786-a263-dcf19a07e4bc] Received event network-vif-deleted-ba20e243-e5f1-4bbe-bac2-6163b07e850f {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-04ceb4c1-8263-4c8b-a83c-975d80c2211e tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "5c1c9a3d-04de-4786-a263-dcf19a07e4bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.502s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2b144078-2d2e-460c-b432-96d6309e338c {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 02:49:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:09 user nova-compute[75391]: INFO nova.compute.manager [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Terminating instance
Nov 15 02:49:09 user nova-compute[75391]: DEBUG nova.compute.manager [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:49:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG nova.compute.manager [req-8181b95b-9bfe-4f57-8585-47f811ac40e2 req-9dfd753e-a276-48db-a978-ed3228465d69 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-unplugged-59301df7-815a-4047-b6e2-190a0e80b4d4 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8181b95b-9bfe-4f57-8585-47f811ac40e2 req-9dfd753e-a276-48db-a978-ed3228465d69 service nova] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8181b95b-9bfe-4f57-8585-47f811ac40e2 req-9dfd753e-a276-48db-a978-ed3228465d69 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8181b95b-9bfe-4f57-8585-47f811ac40e2 req-9dfd753e-a276-48db-a978-ed3228465d69 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG nova.compute.manager [req-8181b95b-9bfe-4f57-8585-47f811ac40e2 req-9dfd753e-a276-48db-a978-ed3228465d69 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] No waiting events found dispatching network-vif-unplugged-59301df7-815a-4047-b6e2-190a0e80b4d4 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG nova.compute.manager [req-8181b95b-9bfe-4f57-8585-47f811ac40e2 req-9dfd753e-a276-48db-a978-ed3228465d69 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-unplugged-59301df7-815a-4047-b6e2-190a0e80b4d4 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG nova.compute.manager [req-8181b95b-9bfe-4f57-8585-47f811ac40e2 req-9dfd753e-a276-48db-a978-ed3228465d69 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-plugged-59301df7-815a-4047-b6e2-190a0e80b4d4 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8181b95b-9bfe-4f57-8585-47f811ac40e2 req-9dfd753e-a276-48db-a978-ed3228465d69 service nova] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8181b95b-9bfe-4f57-8585-47f811ac40e2 req-9dfd753e-a276-48db-a978-ed3228465d69 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8181b95b-9bfe-4f57-8585-47f811ac40e2 req-9dfd753e-a276-48db-a978-ed3228465d69 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG nova.compute.manager [req-8181b95b-9bfe-4f57-8585-47f811ac40e2 req-9dfd753e-a276-48db-a978-ed3228465d69 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] No waiting events found dispatching network-vif-plugged-59301df7-815a-4047-b6e2-190a0e80b4d4 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:49:10 user nova-compute[75391]: WARNING nova.compute.manager [req-8181b95b-9bfe-4f57-8585-47f811ac40e2 req-9dfd753e-a276-48db-a978-ed3228465d69 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received unexpected event network-vif-plugged-59301df7-815a-4047-b6e2-190a0e80b4d4 for instance with vm_state active and task_state deleting.
Nov 15 02:49:10 user nova-compute[75391]: DEBUG nova.compute.manager [req-c6e98f63-119c-4688-85a5-0fbe8b5208d5 req-ecea230a-cca0-4d21-9412-57a3fd3a3b57 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-unplugged-d42541b2-a63d-470b-88ff-078657735d0a {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c6e98f63-119c-4688-85a5-0fbe8b5208d5 req-ecea230a-cca0-4d21-9412-57a3fd3a3b57 service nova] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c6e98f63-119c-4688-85a5-0fbe8b5208d5 req-ecea230a-cca0-4d21-9412-57a3fd3a3b57 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c6e98f63-119c-4688-85a5-0fbe8b5208d5 req-ecea230a-cca0-4d21-9412-57a3fd3a3b57 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG nova.compute.manager [req-c6e98f63-119c-4688-85a5-0fbe8b5208d5 req-ecea230a-cca0-4d21-9412-57a3fd3a3b57 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] No waiting events found dispatching network-vif-unplugged-d42541b2-a63d-470b-88ff-078657735d0a {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG nova.compute.manager [req-c6e98f63-119c-4688-85a5-0fbe8b5208d5 req-ecea230a-cca0-4d21-9412-57a3fd3a3b57 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-unplugged-d42541b2-a63d-470b-88ff-078657735d0a for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:11 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Instance destroyed successfully.
Nov 15 02:49:11 user nova-compute[75391]: DEBUG nova.objects.instance [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lazy-loading 'resources' on Instance uuid 60762562-adbd-4af6-8c0e-d6363a4111d2 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:49:11 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539282742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539282742',id=20,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKza1whiTyjorzZVhyM5Da4n8+g8hKkFF6P0kflNEQ+1nL/QCauJlu23FgG5vnkGFXLe4gXIyZt4E7kXz1Lx1BPYqrYXAg8ZGX9DrYKxZncH5Sd0WgI2mhhpCQa/hbpklw==',key_name='tempest-keypair-1303500730',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:47:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70ba612613604fa38f1bb4ec29602cac',ramdisk_id='',reservation_id='r-edo4xu27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-408717637',owner_user_name='tempest-TaggedBootDevicesTest_v242-408717637-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:47:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4380b18a109e458f9b08a5154dfd5d27',uuid=60762562-adbd-4af6-8c0e-d6363a4111d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59301df7-815a-4047-b6e2-190a0e80b4d4", "address": "fa:16:3e:11:89:27", "network": {"id": "e4f300b0-c84b-4d12-9cd9-b2b92726d342", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1598402766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59301df7-81", "ovs_interfaceid": "59301df7-815a-4047-b6e2-190a0e80b4d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:49:11 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converting VIF {"id": "59301df7-815a-4047-b6e2-190a0e80b4d4", "address": "fa:16:3e:11:89:27", "network": {"id": "e4f300b0-c84b-4d12-9cd9-b2b92726d342", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1598402766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59301df7-81", "ovs_interfaceid": "59301df7-815a-4047-b6e2-190a0e80b4d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:49:11 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:89:27,bridge_name='br-int',has_traffic_filtering=True,id=59301df7-815a-4047-b6e2-190a0e80b4d4,network=Network(e4f300b0-c84b-4d12-9cd9-b2b92726d342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59301df7-81') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:49:11 user nova-compute[75391]: DEBUG os_vif [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:89:27,bridge_name='br-int',has_traffic_filtering=True,id=59301df7-815a-4047-b6e2-190a0e80b4d4,network=Network(e4f300b0-c84b-4d12-9cd9-b2b92726d342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59301df7-81') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:49:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59301df7-81, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c27527f3-1062-4192-90f8-ac645fb69ed6) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: INFO os_vif [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:89:27,bridge_name='br-int',has_traffic_filtering=True,id=59301df7-815a-4047-b6e2-190a0e80b4d4,network=Network(e4f300b0-c84b-4d12-9cd9-b2b92726d342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59301df7-81')
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539282742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539282742',id=20,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKza1whiTyjorzZVhyM5Da4n8+g8hKkFF6P0kflNEQ+1nL/QCauJlu23FgG5vnkGFXLe4gXIyZt4E7kXz1Lx1BPYqrYXAg8ZGX9DrYKxZncH5Sd0WgI2mhhpCQa/hbpklw==',key_name='tempest-keypair-1303500730',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:47:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70ba612613604fa38f1bb4ec29602cac',ramdisk_id='',reservation_id='r-edo4xu27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-408717637',owner_user_name='tempest-TaggedBootDevicesTest_v242-408717637-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:47:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4380b18a109e458f9b08a5154dfd5d27',uuid=60762562-adbd-4af6-8c0e-d6363a4111d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d42541b2-a63d-470b-88ff-078657735d0a", "address": "fa:16:3e:ef:72:46", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42541b2-a6", "ovs_interfaceid": "d42541b2-a63d-470b-88ff-078657735d0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converting VIF {"id": "d42541b2-a63d-470b-88ff-078657735d0a", "address": "fa:16:3e:ef:72:46", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42541b2-a6", "ovs_interfaceid": "d42541b2-a63d-470b-88ff-078657735d0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:72:46,bridge_name='br-int',has_traffic_filtering=True,id=d42541b2-a63d-470b-88ff-078657735d0a,network=Network(74933e47-dccc-47d3-8c5c-a355abc6d0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd42541b2-a6') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG os_vif [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:72:46,bridge_name='br-int',has_traffic_filtering=True,id=d42541b2-a63d-470b-88ff-078657735d0a,network=Network(74933e47-dccc-47d3-8c5c-a355abc6d0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd42541b2-a6') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd42541b2-a6, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd872e34-fe70-4b40-ad44-cfd0bd17d3d8) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: INFO os_vif [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:72:46,bridge_name='br-int',has_traffic_filtering=True,id=d42541b2-a63d-470b-88ff-078657735d0a,network=Network(74933e47-dccc-47d3-8c5c-a355abc6d0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd42541b2-a6')
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539282742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539282742',id=20,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKza1whiTyjorzZVhyM5Da4n8+g8hKkFF6P0kflNEQ+1nL/QCauJlu23FgG5vnkGFXLe4gXIyZt4E7kXz1Lx1BPYqrYXAg8ZGX9DrYKxZncH5Sd0WgI2mhhpCQa/hbpklw==',key_name='tempest-keypair-1303500730',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:47:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70ba612613604fa38f1bb4ec29602cac',ramdisk_id='',reservation_id='r-edo4xu27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-408717637',owner_user_name='tempest-TaggedBootDevicesTest_v242-408717637-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:47:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4380b18a109e458f9b08a5154dfd5d27',uuid=60762562-adbd-4af6-8c0e-d6363a4111d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a2c8701-e54c-4ad6-b508-bbfbdd7e263c", "address": "fa:16:3e:ba:d3:c1", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a2c8701-e5", "ovs_interfaceid": "6a2c8701-e54c-4ad6-b508-bbfbdd7e263c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converting VIF {"id": "6a2c8701-e54c-4ad6-b508-bbfbdd7e263c", "address": "fa:16:3e:ba:d3:c1", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a2c8701-e5", "ovs_interfaceid": "6a2c8701-e54c-4ad6-b508-bbfbdd7e263c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:d3:c1,bridge_name='br-int',has_traffic_filtering=True,id=6a2c8701-e54c-4ad6-b508-bbfbdd7e263c,network=Network(74933e47-dccc-47d3-8c5c-a355abc6d0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a2c8701-e5') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG os_vif [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:d3:c1,bridge_name='br-int',has_traffic_filtering=True,id=6a2c8701-e54c-4ad6-b508-bbfbdd7e263c,network=Network(74933e47-dccc-47d3-8c5c-a355abc6d0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a2c8701-e5') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a2c8701-e5, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0c3b168-030b-4fb4-83ac-49a240756aad) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: INFO os_vif [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:d3:c1,bridge_name='br-int',has_traffic_filtering=True,id=6a2c8701-e54c-4ad6-b508-bbfbdd7e263c,network=Network(74933e47-dccc-47d3-8c5c-a355abc6d0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a2c8701-e5')
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539282742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539282742',id=20,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKza1whiTyjorzZVhyM5Da4n8+g8hKkFF6P0kflNEQ+1nL/QCauJlu23FgG5vnkGFXLe4gXIyZt4E7kXz1Lx1BPYqrYXAg8ZGX9DrYKxZncH5Sd0WgI2mhhpCQa/hbpklw==',key_name='tempest-keypair-1303500730',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:47:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70ba612613604fa38f1bb4ec29602cac',ramdisk_id='',reservation_id='r-edo4xu27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-408717637',owner_user_name='tempest-TaggedBootDevicesTest_v242-408717637-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:47:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4380b18a109e458f9b08a5154dfd5d27',uuid=60762562-adbd-4af6-8c0e-d6363a4111d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b870665b-9254-4608-bd91-7aa46ed614d8", "address": "fa:16:3e:51:a0:67", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb870665b-92", "ovs_interfaceid": "b870665b-9254-4608-bd91-7aa46ed614d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converting VIF {"id": "b870665b-9254-4608-bd91-7aa46ed614d8", "address": "fa:16:3e:51:a0:67", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb870665b-92", "ovs_interfaceid": "b870665b-9254-4608-bd91-7aa46ed614d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:a0:67,bridge_name='br-int',has_traffic_filtering=True,id=b870665b-9254-4608-bd91-7aa46ed614d8,network=Network(74933e47-dccc-47d3-8c5c-a355abc6d0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb870665b-92') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG os_vif [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:a0:67,bridge_name='br-int',has_traffic_filtering=True,id=b870665b-9254-4608-bd91-7aa46ed614d8,network=Network(74933e47-dccc-47d3-8c5c-a355abc6d0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb870665b-92') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb870665b-92, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75da5889-26ed-4601-b601-6ca1c52228a2) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: INFO os_vif [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:a0:67,bridge_name='br-int',has_traffic_filtering=True,id=b870665b-9254-4608-bd91-7aa46ed614d8,network=Network(74933e47-dccc-47d3-8c5c-a355abc6d0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb870665b-92')
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539282742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539282742',id=20,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKza1whiTyjorzZVhyM5Da4n8+g8hKkFF6P0kflNEQ+1nL/QCauJlu23FgG5vnkGFXLe4gXIyZt4E7kXz1Lx1BPYqrYXAg8ZGX9DrYKxZncH5Sd0WgI2mhhpCQa/hbpklw==',key_name='tempest-keypair-1303500730',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:47:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70ba612613604fa38f1bb4ec29602cac',ramdisk_id='',reservation_id='r-edo4xu27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-408717637',owner_user_name='tempest-TaggedBootDevicesTest_v242-408717637-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:47:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4380b18a109e458f9b08a5154dfd5d27',uuid=60762562-adbd-4af6-8c0e-d6363a4111d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "973cfe4a-ca5b-463e-b8e1-3477e73b20fb", "address": "fa:16:3e:1a:d1:fc", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973cfe4a-ca", "ovs_interfaceid": "973cfe4a-ca5b-463e-b8e1-3477e73b20fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converting VIF {"id": "973cfe4a-ca5b-463e-b8e1-3477e73b20fb", "address": "fa:16:3e:1a:d1:fc", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973cfe4a-ca", "ovs_interfaceid": "973cfe4a-ca5b-463e-b8e1-3477e73b20fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:d1:fc,bridge_name='br-int',has_traffic_filtering=True,id=973cfe4a-ca5b-463e-b8e1-3477e73b20fb,network=Network(74933e47-dccc-47d3-8c5c-a355abc6d0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap973cfe4a-ca') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG os_vif [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:d1:fc,bridge_name='br-int',has_traffic_filtering=True,id=973cfe4a-ca5b-463e-b8e1-3477e73b20fb,network=Network(74933e47-dccc-47d3-8c5c-a355abc6d0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap973cfe4a-ca') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap973cfe4a-ca, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ffa37f56-6fac-4fae-8213-582135e9c177) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-1e226218-fa82-4ddb-a5de-84330d7d85a5 req-d270353f-3cf7-424a-b664-8304f8b10984 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-unplugged-6a2c8701-e54c-4ad6-b508-bbfbdd7e263c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1e226218-fa82-4ddb-a5de-84330d7d85a5 req-d270353f-3cf7-424a-b664-8304f8b10984 service nova] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1e226218-fa82-4ddb-a5de-84330d7d85a5 req-d270353f-3cf7-424a-b664-8304f8b10984 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1e226218-fa82-4ddb-a5de-84330d7d85a5 req-d270353f-3cf7-424a-b664-8304f8b10984 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-1e226218-fa82-4ddb-a5de-84330d7d85a5 req-d270353f-3cf7-424a-b664-8304f8b10984 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] No waiting events found dispatching network-vif-unplugged-6a2c8701-e54c-4ad6-b508-bbfbdd7e263c {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-1e226218-fa82-4ddb-a5de-84330d7d85a5 req-d270353f-3cf7-424a-b664-8304f8b10984 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-unplugged-6a2c8701-e54c-4ad6-b508-bbfbdd7e263c for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-1e226218-fa82-4ddb-a5de-84330d7d85a5 req-d270353f-3cf7-424a-b664-8304f8b10984 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-plugged-6a2c8701-e54c-4ad6-b508-bbfbdd7e263c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1e226218-fa82-4ddb-a5de-84330d7d85a5 req-d270353f-3cf7-424a-b664-8304f8b10984 service nova] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1e226218-fa82-4ddb-a5de-84330d7d85a5 req-d270353f-3cf7-424a-b664-8304f8b10984 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1e226218-fa82-4ddb-a5de-84330d7d85a5 req-d270353f-3cf7-424a-b664-8304f8b10984 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-1e226218-fa82-4ddb-a5de-84330d7d85a5 req-d270353f-3cf7-424a-b664-8304f8b10984 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] No waiting events found dispatching network-vif-plugged-6a2c8701-e54c-4ad6-b508-bbfbdd7e263c {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:49:12 user nova-compute[75391]: WARNING nova.compute.manager [req-1e226218-fa82-4ddb-a5de-84330d7d85a5 req-d270353f-3cf7-424a-b664-8304f8b10984 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received unexpected event network-vif-plugged-6a2c8701-e54c-4ad6-b508-bbfbdd7e263c for instance with vm_state active and task_state deleting.
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-1e226218-fa82-4ddb-a5de-84330d7d85a5 req-d270353f-3cf7-424a-b664-8304f8b10984 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-unplugged-4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1e226218-fa82-4ddb-a5de-84330d7d85a5 req-d270353f-3cf7-424a-b664-8304f8b10984 service nova] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1e226218-fa82-4ddb-a5de-84330d7d85a5 req-d270353f-3cf7-424a-b664-8304f8b10984 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1e226218-fa82-4ddb-a5de-84330d7d85a5 req-d270353f-3cf7-424a-b664-8304f8b10984 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-1e226218-fa82-4ddb-a5de-84330d7d85a5 req-d270353f-3cf7-424a-b664-8304f8b10984 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] No waiting events found dispatching network-vif-unplugged-4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-1e226218-fa82-4ddb-a5de-84330d7d85a5 req-d270353f-3cf7-424a-b664-8304f8b10984 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-unplugged-4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-1e226218-fa82-4ddb-a5de-84330d7d85a5 req-d270353f-3cf7-424a-b664-8304f8b10984 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-plugged-4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1e226218-fa82-4ddb-a5de-84330d7d85a5 req-d270353f-3cf7-424a-b664-8304f8b10984 service nova] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1e226218-fa82-4ddb-a5de-84330d7d85a5 req-d270353f-3cf7-424a-b664-8304f8b10984 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1e226218-fa82-4ddb-a5de-84330d7d85a5 req-d270353f-3cf7-424a-b664-8304f8b10984 service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-1e226218-fa82-4ddb-a5de-84330d7d85a5 req-d270353f-3cf7-424a-b664-8304f8b10984 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] No waiting events found dispatching network-vif-plugged-4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:49:12 user nova-compute[75391]: WARNING nova.compute.manager [req-1e226218-fa82-4ddb-a5de-84330d7d85a5 req-d270353f-3cf7-424a-b664-8304f8b10984 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received unexpected event network-vif-plugged-4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2 for instance with vm_state active and task_state deleting.
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: INFO os_vif [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:d1:fc,bridge_name='br-int',has_traffic_filtering=True,id=973cfe4a-ca5b-463e-b8e1-3477e73b20fb,network=Network(74933e47-dccc-47d3-8c5c-a355abc6d0a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap973cfe4a-ca')
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539282742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539282742',id=20,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKza1whiTyjorzZVhyM5Da4n8+g8hKkFF6P0kflNEQ+1nL/QCauJlu23FgG5vnkGFXLe4gXIyZt4E7kXz1Lx1BPYqrYXAg8ZGX9DrYKxZncH5Sd0WgI2mhhpCQa/hbpklw==',key_name='tempest-keypair-1303500730',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:47:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70ba612613604fa38f1bb4ec29602cac',ramdisk_id='',reservation_id='r-edo4xu27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-408717637',owner_user_name='tempest-TaggedBootDevicesTest_v242-408717637-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:47:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4380b18a109e458f9b08a5154dfd5d27',uuid=60762562-adbd-4af6-8c0e-d6363a4111d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2", "address": "fa:16:3e:fd:5f:e6", "network": {"id": "b2951d9f-4d4e-49b4-86db-e6d3b1460558", "bridge": "br-int", "label": "tempest-device-tagging-net2-258791214", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c79b81c-4b", "ovs_interfaceid": "4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converting VIF {"id": "4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2", "address": "fa:16:3e:fd:5f:e6", "network": {"id": "b2951d9f-4d4e-49b4-86db-e6d3b1460558", "bridge": "br-int", "label": "tempest-device-tagging-net2-258791214", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c79b81c-4b", "ovs_interfaceid": "4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:5f:e6,bridge_name='br-int',has_traffic_filtering=True,id=4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2,network=Network(b2951d9f-4d4e-49b4-86db-e6d3b1460558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c79b81c-4b') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG os_vif [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:5f:e6,bridge_name='br-int',has_traffic_filtering=True,id=4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2,network=Network(b2951d9f-4d4e-49b4-86db-e6d3b1460558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c79b81c-4b') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c79b81c-4b, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a4d45eae-0078-4dbc-83a1-e6c9920d3350) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-plugged-d42541b2-a63d-470b-88ff-078657735d0a {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] No waiting events found dispatching network-vif-plugged-d42541b2-a63d-470b-88ff-078657735d0a {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:49:12 user nova-compute[75391]: WARNING nova.compute.manager [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received unexpected event network-vif-plugged-d42541b2-a63d-470b-88ff-078657735d0a for instance with vm_state active and task_state deleting.
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-unplugged-b870665b-9254-4608-bd91-7aa46ed614d8 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] No waiting events found dispatching network-vif-unplugged-b870665b-9254-4608-bd91-7aa46ed614d8 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-unplugged-b870665b-9254-4608-bd91-7aa46ed614d8 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-plugged-b870665b-9254-4608-bd91-7aa46ed614d8 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] No waiting events found dispatching network-vif-plugged-b870665b-9254-4608-bd91-7aa46ed614d8 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:49:12 user nova-compute[75391]: WARNING nova.compute.manager [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received unexpected event network-vif-plugged-b870665b-9254-4608-bd91-7aa46ed614d8 for instance with vm_state active and task_state deleting.
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-unplugged-973cfe4a-ca5b-463e-b8e1-3477e73b20fb {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] No waiting events found dispatching network-vif-unplugged-973cfe4a-ca5b-463e-b8e1-3477e73b20fb {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-unplugged-973cfe4a-ca5b-463e-b8e1-3477e73b20fb for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-plugged-973cfe4a-ca5b-463e-b8e1-3477e73b20fb {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] No waiting events found dispatching network-vif-plugged-973cfe4a-ca5b-463e-b8e1-3477e73b20fb {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:49:12 user nova-compute[75391]: WARNING nova.compute.manager [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received unexpected event network-vif-plugged-973cfe4a-ca5b-463e-b8e1-3477e73b20fb for instance with vm_state active and task_state deleting.
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-unplugged-d91f58e8-8742-4077-9536-9e7f4cf22a8c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] No waiting events found dispatching network-vif-unplugged-d91f58e8-8742-4077-9536-9e7f4cf22a8c {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-unplugged-d91f58e8-8742-4077-9536-9e7f4cf22a8c for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-plugged-d91f58e8-8742-4077-9536-9e7f4cf22a8c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] Acquiring lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] No waiting events found dispatching network-vif-plugged-d91f58e8-8742-4077-9536-9e7f4cf22a8c {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:49:12 user nova-compute[75391]: WARNING nova.compute.manager [req-a91b1d6e-3d97-45f4-96bd-700090863871 req-96a35502-5414-4379-a48b-b574706aeb3b service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received unexpected event network-vif-plugged-d91f58e8-8742-4077-9536-9e7f4cf22a8c for instance with vm_state active and task_state deleting.
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: INFO os_vif [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:5f:e6,bridge_name='br-int',has_traffic_filtering=True,id=4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2,network=Network(b2951d9f-4d4e-49b4-86db-e6d3b1460558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c79b81c-4b')
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T02:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-539282742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-539282742',id=20,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKza1whiTyjorzZVhyM5Da4n8+g8hKkFF6P0kflNEQ+1nL/QCauJlu23FgG5vnkGFXLe4gXIyZt4E7kXz1Lx1BPYqrYXAg8ZGX9DrYKxZncH5Sd0WgI2mhhpCQa/hbpklw==',key_name='tempest-keypair-1303500730',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:47:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70ba612613604fa38f1bb4ec29602cac',ramdisk_id='',reservation_id='r-edo4xu27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-408717637',owner_user_name='tempest-TaggedBootDevicesTest_v242-408717637-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:47:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4380b18a109e458f9b08a5154dfd5d27',uuid=60762562-adbd-4af6-8c0e-d6363a4111d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d91f58e8-8742-4077-9536-9e7f4cf22a8c", "address": "fa:16:3e:1a:e8:a6", "network": {"id": "b2951d9f-4d4e-49b4-86db-e6d3b1460558", "bridge": "br-int", "label": "tempest-device-tagging-net2-258791214", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd91f58e8-87", "ovs_interfaceid": "d91f58e8-8742-4077-9536-9e7f4cf22a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converting VIF {"id": "d91f58e8-8742-4077-9536-9e7f4cf22a8c", "address": "fa:16:3e:1a:e8:a6", "network": {"id": "b2951d9f-4d4e-49b4-86db-e6d3b1460558", "bridge": "br-int", "label": "tempest-device-tagging-net2-258791214", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd91f58e8-87", "ovs_interfaceid": "d91f58e8-8742-4077-9536-9e7f4cf22a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:e8:a6,bridge_name='br-int',has_traffic_filtering=True,id=d91f58e8-8742-4077-9536-9e7f4cf22a8c,network=Network(b2951d9f-4d4e-49b4-86db-e6d3b1460558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd91f58e8-87') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG os_vif [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:e8:a6,bridge_name='br-int',has_traffic_filtering=True,id=d91f58e8-8742-4077-9536-9e7f4cf22a8c,network=Network(b2951d9f-4d4e-49b4-86db-e6d3b1460558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd91f58e8-87') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd91f58e8-87, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b435c20-2cf4-4ab6-95f1-a55394a97d99) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:12 user nova-compute[75391]: INFO os_vif [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:e8:a6,bridge_name='br-int',has_traffic_filtering=True,id=d91f58e8-8742-4077-9536-9e7f4cf22a8c,network=Network(b2951d9f-4d4e-49b4-86db-e6d3b1460558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd91f58e8-87')
Nov 15 02:49:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kyZEiwjX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:49:12 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:49:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dec433-900c-4173-abf4-d58adb3b71a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:49:12 user nova-compute[75391]: No targets found.
Nov 15 02:49:12 user nova-compute[75391]: iSNS:
Nov 15 02:49:12 user nova-compute[75391]: No targets found.
Nov 15 02:49:12 user nova-compute[75391]: STATIC:
Nov 15 02:49:12 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3
Nov 15 02:49:12 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:12 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:12 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18
Nov 15 02:49:12 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:12 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:12 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103
Nov 15 02:49:12 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:12 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:12 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8
Nov 15 02:49:12 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:12 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:12 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a
Nov 15 02:49:12 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:12 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:12 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:49:12 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:12 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:12 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4
Nov 15 02:49:12 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:12 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:12 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea
Nov 15 02:49:12 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:12 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:12 user nova-compute[75391]: FIRMWARE:
Nov 15 02:49:12 user nova-compute[75391]: No targets found.
Nov 15 02:49:12 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:49:12 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:49:12 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e20e651-afec-48dc-8d4f-2a6b0486a76e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0883edc5-f126-4549-81b7-52de49b7de2c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:49:12 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:49:12 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:49:12 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:49:12 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:49:12 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:49:12 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:49:12 user nova-compute[75391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 (non-flash)
Nov 15 02:49:12 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:49:12 user nova-compute[75391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 (non-flash)
Nov 15 02:49:12 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:49:12 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:49:12 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:49:12 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:49:12 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:49:12 user nova-compute[75391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 (non-flash)
Nov 15 02:49:12 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f622460c5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4'): ({'sdb'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Removing single pathed devices sdb {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b283e2-2c4d-48a8-89f4-6364ac9e6b21]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed0aa3c-7965-4cfe-a0f8-c1b15639f614]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Flushing IO for device /dev/sdb {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.011s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a609e3d-2075-408f-a922-d2627f1d0001]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbed50e0-6e38-4da0-b530-d097c2f8fd6b]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f22d91-7293-40b9-b02d-500ef6ed0727]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[508dd7fe-5642-4263-bc91-88e91b7bcfcf]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4, portal: 172.16.0.220,3260]
Nov 15 02:49:13 user nova-compute[75391]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4, portal: 172.16.0.220,3260] successful.
Nov 15 02:49:13 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d817de5-94f3-48d3-a8cf-acffc9b6ffc4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3495b556-5314-4609-8daf-366320fb936c]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] <== disconnect_volume: return (370ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gSxOKumf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:49:13 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f6fed9-2efb-40a3-8535-56e81ef721ed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:49:13 user nova-compute[75391]: No targets found.
Nov 15 02:49:13 user nova-compute[75391]: iSNS:
Nov 15 02:49:13 user nova-compute[75391]: No targets found.
Nov 15 02:49:13 user nova-compute[75391]: STATIC:
Nov 15 02:49:13 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3
Nov 15 02:49:13 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:13 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:13 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18
Nov 15 02:49:13 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:13 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:13 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103
Nov 15 02:49:13 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:13 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:13 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8
Nov 15 02:49:13 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:13 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:13 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a
Nov 15 02:49:13 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:13 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:13 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:49:13 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:13 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:13 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea
Nov 15 02:49:13 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:13 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:13 user nova-compute[75391]: FIRMWARE:
Nov 15 02:49:13 user nova-compute[75391]: No targets found.
Nov 15 02:49:13 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:49:13 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:49:13 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f750bad7-685b-40e0-b7db-5cc13c1f30fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2b84ec-71d7-46b9-88ec-25dc41f8758e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:49:13 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:49:13 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:49:13 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:49:13 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:49:13 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:49:13 user nova-compute[75391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 (non-flash)
Nov 15 02:49:13 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:49:13 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:49:13 user nova-compute[75391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 (non-flash)
Nov 15 02:49:13 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:49:13 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:49:13 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:49:13 user nova-compute[75391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 (non-flash)
Nov 15 02:49:13 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6244660670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18'): ({'sde'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Removing single pathed devices sde {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59e0abf-2811-43f9-b201-9db26b2fef4c]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8cca18-7392-4b8e-84c2-6a9086df3114]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Flushing IO for device /dev/sde {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7915d426-303c-415e-8313-a36bf5cf560e]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef634ede-5048-4ce0-a959-ce12a8497354]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] SCSI volumes sde have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a038be7a-bb77-4629-b4b2-1da63235548b]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[679b0c6b-22c5-4f6d-856b-47a84eb5bec6]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18, portal: 172.16.0.220,3260]
Nov 15 02:49:13 user nova-compute[75391]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18, portal: 172.16.0.220,3260] successful.
Nov 15 02:49:13 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ee0797-97d7-4cb4-9af4-e197a7fcfb18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[522be502-205f-4d73-93de-5ef97aefb887]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] <== disconnect_volume: return (321ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uabqPvMQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:49:13 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8ec164-ec6b-4035-9b97-d6701fb61568]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:49:13 user nova-compute[75391]: No targets found.
Nov 15 02:49:13 user nova-compute[75391]: iSNS:
Nov 15 02:49:13 user nova-compute[75391]: No targets found.
Nov 15 02:49:13 user nova-compute[75391]: STATIC:
Nov 15 02:49:13 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3
Nov 15 02:49:13 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:13 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:13 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103
Nov 15 02:49:13 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:13 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:13 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8
Nov 15 02:49:13 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:13 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:13 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a
Nov 15 02:49:13 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:13 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:13 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:49:13 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:13 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:13 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea
Nov 15 02:49:13 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:13 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:13 user nova-compute[75391]: FIRMWARE:
Nov 15 02:49:13 user nova-compute[75391]: No targets found.
Nov 15 02:49:13 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:49:13 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:49:13 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcf1400-9f32-46df-ae2b-3ad2b4c72ea5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e953c836-d57f-4bb2-9180-605acb0c5fd0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:49:13 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:49:13 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:49:13 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:49:13 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:49:13 user nova-compute[75391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 (non-flash)
Nov 15 02:49:13 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:49:13 user nova-compute[75391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 (non-flash)
Nov 15 02:49:13 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:49:13 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:49:13 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:49:13 user nova-compute[75391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 (non-flash)
Nov 15 02:49:13 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6244660670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103'): ({'sdd'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Removing single pathed devices sdd {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3962b9a5-cd94-420a-bf88-60498d3f43b9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa2d699-54a8-43e7-a45e-816febcaecea]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Flushing IO for device /dev/sdd {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba669c29-5b4c-4b1b-876a-25c5dfc2afa4]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f248df0b-12e6-4acf-957f-030ef68c3c75]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] SCSI volumes sdd have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.038s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[53240b67-159d-46bf-9db6-be2985134f90]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d7ab08-1026-4926-8aa5-71ea841ed10a]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103, portal: 172.16.0.220,3260]
Nov 15 02:49:13 user nova-compute[75391]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103, portal: 172.16.0.220,3260] successful.
Nov 15 02:49:13 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dded56a-c818-4c6d-8e74-ebb85fab2103 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68d81bd-08a3-4696-9f23-12deb9f02377]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] <== disconnect_volume: return (327ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:49:13 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Deleting instance files /opt/stack/data/nova/instances/60762562-adbd-4af6-8c0e-d6363a4111d2_del
Nov 15 02:49:13 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Deletion of /opt/stack/data/nova/instances/60762562-adbd-4af6-8c0e-d6363a4111d2_del complete
Nov 15 02:49:13 user nova-compute[75391]: INFO nova.compute.manager [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Took 3.96 seconds to destroy the instance on the hypervisor.
Nov 15 02:49:13 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:49:13 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:49:15 user nova-compute[75391]: DEBUG nova.compute.manager [req-70571bdd-8ac0-4f89-a90b-048569f9cb55 req-c5529a21-6a8f-48f9-9c27-1d1e29cd9e8c service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-deleted-b870665b-9254-4608-bd91-7aa46ed614d8 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:15 user nova-compute[75391]: INFO nova.compute.manager [req-70571bdd-8ac0-4f89-a90b-048569f9cb55 req-c5529a21-6a8f-48f9-9c27-1d1e29cd9e8c service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Neutron deleted interface b870665b-9254-4608-bd91-7aa46ed614d8; detaching it from the instance and deleting it from the info cache
Nov 15 02:49:15 user nova-compute[75391]: DEBUG nova.network.neutron [req-70571bdd-8ac0-4f89-a90b-048569f9cb55 req-c5529a21-6a8f-48f9-9c27-1d1e29cd9e8c service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Updating instance_info_cache with network_info: [{"id": "59301df7-815a-4047-b6e2-190a0e80b4d4", "address": "fa:16:3e:11:89:27", "network": {"id": "e4f300b0-c84b-4d12-9cd9-b2b92726d342", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1598402766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59301df7-81", "ovs_interfaceid": "59301df7-815a-4047-b6e2-190a0e80b4d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d42541b2-a63d-470b-88ff-078657735d0a", "address": "fa:16:3e:ef:72:46", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42541b2-a6", "ovs_interfaceid": "d42541b2-a63d-470b-88ff-078657735d0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a2c8701-e54c-4ad6-b508-bbfbdd7e263c", "address": "fa:16:3e:ba:d3:c1", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a2c8701-e5", "ovs_interfaceid": "6a2c8701-e54c-4ad6-b508-bbfbdd7e263c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "973cfe4a-ca5b-463e-b8e1-3477e73b20fb", "address": "fa:16:3e:1a:d1:fc", "network": {"id": "74933e47-dccc-47d3-8c5c-a355abc6d0a7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1812530858", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973cfe4a-ca", "ovs_interfaceid": "973cfe4a-ca5b-463e-b8e1-3477e73b20fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2", "address": "fa:16:3e:fd:5f:e6", "network": {"id": "b2951d9f-4d4e-49b4-86db-e6d3b1460558", "bridge": "br-int", "label": "tempest-device-tagging-net2-258791214", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c79b81c-4b", "ovs_interfaceid": "4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d91f58e8-8742-4077-9536-9e7f4cf22a8c", "address": "fa:16:3e:1a:e8:a6", "network": {"id": "b2951d9f-4d4e-49b4-86db-e6d3b1460558", "bridge": "br-int", "label": "tempest-device-tagging-net2-258791214", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "70ba612613604fa38f1bb4ec29602cac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd91f58e8-87", "ovs_interfaceid": "d91f58e8-8742-4077-9536-9e7f4cf22a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:49:15 user nova-compute[75391]: DEBUG nova.compute.manager [req-70571bdd-8ac0-4f89-a90b-048569f9cb55 req-c5529a21-6a8f-48f9-9c27-1d1e29cd9e8c service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Detach interface failed, port_id=b870665b-9254-4608-bd91-7aa46ed614d8, reason: Instance 60762562-adbd-4af6-8c0e-d6363a4111d2 could not be found. {{(pid=75391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 02:49:17 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:49:17 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Took 3.28 seconds to deallocate network for instance.
Nov 15 02:49:17 user nova-compute[75391]: DEBUG nova.compute.manager [req-83925957-3103-4184-8cbe-f5f8deb931bb req-3725ffbe-42d6-413b-9cc2-cdb85060f519 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-deleted-973cfe4a-ca5b-463e-b8e1-3477e73b20fb {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:17 user nova-compute[75391]: DEBUG nova.compute.manager [req-83925957-3103-4184-8cbe-f5f8deb931bb req-3725ffbe-42d6-413b-9cc2-cdb85060f519 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-deleted-d91f58e8-8742-4077-9536-9e7f4cf22a8c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:17 user nova-compute[75391]: DEBUG nova.compute.manager [req-83925957-3103-4184-8cbe-f5f8deb931bb req-3725ffbe-42d6-413b-9cc2-cdb85060f519 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-deleted-59301df7-815a-4047-b6e2-190a0e80b4d4 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:17 user nova-compute[75391]: DEBUG nova.compute.manager [req-83925957-3103-4184-8cbe-f5f8deb931bb req-3725ffbe-42d6-413b-9cc2-cdb85060f519 service nova] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Received event network-vif-deleted-4c79b81c-4ba5-4bb8-bc11-4ffa9a4900c2 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:17 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:19 user nova-compute[75391]: INFO nova.compute.manager [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] [instance: 60762562-adbd-4af6-8c0e-d6363a4111d2] Took 2.43 seconds to detach 3 volumes for instance.
Nov 15 02:49:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:19 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:49:19 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:49:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:19 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Deleted allocations for instance 60762562-adbd-4af6-8c0e-d6363a4111d2
Nov 15 02:49:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7826ebbb-900d-4a2a-8360-06558d8ace4f tempest-TaggedBootDevicesTest_v242-408717637 tempest-TaggedBootDevicesTest_v242-408717637-project-member] Lock "60762562-adbd-4af6-8c0e-d6363a4111d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.229s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:22 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:28 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2b144078-2d2e-460c-b432-96d6309e338c is timed out.
Nov 15 02:49:28 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Successfully detached device vdb from instance 2b144078-2d2e-460c-b432-96d6309e338c from the live domain config.
Nov 15 02:49:28 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:49:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TDBMlJav', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:49:28 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:49:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:49:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:49:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e98616-00b5-47df-bbdb-472502482f96]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:49:28 user nova-compute[75391]: No targets found.
Nov 15 02:49:28 user nova-compute[75391]: iSNS:
Nov 15 02:49:28 user nova-compute[75391]: No targets found.
Nov 15 02:49:28 user nova-compute[75391]: STATIC:
Nov 15 02:49:28 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3
Nov 15 02:49:28 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:28 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:28 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8
Nov 15 02:49:28 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:28 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:28 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a
Nov 15 02:49:28 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:28 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:28 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:49:28 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:28 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:28 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea
Nov 15 02:49:28 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:28 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:28 user nova-compute[75391]: FIRMWARE:
Nov 15 02:49:28 user nova-compute[75391]: No targets found.
Nov 15 02:49:28 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:49:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:49:28 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:49:28 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:49:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:49:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe5bfb1-2908-4b46-874c-5b1e1358007f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fe2fc7-381a-428f-b052-f755146ce06d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:49:28 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:49:28 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:49:28 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:49:28 user nova-compute[75391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 (non-flash)
Nov 15 02:49:28 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:49:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:49:28 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:49:28 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:49:28 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:49:28 user nova-compute[75391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 (non-flash)
Nov 15 02:49:28 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:49:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62247d11b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3'): ({'sdi'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:49:28 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Removing single pathed devices sdi {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:49:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe65fcd-35a2-4e58-a2d7-5c020afa6020]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[700c1072-61c3-465d-881a-0305e76b6171]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Flushing IO for device /dev/sdi {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[104df77e-a22e-4e34-b490-7994ee10174b]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.044s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7964cb88-227b-44ce-909f-0583f6f48987]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] SCSI volumes sdi have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7bd3a6-02b1-43ee-b315-276b4479845e]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b311fd-2020-449f-8ed8-139fe21472ac]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3, portal: 172.16.0.220,3260]
Nov 15 02:49:29 user nova-compute[75391]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3, portal: 172.16.0.220,3260] successful.
Nov 15 02:49:29 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b54d619-56be-4a7c-a0fa-1c4a8598f3b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f7f881-3ceb-42ae-b3b2-1027894cb769]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] <== disconnect_volume: return (325ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:49:29 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lazy-loading 'flavor' on Instance uuid 2b144078-2d2e-460c-b432-96d6309e338c {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:49:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9c9a3ca4-cc7b-4323-99e9-508d15f07d1e tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lock "2b144078-2d2e-460c-b432-96d6309e338c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.807s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.objects.instance [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'flavor' on Instance uuid da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "refresh_cache-da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquired lock "refresh_cache-da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.network.neutron [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.objects.instance [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'info_cache' on Instance uuid da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.objects.base [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Object Instance<da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f> lazy-loaded attributes: flavor,info_cache {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.network.neutron [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Updating instance_info_cache with network_info: [{"id": "f3eff2a5-1256-4a92-969a-62aca65b7452", "address": "fa:16:3e:1d:2d:fe", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eff2a5-12", "ovs_interfaceid": "f3eff2a5-1256-4a92-969a-62aca65b7452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Releasing lock "refresh_cache-da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:49:40 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Instance destroyed successfully.
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.objects.instance [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'resources' on Instance uuid da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.objects.base [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Object Instance<da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:45:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2059106196',display_name='tempest-AttachVolumeTestJSON-server-2059106196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2059106196',id=16,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCD3L1SyX/DHVmOgefUSKxNSWOZ+sTPqXiHUSBukECcD3u5gRzMMwQl2EIJXu8cBcituCl5oxuFwWyqmLGHfNTrWeVvrAhqAma6otXiHGESdUtG7YKOLDquTjdHFcZgT9g==',key_name='tempest-keypair-354891702',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:45:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3ae33412d3944fbcb20520ae0b5d5d17',ramdisk_id='',reservation_id='r-rjbq8t39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-452422979',owner_user_name='tempest-AttachVolumeTestJSON-452422979-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:47:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa67273822f247b2ae2d34ec9cd8c8b4',uuid=da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f3eff2a5-1256-4a92-969a-62aca65b7452", "address": "fa:16:3e:1d:2d:fe", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eff2a5-12", "ovs_interfaceid": "f3eff2a5-1256-4a92-969a-62aca65b7452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Converting VIF {"id": "f3eff2a5-1256-4a92-969a-62aca65b7452", "address": "fa:16:3e:1d:2d:fe", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eff2a5-12", "ovs_interfaceid": "f3eff2a5-1256-4a92-969a-62aca65b7452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:2d:fe,bridge_name='br-int',has_traffic_filtering=True,id=f3eff2a5-1256-4a92-969a-62aca65b7452,network=Network(4866e9c3-d16f-4496-b56a-1f100ea5622a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3eff2a5-12') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG os_vif [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:2d:fe,bridge_name='br-int',has_traffic_filtering=True,id=f3eff2a5-1256-4a92-969a-62aca65b7452,network=Network(4866e9c3-d16f-4496-b56a-1f100ea5622a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3eff2a5-12') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3eff2a5-12, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc4dfcb1-57d8-4ed7-84e0-e706b63eebd5) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:40 user nova-compute[75391]: INFO os_vif [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:2d:fe,bridge_name='br-int',has_traffic_filtering=True,id=f3eff2a5-1256-4a92-969a-62aca65b7452,network=Network(4866e9c3-d16f-4496-b56a-1f100ea5622a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3eff2a5-12')
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GxWsSnDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:49:40 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:49:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[97193c14-2c35-4069-b6c1-c8d652f83078]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:49:40 user nova-compute[75391]: No targets found.
Nov 15 02:49:40 user nova-compute[75391]: iSNS:
Nov 15 02:49:40 user nova-compute[75391]: No targets found.
Nov 15 02:49:40 user nova-compute[75391]: STATIC:
Nov 15 02:49:40 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8
Nov 15 02:49:40 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:40 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:40 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a
Nov 15 02:49:40 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:40 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:40 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:49:40 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:40 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:40 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea
Nov 15 02:49:40 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:49:40 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:49:40 user nova-compute[75391]: FIRMWARE:
Nov 15 02:49:40 user nova-compute[75391]: No targets found.
Nov 15 02:49:40 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:49:40 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:49:40 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e950b3-f7ff-450c-8271-3bd3dd933364]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad22685c-78cc-49a1-b148-117a662f3b86]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:49:40 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:49:40 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:49:40 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:49:40 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:49:40 user nova-compute[75391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:49:40 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:49:40 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:49:40 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62247d1240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8'): ({'sdc'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Removing single pathed devices sdc {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[34343fda-acc6-4ef6-980c-f43fe00037a4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[663c026a-d261-4890-9481-16413b6a184f]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Flushing IO for device /dev/sdc {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[522d7aae-3673-4436-bb32-daefb0395c3d]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6438e49a-9064-423a-a439-cbd5733f4c9e]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] SCSI volumes sdc have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3d3074-86bb-47b7-8c59-19789486bf44]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d9389a-2c0f-4930-a09a-cb5a2fe70079]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8, portal: 172.16.0.220,3260]
Nov 15 02:49:40 user nova-compute[75391]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8, portal: 172.16.0.220,3260] successful.
Nov 15 02:49:40 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[681f21f4-904f-411b-b354-cb08dadfd961]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] <== disconnect_volume: return (300ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Start _get_guest_xml network_info=[{"id": "f3eff2a5-1256-4a92-969a-62aca65b7452", "address": "fa:16:3e:1d:2d:fe", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eff2a5-12", "ovs_interfaceid": "f3eff2a5-1256-4a92-969a-62aca65b7452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '99c42c94-0b92-4310-b379-36ce081d2169', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GxWsSnDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f', 'attached_at': '', 'detached_at': '', 'volume_id': '48cae43a-b3bd-4e69-b14c-d2104d2065c8', 'serial': '48cae43a-b3bd-4e69-b14c-d2104d2065c8'}, 'volume_type': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.objects.instance [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'numa_topology' on Instance uuid da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.objects.base [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Object Instance<da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:49:40 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:49:40 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.objects.instance [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'vcpu_model' on Instance uuid da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.objects.base [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Object Instance<da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GxWsSnDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:49:40 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:49:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:49:40 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:49:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:49:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:49:40 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:49:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d04bc5-24ef-4912-a6b3-8614d2e705b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:49:41 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[176930de-2917-485b-bef1-99e223203cf3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8] added
Nov 15 02:49:41 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fe8333-4331-422c-ab0d-077c28be7864]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba1b09f-428b-42bb-bc4e-0ad5aa21c6f2]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GxWsSnDQ {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GxWsSnDQ" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadd890e-4e56-4efc-adbc-ff21a8ef91f4]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GxWsSnDQ'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c8f64a-b223-4550-af05-b506f85ed757]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78cfda0-da7b-4580-bc48-fad4a082a60c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:49:41 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:49:41 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:49:41 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:49:41 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:49:41 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:49:41 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7299ec9a-73cc-4ecc-8977-9a4b73f75493]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8, portal: 172.16.0.220,3260]
Nov 15 02:49:41 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8, portal: 172.16.0.220,3260] successful.
Nov 15 02:49:41 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd57186-8b4e-4c54-94a8-a7cdfa8e3c60]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a624a7-48dc-4104-bc36-26e00ce5fe85]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:49:41 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:49:41 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:49:41 user nova-compute[75391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:49:41 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:49:41 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:49:41 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:49:41 user nova-compute[75391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:49:41 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cd402a-3572-4b80-9096-045a74f4d7cb]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:49:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GxWsSnDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:49:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:49:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26530353236336437', 'path': '/dev/sdb'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:49:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530353236336437', 'path': '/dev/sdb'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:49:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:45:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2059106196',display_name='tempest-AttachVolumeTestJSON-server-2059106196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2059106196',id=16,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCD3L1SyX/DHVmOgefUSKxNSWOZ+sTPqXiHUSBukECcD3u5gRzMMwQl2EIJXu8cBcituCl5oxuFwWyqmLGHfNTrWeVvrAhqAma6otXiHGESdUtG7YKOLDquTjdHFcZgT9g==',key_name='tempest-keypair-354891702',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:45:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3ae33412d3944fbcb20520ae0b5d5d17',ramdisk_id='',reservation_id='r-rjbq8t39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-452422979',owner_user_name='tempest-AttachVolumeTestJSON-452422979-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:47:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa67273822f247b2ae2d34ec9cd8c8b4',uuid=da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f3eff2a5-1256-4a92-969a-62aca65b7452", "address": "fa:16:3e:1d:2d:fe", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eff2a5-12", "ovs_interfaceid": "f3eff2a5-1256-4a92-969a-62aca65b7452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:49:42 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Converting VIF {"id": "f3eff2a5-1256-4a92-969a-62aca65b7452", "address": "fa:16:3e:1d:2d:fe", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eff2a5-12", "ovs_interfaceid": "f3eff2a5-1256-4a92-969a-62aca65b7452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:49:42 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:2d:fe,bridge_name='br-int',has_traffic_filtering=True,id=f3eff2a5-1256-4a92-969a-62aca65b7452,network=Network(4866e9c3-d16f-4496-b56a-1f100ea5622a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3eff2a5-12') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:49:42 user nova-compute[75391]: DEBUG nova.objects.instance [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'pci_devices' on Instance uuid da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:49:42 user nova-compute[75391]: DEBUG nova.objects.base [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Object Instance<da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:49:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:49:42 user nova-compute[75391]:   <uuid>da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f</uuid>
Nov 15 02:49:42 user nova-compute[75391]:   <name>instance-00000010</name>
Nov 15 02:49:42 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:49:42 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:49:42 user nova-compute[75391]:   <metadata>
Nov 15 02:49:42 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:49:42 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:49:42 user nova-compute[75391]:       <nova:name>tempest-AttachVolumeTestJSON-server-2059106196</nova:name>
Nov 15 02:49:42 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:49:40</nova:creationTime>
Nov 15 02:49:42 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:49:42 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:49:42 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:49:42 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:49:42 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:49:42 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:49:42 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:49:42 user nova-compute[75391]:       <nova:owner>
Nov 15 02:49:42 user nova-compute[75391]:         <nova:user uuid="aa67273822f247b2ae2d34ec9cd8c8b4">tempest-AttachVolumeTestJSON-452422979-project-member</nova:user>
Nov 15 02:49:42 user nova-compute[75391]:         <nova:project uuid="3ae33412d3944fbcb20520ae0b5d5d17">tempest-AttachVolumeTestJSON-452422979</nova:project>
Nov 15 02:49:42 user nova-compute[75391]:       </nova:owner>
Nov 15 02:49:42 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:49:42 user nova-compute[75391]:       <nova:ports>
Nov 15 02:49:42 user nova-compute[75391]:         <nova:port uuid="f3eff2a5-1256-4a92-969a-62aca65b7452">
Nov 15 02:49:42 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 02:49:42 user nova-compute[75391]:         </nova:port>
Nov 15 02:49:42 user nova-compute[75391]:       </nova:ports>
Nov 15 02:49:42 user nova-compute[75391]:     </nova:instance>
Nov 15 02:49:42 user nova-compute[75391]:   </metadata>
Nov 15 02:49:42 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:49:42 user nova-compute[75391]:     <system>
Nov 15 02:49:42 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:49:42 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:49:42 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:49:42 user nova-compute[75391]:       <entry name="serial">da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f</entry>
Nov 15 02:49:42 user nova-compute[75391]:       <entry name="uuid">da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f</entry>
Nov 15 02:49:42 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:49:42 user nova-compute[75391]:     </system>
Nov 15 02:49:42 user nova-compute[75391]:   </sysinfo>
Nov 15 02:49:42 user nova-compute[75391]:   <os>
Nov 15 02:49:42 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:49:42 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:49:42 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:49:42 user nova-compute[75391]:   </os>
Nov 15 02:49:42 user nova-compute[75391]:   <features>
Nov 15 02:49:42 user nova-compute[75391]:     <acpi/>
Nov 15 02:49:42 user nova-compute[75391]:     <apic/>
Nov 15 02:49:42 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:49:42 user nova-compute[75391]:   </features>
Nov 15 02:49:42 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:49:42 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:49:42 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:49:42 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:49:42 user nova-compute[75391]:   </clock>
Nov 15 02:49:42 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:49:42 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:49:42 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:49:42 user nova-compute[75391]:   </cpu>
Nov 15 02:49:42 user nova-compute[75391]:   <devices>
Nov 15 02:49:42 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:49:42 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:49:42 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk"/>
Nov 15 02:49:42 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:49:42 user nova-compute[75391]:     </disk>
Nov 15 02:49:42 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 02:49:42 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:49:42 user nova-compute[75391]:       <source dev="/dev/sdb"/>
Nov 15 02:49:42 user nova-compute[75391]:       <target dev="vdb" bus="virtio"/>
Nov 15 02:49:42 user nova-compute[75391]:       <serial>48cae43a-b3bd-4e69-b14c-d2104d2065c8</serial>
Nov 15 02:49:42 user nova-compute[75391]:     </disk>
Nov 15 02:49:42 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:49:42 user nova-compute[75391]:       <mac address="fa:16:3e:1d:2d:fe"/>
Nov 15 02:49:42 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:49:42 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:49:42 user nova-compute[75391]:       <target dev="tapf3eff2a5-12"/>
Nov 15 02:49:42 user nova-compute[75391]:     </interface>
Nov 15 02:49:42 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:49:42 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/console.log" append="off"/>
Nov 15 02:49:42 user nova-compute[75391]:     </serial>
Nov 15 02:49:42 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:49:42 user nova-compute[75391]:     <video>
Nov 15 02:49:42 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:49:42 user nova-compute[75391]:     </video>
Nov 15 02:49:42 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:49:42 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:49:42 user nova-compute[75391]:     </rng>
Nov 15 02:49:42 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:49:42 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:49:42 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:49:42 user nova-compute[75391]:     </memballoon>
Nov 15 02:49:42 user nova-compute[75391]:   </devices>
Nov 15 02:49:42 user nova-compute[75391]: </domain>
Nov 15 02:49:42 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:49:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:49:42 user nova-compute[75391]: DEBUG nova.objects.instance [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'trusted_certs' on Instance uuid da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:49:42 user nova-compute[75391]: DEBUG nova.objects.base [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Object Instance<da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:49:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.207s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:42 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:49:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:43 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Cannot resize image /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:49:43 user nova-compute[75391]: DEBUG nova.objects.instance [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'migration_context' on Instance uuid da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:49:43 user nova-compute[75391]: DEBUG nova.objects.base [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Object Instance<da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:49:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:45:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2059106196',display_name='tempest-AttachVolumeTestJSON-server-2059106196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2059106196',id=16,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCD3L1SyX/DHVmOgefUSKxNSWOZ+sTPqXiHUSBukECcD3u5gRzMMwQl2EIJXu8cBcituCl5oxuFwWyqmLGHfNTrWeVvrAhqAma6otXiHGESdUtG7YKOLDquTjdHFcZgT9g==',key_name='tempest-keypair-354891702',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:45:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='3ae33412d3944fbcb20520ae0b5d5d17',ramdisk_id='',reservation_id='r-rjbq8t39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-452422979',owner_user_name='tempest-AttachVolumeTestJSON-452422979-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:47:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa67273822f247b2ae2d34ec9cd8c8b4',uuid=da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f3eff2a5-1256-4a92-969a-62aca65b7452", "address": "fa:16:3e:1d:2d:fe", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eff2a5-12", "ovs_interfaceid": "f3eff2a5-1256-4a92-969a-62aca65b7452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:49:43 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Converting VIF {"id": "f3eff2a5-1256-4a92-969a-62aca65b7452", "address": "fa:16:3e:1d:2d:fe", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eff2a5-12", "ovs_interfaceid": "f3eff2a5-1256-4a92-969a-62aca65b7452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:49:43 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:2d:fe,bridge_name='br-int',has_traffic_filtering=True,id=f3eff2a5-1256-4a92-969a-62aca65b7452,network=Network(4866e9c3-d16f-4496-b56a-1f100ea5622a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3eff2a5-12') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:49:43 user nova-compute[75391]: DEBUG os_vif [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:2d:fe,bridge_name='br-int',has_traffic_filtering=True,id=f3eff2a5-1256-4a92-969a-62aca65b7452,network=Network(4866e9c3-d16f-4496-b56a-1f100ea5622a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3eff2a5-12') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:49:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:49:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76e9e620-2a76-55e1-b8e2-20a9d401efbe', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:49:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3eff2a5-12, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf3eff2a5-12, col_values=(('qos', UUID('1875b391-bd43-498a-8f4c-d905715438b4')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf3eff2a5-12, col_values=(('external_ids', {'iface-id': 'f3eff2a5-1256-4a92-969a-62aca65b7452', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:2d:fe', 'vm-uuid': 'da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:49:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:43 user nova-compute[75391]: INFO os_vif [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:2d:fe,bridge_name='br-int',has_traffic_filtering=True,id=f3eff2a5-1256-4a92-969a-62aca65b7452,network=Network(4866e9c3-d16f-4496-b56a-1f100ea5622a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3eff2a5-12')
Nov 15 02:49:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-8a6f457d-d857-48b5-98cc-0ec399c46967 req-a1847c1e-afec-4351-8e8d-f8e23b849eea service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received event network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8a6f457d-d857-48b5-98cc-0ec399c46967 req-a1847c1e-afec-4351-8e8d-f8e23b849eea service nova] Acquiring lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8a6f457d-d857-48b5-98cc-0ec399c46967 req-a1847c1e-afec-4351-8e8d-f8e23b849eea service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8a6f457d-d857-48b5-98cc-0ec399c46967 req-a1847c1e-afec-4351-8e8d-f8e23b849eea service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-8a6f457d-d857-48b5-98cc-0ec399c46967 req-a1847c1e-afec-4351-8e8d-f8e23b849eea service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] No waiting events found dispatching network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:49:44 user nova-compute[75391]: WARNING nova.compute.manager [req-8a6f457d-d857-48b5-98cc-0ec399c46967 req-a1847c1e-afec-4351-8e8d-f8e23b849eea service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received unexpected event network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 for instance with vm_state stopped and task_state powering-on.
Nov 15 02:49:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:46 user nova-compute[75391]: DEBUG nova.compute.manager [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:49:46 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Instance rebooted successfully.
Nov 15 02:49:46 user nova-compute[75391]: DEBUG nova.compute.manager [None req-c6f4fce7-055c-4985-ae71-4b465519720a tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:49:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-44f314eb-567e-4684-af83-af8ff3de2cdb req-15eca328-693f-4d62-b8f4-529759066b0f service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received event network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-44f314eb-567e-4684-af83-af8ff3de2cdb req-15eca328-693f-4d62-b8f4-529759066b0f service nova] Acquiring lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-44f314eb-567e-4684-af83-af8ff3de2cdb req-15eca328-693f-4d62-b8f4-529759066b0f service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-44f314eb-567e-4684-af83-af8ff3de2cdb req-15eca328-693f-4d62-b8f4-529759066b0f service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-44f314eb-567e-4684-af83-af8ff3de2cdb req-15eca328-693f-4d62-b8f4-529759066b0f service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] No waiting events found dispatching network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:49:46 user nova-compute[75391]: WARNING nova.compute.manager [req-44f314eb-567e-4684-af83-af8ff3de2cdb req-15eca328-693f-4d62-b8f4-529759066b0f service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received unexpected event network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 for instance with vm_state active and task_state None.
Nov 15 02:49:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:50 user nova-compute[75391]: DEBUG nova.compute.manager [req-973c6d1f-501a-4778-b3f6-3b3f0f10e487 req-9a80335a-b795-4705-aaec-d86572569b4b service nova] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Received event network-changed-b4140c76-b437-46c4-b8f4-dfafb44d7431 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:50 user nova-compute[75391]: DEBUG nova.compute.manager [req-973c6d1f-501a-4778-b3f6-3b3f0f10e487 req-9a80335a-b795-4705-aaec-d86572569b4b service nova] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Refreshing instance network info cache due to event network-changed-b4140c76-b437-46c4-b8f4-dfafb44d7431. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:49:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-973c6d1f-501a-4778-b3f6-3b3f0f10e487 req-9a80335a-b795-4705-aaec-d86572569b4b service nova] Acquiring lock "refresh_cache-054d3064-549d-442e-85ea-4c7bfde518cb" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:49:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-973c6d1f-501a-4778-b3f6-3b3f0f10e487 req-9a80335a-b795-4705-aaec-d86572569b4b service nova] Acquired lock "refresh_cache-054d3064-549d-442e-85ea-4c7bfde518cb" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:49:50 user nova-compute[75391]: DEBUG nova.network.neutron [req-973c6d1f-501a-4778-b3f6-3b3f0f10e487 req-9a80335a-b795-4705-aaec-d86572569b4b service nova] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Refreshing network info cache for port b4140c76-b437-46c4-b8f4-dfafb44d7431 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:49:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "054d3064-549d-442e-85ea-4c7bfde518cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "054d3064-549d-442e-85ea-4c7bfde518cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:51 user nova-compute[75391]: DEBUG nova.objects.instance [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lazy-loading 'flavor' on Instance uuid 054d3064-549d-442e-85ea-4c7bfde518cb {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:49:51 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Ignoring supplied device name: /dev/vdb
Nov 15 02:49:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "054d3064-549d-442e-85ea-4c7bfde518cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "054d3064-549d-442e-85ea-4c7bfde518cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "054d3064-549d-442e-85ea-4c7bfde518cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:51 user nova-compute[75391]: INFO nova.compute.manager [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Attaching volume b64b2bd5-408d-409f-91d1-53b9f79ca6fd to /dev/vdb
Nov 15 02:49:51 user nova-compute[75391]: DEBUG nova.network.neutron [req-973c6d1f-501a-4778-b3f6-3b3f0f10e487 req-9a80335a-b795-4705-aaec-d86572569b4b service nova] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Updated VIF entry in instance network info cache for port b4140c76-b437-46c4-b8f4-dfafb44d7431. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:49:51 user nova-compute[75391]: DEBUG nova.network.neutron [req-973c6d1f-501a-4778-b3f6-3b3f0f10e487 req-9a80335a-b795-4705-aaec-d86572569b4b service nova] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Updating instance_info_cache with network_info: [{"id": "b4140c76-b437-46c4-b8f4-dfafb44d7431", "address": "fa:16:3e:0c:35:87", "network": {"id": "07cd9e35-dfd4-4a08-ac37-52c7bfefa42e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1490748469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96a31c2c4cb4586857b6179adf48ec0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4140c76-b4", "ovs_interfaceid": "b4140c76-b437-46c4-b8f4-dfafb44d7431", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:49:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-973c6d1f-501a-4778-b3f6-3b3f0f10e487 req-9a80335a-b795-4705-aaec-d86572569b4b service nova] Releasing lock "refresh_cache-054d3064-549d-442e-85ea-4c7bfde518cb" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:49:51 user nova-compute[75391]: DEBUG os_brick.utils [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:49:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[65eec95d-aaaa-42e2-8a04-208270dd2a61]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbee7fc4-1de2-4fca-8fa4-9edbcf41c69c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1dd05b7-34a1-4bf8-abb0-aab2f7860b30]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa93debf-528c-457b-a30e-ef9badc75482]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:49:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:49:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:49:51 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:49:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf51e346-e6b7-48bb-8e7d-e241120f9c31]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:49:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:49:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:49:51 user nova-compute[75391]: DEBUG os_brick.utils [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:49:51 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Updating existing volume attachment record: 2a634b3a-5e29-47d5-a061-9f07e4023793 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:49:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c8f0886b-3d1b-4350-9996-c7bb1af84400 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c8f0886b-3d1b-4350-9996-c7bb1af84400 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c8f0886b-3d1b-4350-9996-c7bb1af84400 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c8f0886b-3d1b-4350-9996-c7bb1af84400 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c8f0886b-3d1b-4350-9996-c7bb1af84400 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:52 user nova-compute[75391]: INFO nova.compute.manager [None req-c8f0886b-3d1b-4350-9996-c7bb1af84400 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Terminating instance
Nov 15 02:49:52 user nova-compute[75391]: DEBUG nova.compute.manager [None req-c8f0886b-3d1b-4350-9996-c7bb1af84400 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:49:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:52 user nova-compute[75391]: DEBUG nova.compute.manager [req-e4f1c6d7-c8a6-49b6-9ff8-c09d36fa6408 req-cd6cf938-c5d3-4855-bf5f-f68ddfa8c093 service nova] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Received event network-changed-b89e475f-2d05-4427-81aa-64a19c9664ee {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:52 user nova-compute[75391]: DEBUG nova.compute.manager [req-e4f1c6d7-c8a6-49b6-9ff8-c09d36fa6408 req-cd6cf938-c5d3-4855-bf5f-f68ddfa8c093 service nova] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Refreshing instance network info cache due to event network-changed-b89e475f-2d05-4427-81aa-64a19c9664ee. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:49:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e4f1c6d7-c8a6-49b6-9ff8-c09d36fa6408 req-cd6cf938-c5d3-4855-bf5f-f68ddfa8c093 service nova] Acquiring lock "refresh_cache-38a63a30-a3bc-4556-9fb6-53522dbf2c68" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:49:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e4f1c6d7-c8a6-49b6-9ff8-c09d36fa6408 req-cd6cf938-c5d3-4855-bf5f-f68ddfa8c093 service nova] Acquired lock "refresh_cache-38a63a30-a3bc-4556-9fb6-53522dbf2c68" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:49:52 user nova-compute[75391]: DEBUG nova.network.neutron [req-e4f1c6d7-c8a6-49b6-9ff8-c09d36fa6408 req-cd6cf938-c5d3-4855-bf5f-f68ddfa8c093 service nova] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Refreshing network info cache for port b89e475f-2d05-4427-81aa-64a19c9664ee {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:49:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG nova.compute.manager [req-1b34c998-ea4f-45f7-b2da-54eeda0f715b req-3c069c26-15ad-40ba-b4dd-1c522d43b9c8 service nova] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Received event network-vif-unplugged-b89e475f-2d05-4427-81aa-64a19c9664ee {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1b34c998-ea4f-45f7-b2da-54eeda0f715b req-3c069c26-15ad-40ba-b4dd-1c522d43b9c8 service nova] Acquiring lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1b34c998-ea4f-45f7-b2da-54eeda0f715b req-3c069c26-15ad-40ba-b4dd-1c522d43b9c8 service nova] Lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1b34c998-ea4f-45f7-b2da-54eeda0f715b req-3c069c26-15ad-40ba-b4dd-1c522d43b9c8 service nova] Lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG nova.compute.manager [req-1b34c998-ea4f-45f7-b2da-54eeda0f715b req-3c069c26-15ad-40ba-b4dd-1c522d43b9c8 service nova] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] No waiting events found dispatching network-vif-unplugged-b89e475f-2d05-4427-81aa-64a19c9664ee {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG nova.compute.manager [req-1b34c998-ea4f-45f7-b2da-54eeda0f715b req-3c069c26-15ad-40ba-b4dd-1c522d43b9c8 service nova] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Received event network-vif-unplugged-b89e475f-2d05-4427-81aa-64a19c9664ee for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-fc9484c0-9083-4797-8ab1-2ad392822ce8" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-fc9484c0-9083-4797-8ab1-2ad392822ce8" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 02:49:53 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Instance destroyed successfully.
Nov 15 02:49:53 user nova-compute[75391]: DEBUG nova.objects.instance [None req-c8f0886b-3d1b-4350-9996-c7bb1af84400 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lazy-loading 'resources' on Instance uuid 38a63a30-a3bc-4556-9fb6-53522dbf2c68 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-c8f0886b-3d1b-4350-9996-c7bb1af84400 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:42:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1307944408',display_name='tempest-TestStampPattern-server-1307944408',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1307944408',id=11,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3B/LEgcjzrDXoVcTjod3suFtQaJB7/AKBOdUne7T90RZ2Rsek9XiExDiKs3DHc1kAHMCNWLEQyKPOAYwsFFBz1wohZQQ7UNT2IOBVNPlD2nJvR8+6i+tJnL4hmFgKSyA==',key_name='tempest-TestStampPattern-587335042',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:43:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49e0ca1f6ce542a482164410c5e67e13',ramdisk_id='',reservation_id='r-fnkdct1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1142812634',owner_user_name='tempest-TestStampPattern-1142812634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:45:58Z,user_data=None,user_id='80bf1a1698dc420799dbaf2e254e5d74',uuid=38a63a30-a3bc-4556-9fb6-53522dbf2c68,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b89e475f-2d05-4427-81aa-64a19c9664ee", "address": "fa:16:3e:8f:aa:98", "network": {"id": "5567560c-b3c5-4802-b758-92d672458351", "bridge": "br-int", "label": "tempest-TestStampPattern-268456575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e0ca1f6ce542a482164410c5e67e13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89e475f-2d", "ovs_interfaceid": "b89e475f-2d05-4427-81aa-64a19c9664ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-c8f0886b-3d1b-4350-9996-c7bb1af84400 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Converting VIF {"id": "b89e475f-2d05-4427-81aa-64a19c9664ee", "address": "fa:16:3e:8f:aa:98", "network": {"id": "5567560c-b3c5-4802-b758-92d672458351", "bridge": "br-int", "label": "tempest-TestStampPattern-268456575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e0ca1f6ce542a482164410c5e67e13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89e475f-2d", "ovs_interfaceid": "b89e475f-2d05-4427-81aa-64a19c9664ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-c8f0886b-3d1b-4350-9996-c7bb1af84400 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:aa:98,bridge_name='br-int',has_traffic_filtering=True,id=b89e475f-2d05-4427-81aa-64a19c9664ee,network=Network(5567560c-b3c5-4802-b758-92d672458351),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb89e475f-2d') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG os_vif [None req-c8f0886b-3d1b-4350-9996-c7bb1af84400 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:aa:98,bridge_name='br-int',has_traffic_filtering=True,id=b89e475f-2d05-4427-81aa-64a19c9664ee,network=Network(5567560c-b3c5-4802-b758-92d672458351),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb89e475f-2d') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb89e475f-2d, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0621adde-2909-4f7f-9c84-8432187370ad) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:53 user nova-compute[75391]: INFO os_vif [None req-c8f0886b-3d1b-4350-9996-c7bb1af84400 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:aa:98,bridge_name='br-int',has_traffic_filtering=True,id=b89e475f-2d05-4427-81aa-64a19c9664ee,network=Network(5567560c-b3c5-4802-b758-92d672458351),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb89e475f-2d')
Nov 15 02:49:53 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-c8f0886b-3d1b-4350-9996-c7bb1af84400 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Deleting instance files /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68_del
Nov 15 02:49:53 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-c8f0886b-3d1b-4350-9996-c7bb1af84400 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Deletion of /opt/stack/data/nova/instances/38a63a30-a3bc-4556-9fb6-53522dbf2c68_del complete
Nov 15 02:49:53 user nova-compute[75391]: DEBUG nova.network.neutron [req-e4f1c6d7-c8a6-49b6-9ff8-c09d36fa6408 req-cd6cf938-c5d3-4855-bf5f-f68ddfa8c093 service nova] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Updated VIF entry in instance network info cache for port b89e475f-2d05-4427-81aa-64a19c9664ee. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG nova.network.neutron [req-e4f1c6d7-c8a6-49b6-9ff8-c09d36fa6408 req-cd6cf938-c5d3-4855-bf5f-f68ddfa8c093 service nova] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Updating instance_info_cache with network_info: [{"id": "b89e475f-2d05-4427-81aa-64a19c9664ee", "address": "fa:16:3e:8f:aa:98", "network": {"id": "5567560c-b3c5-4802-b758-92d672458351", "bridge": "br-int", "label": "tempest-TestStampPattern-268456575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e0ca1f6ce542a482164410c5e67e13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89e475f-2d", "ovs_interfaceid": "b89e475f-2d05-4427-81aa-64a19c9664ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e4f1c6d7-c8a6-49b6-9ff8-c09d36fa6408 req-cd6cf938-c5d3-4855-bf5f-f68ddfa8c093 service nova] Releasing lock "refresh_cache-38a63a30-a3bc-4556-9fb6-53522dbf2c68" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:49:53 user nova-compute[75391]: INFO nova.compute.manager [None req-c8f0886b-3d1b-4350-9996-c7bb1af84400 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 15 02:49:53 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-c8f0886b-3d1b-4350-9996-c7bb1af84400 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:49:53 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:49:54 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Updating instance_info_cache with network_info: [{"id": "d8f34e4c-5c99-45eb-a282-a721a2019209", "address": "fa:16:3e:ca:58:46", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f34e4c-5c", "ovs_interfaceid": "d8f34e4c-5c99-45eb-a282-a721a2019209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:49:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-fc9484c0-9083-4797-8ab1-2ad392822ce8" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:49:54 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 02:49:54 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:49:54 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:49:54 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:49:54 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:49:54 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:49:54 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:49:54 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:49:54 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:49:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:54 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:49:54 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:49:54 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Took 0.65 seconds to deallocate network for instance.
Nov 15 02:49:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c8f0886b-3d1b-4350-9996-c7bb1af84400 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c8f0886b-3d1b-4350-9996-c7bb1af84400 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51ffdd2-a462-4360-bc03-49f91c2ef45a/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51ffdd2-a462-4360-bc03-49f91c2ef45a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51ffdd2-a462-4360-bc03-49f91c2ef45a/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:54 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-c8f0886b-3d1b-4350-9996-c7bb1af84400 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:49:54 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-c8f0886b-3d1b-4350-9996-c7bb1af84400 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:49:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c8f0886b-3d1b-4350-9996-c7bb1af84400 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51ffdd2-a462-4360-bc03-49f91c2ef45a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:54 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-c8f0886b-3d1b-4350-9996-c7bb1af84400 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Deleted allocations for instance 38a63a30-a3bc-4556-9fb6-53522dbf2c68
Nov 15 02:49:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c8f0886b-3d1b-4350-9996-c7bb1af84400 tempest-TestStampPattern-1142812634 tempest-TestStampPattern-1142812634-project-member] Lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.443s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:49:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:55 user nova-compute[75391]: DEBUG nova.compute.manager [req-7d298bf7-113b-4ecd-8ee7-19ee4097c8ce req-805921b7-ddd2-4759-819a-4af6ba2f566f service nova] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Received event network-vif-plugged-b89e475f-2d05-4427-81aa-64a19c9664ee {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7d298bf7-113b-4ecd-8ee7-19ee4097c8ce req-805921b7-ddd2-4759-819a-4af6ba2f566f service nova] Acquiring lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7d298bf7-113b-4ecd-8ee7-19ee4097c8ce req-805921b7-ddd2-4759-819a-4af6ba2f566f service nova] Lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7d298bf7-113b-4ecd-8ee7-19ee4097c8ce req-805921b7-ddd2-4759-819a-4af6ba2f566f service nova] Lock "38a63a30-a3bc-4556-9fb6-53522dbf2c68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:55 user nova-compute[75391]: DEBUG nova.compute.manager [req-7d298bf7-113b-4ecd-8ee7-19ee4097c8ce req-805921b7-ddd2-4759-819a-4af6ba2f566f service nova] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] No waiting events found dispatching network-vif-plugged-b89e475f-2d05-4427-81aa-64a19c9664ee {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:49:55 user nova-compute[75391]: WARNING nova.compute.manager [req-7d298bf7-113b-4ecd-8ee7-19ee4097c8ce req-805921b7-ddd2-4759-819a-4af6ba2f566f service nova] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Received unexpected event network-vif-plugged-b89e475f-2d05-4427-81aa-64a19c9664ee for instance with vm_state deleted and task_state None.
Nov 15 02:49:55 user nova-compute[75391]: DEBUG nova.compute.manager [req-7d298bf7-113b-4ecd-8ee7-19ee4097c8ce req-805921b7-ddd2-4759-819a-4af6ba2f566f service nova] [instance: 38a63a30-a3bc-4556-9fb6-53522dbf2c68] Received event network-vif-deleted-b89e475f-2d05-4427-81aa-64a19c9664ee {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b144078-2d2e-460c-b432-96d6309e338c/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b144078-2d2e-460c-b432-96d6309e338c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b144078-2d2e-460c-b432-96d6309e338c/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b144078-2d2e-460c-b432-96d6309e338c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'keuziEXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:49:56 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:49:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:49:56 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:49:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:49:56 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[603557b5-5a58-4737-bdd0-462b92151256]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:49:56 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f36130-0e30-4937-b3c2-f258d3a82c98]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd] added
Nov 15 02:49:56 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[96eed4c9-7c7b-4be9-b966-3ec998b4f22a]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d85b3bc-4240-4d09-8bb6-e51c6490d18f]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v keuziEXN {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v keuziEXN" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b24eb8-635b-4e2c-bf83-2523c5563a8e]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'keuziEXN'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1c788f-3038-4c35-9c1c-2468dd1736f7]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[820cd86a-9998-4acb-878d-ac278bfb8547]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:49:56 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:49:56 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:49:56 user nova-compute[75391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:49:56 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:49:56 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:49:56 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:49:56 user nova-compute[75391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:49:56 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[039015ab-3753-41ee-8ff4-77dc95b2be32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd, portal: 172.16.0.220,3260]
Nov 15 02:49:56 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd, portal: 172.16.0.220,3260] successful.
Nov 15 02:49:56 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1615db27-3bbe-476b-a7a9-e6574daa41a3]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28e529d-746f-4b7d-b9f8-b9dcfac41b36]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:49:56 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:49:56 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:49:56 user nova-compute[75391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:49:56 user nova-compute[75391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd (non-flash)
Nov 15 02:49:56 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:49:56 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:49:56 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:49:56 user nova-compute[75391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:49:56 user nova-compute[75391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd (non-flash)
Nov 15 02:49:56 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[22293298-bae5-4474-a35f-83a920c5ed04]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'keuziEXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:49:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:49:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Acquiring lock "fdcb81ad-9c87-408d-abed-9b7cd2a7a646" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "fdcb81ad-9c87-408d-abed-9b7cd2a7a646" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:57 user nova-compute[75391]: DEBUG nova.compute.manager [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:49:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:57 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:49:57 user nova-compute[75391]: INFO nova.compute.claims [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Claim successful on node user
Nov 15 02:49:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:49:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23063313032383032', 'path': '/dev/sdc'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:49:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063313032383032', 'path': '/dev/sdc'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:49:57 user nova-compute[75391]: DEBUG nova.objects.instance [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lazy-loading 'flavor' on Instance uuid 054d3064-549d-442e-85ea-4c7bfde518cb {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:49:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 02:49:57 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:49:57 user nova-compute[75391]:   <source dev="/dev/sdc"/>
Nov 15 02:49:57 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:49:57 user nova-compute[75391]:   <serial>b64b2bd5-408d-409f-91d1-53b9f79ca6fd</serial>
Nov 15 02:49:57 user nova-compute[75391]: </disk>
Nov 15 02:49:57 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:49:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/054d3064-549d-442e-85ea-4c7bfde518cb/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] No VIF found with MAC fa:16:3e:0c:35:87, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG nova.compute.manager [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/054d3064-549d-442e-85ea-4c7bfde518cb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/054d3064-549d-442e-85ea-4c7bfde518cb/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG nova.compute.manager [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG nova.network.neutron [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-86ead14b-ac71-41a6-a95e-395f224ae34f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "054d3064-549d-442e-85ea-4c7bfde518cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.935s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:58 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:49:58 user nova-compute[75391]: DEBUG nova.compute.manager [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG nova.policy [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6725c61101204b09be4fd561231c4123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238e9fdacbfe47c7bdd8c638872c6ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/054d3064-549d-442e-85ea-4c7bfde518cb/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG nova.compute.manager [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:49:58 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Creating image(s)
Nov 15 02:49:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Acquiring lock "/opt/stack/data/nova/instances/fdcb81ad-9c87-408d-abed-9b7cd2a7a646/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "/opt/stack/data/nova/instances/fdcb81ad-9c87-408d-abed-9b7cd2a7a646/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "/opt/stack/data/nova/instances/fdcb81ad-9c87-408d-abed-9b7cd2a7a646/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG nova.network.neutron [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Successfully created port: 7b9c6c03-700b-4dbe-944f-181f69045879 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.534s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:58 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:49:58 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:49:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=7372MB free_disk=25.051895141601562GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9744c8a1-046e-4a00-92e0-92ebb3275ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance fc9484c0-9083-4797-8ab1-2ad392822ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6400a5f3-0ec9-4484-930c-1f5061ae5374 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance a4171d96-bb26-473f-a322-178dadbaab0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 2b144078-2d2e-460c-b432-96d6309e338c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance ebb7e616-3c05-4d99-a0b3-76dc1723e82d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 054d3064-549d-442e-85ea-4c7bfde518cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 4ab2dd85-9758-4ea9-8282-9396a2653393 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance d51ffdd2-a462-4360-bc03-49f91c2ef45a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance fdcb81ad-9c87-408d-abed-9b7cd2a7a646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.222s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/fdcb81ad-9c87-408d-abed-9b7cd2a7a646/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/fdcb81ad-9c87-408d-abed-9b7cd2a7a646/disk 1073741824" returned: 0 in 0.056s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.176s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fdcb81ad-9c87-408d-abed-9b7cd2a7a646/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcb81ad-9c87-408d-abed-9b7cd2a7a646/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG nova.network.neutron [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Successfully updated port: 7b9c6c03-700b-4dbe-944f-181f69045879 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Acquiring lock "refresh_cache-fdcb81ad-9c87-408d-abed-9b7cd2a7a646" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Acquired lock "refresh_cache-fdcb81ad-9c87-408d-abed-9b7cd2a7a646" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG nova.network.neutron [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG nova.compute.manager [req-cb4f570d-eef2-4b5b-ac6e-39bcaadbded9 req-d1d7f8b8-f803-4959-99be-a7a2ff0c07dc service nova] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Received event network-changed-7b9c6c03-700b-4dbe-944f-181f69045879 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG nova.compute.manager [req-cb4f570d-eef2-4b5b-ac6e-39bcaadbded9 req-d1d7f8b8-f803-4959-99be-a7a2ff0c07dc service nova] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Refreshing instance network info cache due to event network-changed-7b9c6c03-700b-4dbe-944f-181f69045879. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-cb4f570d-eef2-4b5b-ac6e-39bcaadbded9 req-d1d7f8b8-f803-4959-99be-a7a2ff0c07dc service nova] Acquiring lock "refresh_cache-fdcb81ad-9c87-408d-abed-9b7cd2a7a646" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcb81ad-9c87-408d-abed-9b7cd2a7a646/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Cannot resize image /opt/stack/data/nova/instances/fdcb81ad-9c87-408d-abed-9b7cd2a7a646/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Ensure instance console log exists: /opt/stack/data/nova/instances/fdcb81ad-9c87-408d-abed-9b7cd2a7a646/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.677s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:49:59 user nova-compute[75391]: DEBUG nova.network.neutron [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.network.neutron [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Updating instance_info_cache with network_info: [{"id": "7b9c6c03-700b-4dbe-944f-181f69045879", "address": "fa:16:3e:80:9f:9a", "network": {"id": "fe3b43e0-6135-45f0-97ec-8b2af5fa26fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1391931283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "238e9fdacbfe47c7bdd8c638872c6ca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9c6c03-70", "ovs_interfaceid": "7b9c6c03-700b-4dbe-944f-181f69045879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Releasing lock "refresh_cache-fdcb81ad-9c87-408d-abed-9b7cd2a7a646" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.compute.manager [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Instance network_info: |[{"id": "7b9c6c03-700b-4dbe-944f-181f69045879", "address": "fa:16:3e:80:9f:9a", "network": {"id": "fe3b43e0-6135-45f0-97ec-8b2af5fa26fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1391931283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "238e9fdacbfe47c7bdd8c638872c6ca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9c6c03-70", "ovs_interfaceid": "7b9c6c03-700b-4dbe-944f-181f69045879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-cb4f570d-eef2-4b5b-ac6e-39bcaadbded9 req-d1d7f8b8-f803-4959-99be-a7a2ff0c07dc service nova] Acquired lock "refresh_cache-fdcb81ad-9c87-408d-abed-9b7cd2a7a646" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.network.neutron [req-cb4f570d-eef2-4b5b-ac6e-39bcaadbded9 req-d1d7f8b8-f803-4959-99be-a7a2ff0c07dc service nova] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Refreshing network info cache for port 7b9c6c03-700b-4dbe-944f-181f69045879 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Start _get_guest_xml network_info=[{"id": "7b9c6c03-700b-4dbe-944f-181f69045879", "address": "fa:16:3e:80:9f:9a", "network": {"id": "fe3b43e0-6135-45f0-97ec-8b2af5fa26fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1391931283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "238e9fdacbfe47c7bdd8c638872c6ca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9c6c03-70", "ovs_interfaceid": "7b9c6c03-700b-4dbe-944f-181f69045879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:50:00 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:50:00 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:49:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2051821792',display_name='tempest-VolumesActionsTest-instance-2051821792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2051821792',id=24,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='238e9fdacbfe47c7bdd8c638872c6ca2',ramdisk_id='',reservation_id='r-oa5t10hh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-712553389',owner_user_name='tempest-VolumesActionsTest-712553389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:49:58Z,user_data=None,user_id='6725c61101204b09be4fd561231c4123',uuid=fdcb81ad-9c87-408d-abed-9b7cd2a7a646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b9c6c03-700b-4dbe-944f-181f69045879", "address": "fa:16:3e:80:9f:9a", "network": {"id": "fe3b43e0-6135-45f0-97ec-8b2af5fa26fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1391931283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "238e9fdacbfe47c7bdd8c638872c6ca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9c6c03-70", "ovs_interfaceid": "7b9c6c03-700b-4dbe-944f-181f69045879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Converting VIF {"id": "7b9c6c03-700b-4dbe-944f-181f69045879", "address": "fa:16:3e:80:9f:9a", "network": {"id": "fe3b43e0-6135-45f0-97ec-8b2af5fa26fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1391931283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "238e9fdacbfe47c7bdd8c638872c6ca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9c6c03-70", "ovs_interfaceid": "7b9c6c03-700b-4dbe-944f-181f69045879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:9f:9a,bridge_name='br-int',has_traffic_filtering=True,id=7b9c6c03-700b-4dbe-944f-181f69045879,network=Network(fe3b43e0-6135-45f0-97ec-8b2af5fa26fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b9c6c03-70') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.objects.instance [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lazy-loading 'pci_devices' on Instance uuid fdcb81ad-9c87-408d-abed-9b7cd2a7a646 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:50:00 user nova-compute[75391]:   <uuid>fdcb81ad-9c87-408d-abed-9b7cd2a7a646</uuid>
Nov 15 02:50:00 user nova-compute[75391]:   <name>instance-00000018</name>
Nov 15 02:50:00 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:50:00 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:50:00 user nova-compute[75391]:   <metadata>
Nov 15 02:50:00 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:50:00 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:50:00 user nova-compute[75391]:       <nova:name>tempest-VolumesActionsTest-instance-2051821792</nova:name>
Nov 15 02:50:00 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:50:00</nova:creationTime>
Nov 15 02:50:00 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:50:00 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:50:00 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:50:00 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:50:00 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:50:00 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:50:00 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:50:00 user nova-compute[75391]:       <nova:owner>
Nov 15 02:50:00 user nova-compute[75391]:         <nova:user uuid="6725c61101204b09be4fd561231c4123">tempest-VolumesActionsTest-712553389-project-member</nova:user>
Nov 15 02:50:00 user nova-compute[75391]:         <nova:project uuid="238e9fdacbfe47c7bdd8c638872c6ca2">tempest-VolumesActionsTest-712553389</nova:project>
Nov 15 02:50:00 user nova-compute[75391]:       </nova:owner>
Nov 15 02:50:00 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:50:00 user nova-compute[75391]:       <nova:ports>
Nov 15 02:50:00 user nova-compute[75391]:         <nova:port uuid="7b9c6c03-700b-4dbe-944f-181f69045879">
Nov 15 02:50:00 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 02:50:00 user nova-compute[75391]:         </nova:port>
Nov 15 02:50:00 user nova-compute[75391]:       </nova:ports>
Nov 15 02:50:00 user nova-compute[75391]:     </nova:instance>
Nov 15 02:50:00 user nova-compute[75391]:   </metadata>
Nov 15 02:50:00 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:50:00 user nova-compute[75391]:     <system>
Nov 15 02:50:00 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:50:00 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:50:00 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:50:00 user nova-compute[75391]:       <entry name="serial">fdcb81ad-9c87-408d-abed-9b7cd2a7a646</entry>
Nov 15 02:50:00 user nova-compute[75391]:       <entry name="uuid">fdcb81ad-9c87-408d-abed-9b7cd2a7a646</entry>
Nov 15 02:50:00 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:50:00 user nova-compute[75391]:     </system>
Nov 15 02:50:00 user nova-compute[75391]:   </sysinfo>
Nov 15 02:50:00 user nova-compute[75391]:   <os>
Nov 15 02:50:00 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:50:00 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:50:00 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:50:00 user nova-compute[75391]:   </os>
Nov 15 02:50:00 user nova-compute[75391]:   <features>
Nov 15 02:50:00 user nova-compute[75391]:     <acpi/>
Nov 15 02:50:00 user nova-compute[75391]:     <apic/>
Nov 15 02:50:00 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:50:00 user nova-compute[75391]:   </features>
Nov 15 02:50:00 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:50:00 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:50:00 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:50:00 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:50:00 user nova-compute[75391]:   </clock>
Nov 15 02:50:00 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:50:00 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:50:00 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:50:00 user nova-compute[75391]:   </cpu>
Nov 15 02:50:00 user nova-compute[75391]:   <devices>
Nov 15 02:50:00 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:50:00 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:50:00 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/fdcb81ad-9c87-408d-abed-9b7cd2a7a646/disk"/>
Nov 15 02:50:00 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:50:00 user nova-compute[75391]:     </disk>
Nov 15 02:50:00 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:50:00 user nova-compute[75391]:       <mac address="fa:16:3e:80:9f:9a"/>
Nov 15 02:50:00 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:50:00 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:50:00 user nova-compute[75391]:       <target dev="tap7b9c6c03-70"/>
Nov 15 02:50:00 user nova-compute[75391]:     </interface>
Nov 15 02:50:00 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:50:00 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/fdcb81ad-9c87-408d-abed-9b7cd2a7a646/console.log" append="off"/>
Nov 15 02:50:00 user nova-compute[75391]:     </serial>
Nov 15 02:50:00 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:50:00 user nova-compute[75391]:     <video>
Nov 15 02:50:00 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:50:00 user nova-compute[75391]:     </video>
Nov 15 02:50:00 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:50:00 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:50:00 user nova-compute[75391]:     </rng>
Nov 15 02:50:00 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:50:00 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:50:00 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:50:00 user nova-compute[75391]:     </memballoon>
Nov 15 02:50:00 user nova-compute[75391]:   </devices>
Nov 15 02:50:00 user nova-compute[75391]: </domain>
Nov 15 02:50:00 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:49:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2051821792',display_name='tempest-VolumesActionsTest-instance-2051821792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2051821792',id=24,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='238e9fdacbfe47c7bdd8c638872c6ca2',ramdisk_id='',reservation_id='r-oa5t10hh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-712553389',owner_user_name='tempest-VolumesActionsTest-712553389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:49:58Z,user_data=None,user_id='6725c61101204b09be4fd561231c4123',uuid=fdcb81ad-9c87-408d-abed-9b7cd2a7a646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b9c6c03-700b-4dbe-944f-181f69045879", "address": "fa:16:3e:80:9f:9a", "network": {"id": "fe3b43e0-6135-45f0-97ec-8b2af5fa26fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1391931283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "238e9fdacbfe47c7bdd8c638872c6ca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9c6c03-70", "ovs_interfaceid": "7b9c6c03-700b-4dbe-944f-181f69045879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Converting VIF {"id": "7b9c6c03-700b-4dbe-944f-181f69045879", "address": "fa:16:3e:80:9f:9a", "network": {"id": "fe3b43e0-6135-45f0-97ec-8b2af5fa26fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1391931283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "238e9fdacbfe47c7bdd8c638872c6ca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9c6c03-70", "ovs_interfaceid": "7b9c6c03-700b-4dbe-944f-181f69045879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:9f:9a,bridge_name='br-int',has_traffic_filtering=True,id=7b9c6c03-700b-4dbe-944f-181f69045879,network=Network(fe3b43e0-6135-45f0-97ec-8b2af5fa26fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b9c6c03-70') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG os_vif [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:9f:9a,bridge_name='br-int',has_traffic_filtering=True,id=7b9c6c03-700b-4dbe-944f-181f69045879,network=Network(fe3b43e0-6135-45f0-97ec-8b2af5fa26fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b9c6c03-70') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a3dbd31-80b9-50d1-8a31-f625157109bd', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b9c6c03-70, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b9c6c03-70, col_values=(('qos', UUID('921033d9-517d-4311-a686-016b61b6264c')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b9c6c03-70, col_values=(('external_ids', {'iface-id': '7b9c6c03-700b-4dbe-944f-181f69045879', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:9f:9a', 'vm-uuid': 'fdcb81ad-9c87-408d-abed-9b7cd2a7a646'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:00 user nova-compute[75391]: INFO os_vif [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:9f:9a,bridge_name='br-int',has_traffic_filtering=True,id=7b9c6c03-700b-4dbe-944f-181f69045879,network=Network(fe3b43e0-6135-45f0-97ec-8b2af5fa26fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b9c6c03-70')
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] No VIF found with MAC fa:16:3e:80:9f:9a, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.network.neutron [req-cb4f570d-eef2-4b5b-ac6e-39bcaadbded9 req-d1d7f8b8-f803-4959-99be-a7a2ff0c07dc service nova] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Updated VIF entry in instance network info cache for port 7b9c6c03-700b-4dbe-944f-181f69045879. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.network.neutron [req-cb4f570d-eef2-4b5b-ac6e-39bcaadbded9 req-d1d7f8b8-f803-4959-99be-a7a2ff0c07dc service nova] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Updating instance_info_cache with network_info: [{"id": "7b9c6c03-700b-4dbe-944f-181f69045879", "address": "fa:16:3e:80:9f:9a", "network": {"id": "fe3b43e0-6135-45f0-97ec-8b2af5fa26fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1391931283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "238e9fdacbfe47c7bdd8c638872c6ca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9c6c03-70", "ovs_interfaceid": "7b9c6c03-700b-4dbe-944f-181f69045879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-cb4f570d-eef2-4b5b-ac6e-39bcaadbded9 req-d1d7f8b8-f803-4959-99be-a7a2ff0c07dc service nova] Releasing lock "refresh_cache-fdcb81ad-9c87-408d-abed-9b7cd2a7a646" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b6e0fa9-0637-4270-9868-ba23cbc9b034 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Acquiring lock "2b144078-2d2e-460c-b432-96d6309e338c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b6e0fa9-0637-4270-9868-ba23cbc9b034 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lock "2b144078-2d2e-460c-b432-96d6309e338c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b6e0fa9-0637-4270-9868-ba23cbc9b034 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Acquiring lock "2b144078-2d2e-460c-b432-96d6309e338c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b6e0fa9-0637-4270-9868-ba23cbc9b034 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lock "2b144078-2d2e-460c-b432-96d6309e338c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b6e0fa9-0637-4270-9868-ba23cbc9b034 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lock "2b144078-2d2e-460c-b432-96d6309e338c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:00 user nova-compute[75391]: INFO nova.compute.manager [None req-9b6e0fa9-0637-4270-9868-ba23cbc9b034 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Terminating instance
Nov 15 02:50:00 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b6e0fa9-0637-4270-9868-ba23cbc9b034 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:50:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:01 user nova-compute[75391]: DEBUG nova.compute.manager [req-b221d261-5fe2-48ee-88a4-2438f85c779b req-85877d14-eb3b-402a-bd5a-605e33bf3851 service nova] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Received event network-vif-unplugged-5cf32d19-328e-4636-85cf-9055b9dc516b {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:50:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b221d261-5fe2-48ee-88a4-2438f85c779b req-85877d14-eb3b-402a-bd5a-605e33bf3851 service nova] Acquiring lock "2b144078-2d2e-460c-b432-96d6309e338c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b221d261-5fe2-48ee-88a4-2438f85c779b req-85877d14-eb3b-402a-bd5a-605e33bf3851 service nova] Lock "2b144078-2d2e-460c-b432-96d6309e338c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b221d261-5fe2-48ee-88a4-2438f85c779b req-85877d14-eb3b-402a-bd5a-605e33bf3851 service nova] Lock "2b144078-2d2e-460c-b432-96d6309e338c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:01 user nova-compute[75391]: DEBUG nova.compute.manager [req-b221d261-5fe2-48ee-88a4-2438f85c779b req-85877d14-eb3b-402a-bd5a-605e33bf3851 service nova] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] No waiting events found dispatching network-vif-unplugged-5cf32d19-328e-4636-85cf-9055b9dc516b {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:50:01 user nova-compute[75391]: DEBUG nova.compute.manager [req-b221d261-5fe2-48ee-88a4-2438f85c779b req-85877d14-eb3b-402a-bd5a-605e33bf3851 service nova] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Received event network-vif-unplugged-5cf32d19-328e-4636-85cf-9055b9dc516b for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:50:02 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Instance destroyed successfully.
Nov 15 02:50:02 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9b6e0fa9-0637-4270-9868-ba23cbc9b034 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lazy-loading 'resources' on Instance uuid 2b144078-2d2e-460c-b432-96d6309e338c {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:50:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-9b6e0fa9-0637-4270-9868-ba23cbc9b034 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:47:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1013641174',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1013641174',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1013641',id=18,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCr431YR+5GJ9r3bNLlb2nrg33RWscWRe6juPvDOhvAgXWVyufyC+bvwi4TtZyeXs/ifvf5Nvc1Fg/ePWoC7tGy2Az2jBm9Q2OvRzeJJyy9HhGz7bHqdETPi58UX7AnHYQ==',key_name='tempest-keypair-1683423078',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:47:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4593a86a9104dadb43fce4e25e62b5a',ramdisk_id='',reservation_id='r-00lmkhsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-979449537',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:47:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e644a27f12f94d3ca787608cc36879fe',uuid=2b144078-2d2e-460c-b432-96d6309e338c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cf32d19-328e-4636-85cf-9055b9dc516b", "address": "fa:16:3e:88:86:50", "network": {"id": "a072f3fa-a5c1-47ad-9521-79920d593ad0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-16679141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4593a86a9104dadb43fce4e25e62b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cf32d19-32", "ovs_interfaceid": "5cf32d19-328e-4636-85cf-9055b9dc516b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:50:02 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-9b6e0fa9-0637-4270-9868-ba23cbc9b034 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Converting VIF {"id": "5cf32d19-328e-4636-85cf-9055b9dc516b", "address": "fa:16:3e:88:86:50", "network": {"id": "a072f3fa-a5c1-47ad-9521-79920d593ad0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-16679141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4593a86a9104dadb43fce4e25e62b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cf32d19-32", "ovs_interfaceid": "5cf32d19-328e-4636-85cf-9055b9dc516b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:50:02 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-9b6e0fa9-0637-4270-9868-ba23cbc9b034 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:86:50,bridge_name='br-int',has_traffic_filtering=True,id=5cf32d19-328e-4636-85cf-9055b9dc516b,network=Network(a072f3fa-a5c1-47ad-9521-79920d593ad0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cf32d19-32') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:50:02 user nova-compute[75391]: DEBUG os_vif [None req-9b6e0fa9-0637-4270-9868-ba23cbc9b034 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:86:50,bridge_name='br-int',has_traffic_filtering=True,id=5cf32d19-328e-4636-85cf-9055b9dc516b,network=Network(a072f3fa-a5c1-47ad-9521-79920d593ad0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cf32d19-32') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:50:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5cf32d19-32, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:50:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:50:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a39f313-4c96-4d11-9fda-be9a1fbadee1) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:50:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:50:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:02 user nova-compute[75391]: INFO os_vif [None req-9b6e0fa9-0637-4270-9868-ba23cbc9b034 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:86:50,bridge_name='br-int',has_traffic_filtering=True,id=5cf32d19-328e-4636-85cf-9055b9dc516b,network=Network(a072f3fa-a5c1-47ad-9521-79920d593ad0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cf32d19-32')
Nov 15 02:50:02 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-9b6e0fa9-0637-4270-9868-ba23cbc9b034 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Deleting instance files /opt/stack/data/nova/instances/2b144078-2d2e-460c-b432-96d6309e338c_del
Nov 15 02:50:02 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-9b6e0fa9-0637-4270-9868-ba23cbc9b034 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Deletion of /opt/stack/data/nova/instances/2b144078-2d2e-460c-b432-96d6309e338c_del complete
Nov 15 02:50:02 user nova-compute[75391]: INFO nova.compute.manager [None req-9b6e0fa9-0637-4270-9868-ba23cbc9b034 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 15 02:50:02 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-9b6e0fa9-0637-4270-9868-ba23cbc9b034 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:50:02 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:50:02 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:50:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-e4209ea6-0b8a-4a3a-a150-dda9db65bec5 req-9afc5a58-6f03-4bb4-800f-2cbb1978710b service nova] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Received event network-vif-plugged-7b9c6c03-700b-4dbe-944f-181f69045879 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:50:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e4209ea6-0b8a-4a3a-a150-dda9db65bec5 req-9afc5a58-6f03-4bb4-800f-2cbb1978710b service nova] Acquiring lock "fdcb81ad-9c87-408d-abed-9b7cd2a7a646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e4209ea6-0b8a-4a3a-a150-dda9db65bec5 req-9afc5a58-6f03-4bb4-800f-2cbb1978710b service nova] Lock "fdcb81ad-9c87-408d-abed-9b7cd2a7a646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e4209ea6-0b8a-4a3a-a150-dda9db65bec5 req-9afc5a58-6f03-4bb4-800f-2cbb1978710b service nova] Lock "fdcb81ad-9c87-408d-abed-9b7cd2a7a646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-e4209ea6-0b8a-4a3a-a150-dda9db65bec5 req-9afc5a58-6f03-4bb4-800f-2cbb1978710b service nova] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] No waiting events found dispatching network-vif-plugged-7b9c6c03-700b-4dbe-944f-181f69045879 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:50:02 user nova-compute[75391]: WARNING nova.compute.manager [req-e4209ea6-0b8a-4a3a-a150-dda9db65bec5 req-9afc5a58-6f03-4bb4-800f-2cbb1978710b service nova] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Received unexpected event network-vif-plugged-7b9c6c03-700b-4dbe-944f-181f69045879 for instance with vm_state building and task_state spawning.
Nov 15 02:50:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:03 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:50:03 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Took 0.96 seconds to deallocate network for instance.
Nov 15 02:50:03 user nova-compute[75391]: DEBUG nova.compute.manager [req-bf63881e-302a-408d-9354-e85049d4157d req-5a995fa8-c0e0-469e-852b-b006fab96e1c service nova] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Received event network-vif-deleted-5cf32d19-328e-4636-85cf-9055b9dc516b {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:50:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b6e0fa9-0637-4270-9868-ba23cbc9b034 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b6e0fa9-0637-4270-9868-ba23cbc9b034 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:03 user nova-compute[75391]: DEBUG nova.compute.manager [req-748a470b-7aae-4868-b675-b6b05466b2b8 req-743cb965-e59b-4013-813a-41dba381d594 service nova] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Received event network-vif-plugged-5cf32d19-328e-4636-85cf-9055b9dc516b {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:50:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-748a470b-7aae-4868-b675-b6b05466b2b8 req-743cb965-e59b-4013-813a-41dba381d594 service nova] Acquiring lock "2b144078-2d2e-460c-b432-96d6309e338c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-748a470b-7aae-4868-b675-b6b05466b2b8 req-743cb965-e59b-4013-813a-41dba381d594 service nova] Lock "2b144078-2d2e-460c-b432-96d6309e338c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-748a470b-7aae-4868-b675-b6b05466b2b8 req-743cb965-e59b-4013-813a-41dba381d594 service nova] Lock "2b144078-2d2e-460c-b432-96d6309e338c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:03 user nova-compute[75391]: DEBUG nova.compute.manager [req-748a470b-7aae-4868-b675-b6b05466b2b8 req-743cb965-e59b-4013-813a-41dba381d594 service nova] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] No waiting events found dispatching network-vif-plugged-5cf32d19-328e-4636-85cf-9055b9dc516b {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:50:03 user nova-compute[75391]: WARNING nova.compute.manager [req-748a470b-7aae-4868-b675-b6b05466b2b8 req-743cb965-e59b-4013-813a-41dba381d594 service nova] [instance: 2b144078-2d2e-460c-b432-96d6309e338c] Received unexpected event network-vif-plugged-5cf32d19-328e-4636-85cf-9055b9dc516b for instance with vm_state deleted and task_state None.
Nov 15 02:50:03 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b6e0fa9-0637-4270-9868-ba23cbc9b034 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:50:03 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b6e0fa9-0637-4270-9868-ba23cbc9b034 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:50:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b6e0fa9-0637-4270-9868-ba23cbc9b034 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:03 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-9b6e0fa9-0637-4270-9868-ba23cbc9b034 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Deleted allocations for instance 2b144078-2d2e-460c-b432-96d6309e338c
Nov 15 02:50:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b6e0fa9-0637-4270-9868-ba23cbc9b034 tempest-TestServerVolumeAttachScenarioOldVersion-979449537 tempest-TestServerVolumeAttachScenarioOldVersion-979449537-project-member] Lock "2b144078-2d2e-460c-b432-96d6309e338c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.858s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:04 user nova-compute[75391]: DEBUG nova.compute.manager [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:50:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:50:04 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Instance spawned successfully.
Nov 15 02:50:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:50:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:50:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:50:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:50:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:50:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:50:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:50:04 user nova-compute[75391]: INFO nova.compute.manager [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Took 5.98 seconds to spawn the instance on the hypervisor.
Nov 15 02:50:04 user nova-compute[75391]: DEBUG nova.compute.manager [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:50:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-1eb185f2-6ceb-45be-b37a-9ce42915e1e8 req-632887f5-bcdb-4cee-a379-3c36cc20bc43 service nova] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Received event network-vif-plugged-7b9c6c03-700b-4dbe-944f-181f69045879 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:50:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1eb185f2-6ceb-45be-b37a-9ce42915e1e8 req-632887f5-bcdb-4cee-a379-3c36cc20bc43 service nova] Acquiring lock "fdcb81ad-9c87-408d-abed-9b7cd2a7a646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1eb185f2-6ceb-45be-b37a-9ce42915e1e8 req-632887f5-bcdb-4cee-a379-3c36cc20bc43 service nova] Lock "fdcb81ad-9c87-408d-abed-9b7cd2a7a646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1eb185f2-6ceb-45be-b37a-9ce42915e1e8 req-632887f5-bcdb-4cee-a379-3c36cc20bc43 service nova] Lock "fdcb81ad-9c87-408d-abed-9b7cd2a7a646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-1eb185f2-6ceb-45be-b37a-9ce42915e1e8 req-632887f5-bcdb-4cee-a379-3c36cc20bc43 service nova] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] No waiting events found dispatching network-vif-plugged-7b9c6c03-700b-4dbe-944f-181f69045879 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:50:04 user nova-compute[75391]: WARNING nova.compute.manager [req-1eb185f2-6ceb-45be-b37a-9ce42915e1e8 req-632887f5-bcdb-4cee-a379-3c36cc20bc43 service nova] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Received unexpected event network-vif-plugged-7b9c6c03-700b-4dbe-944f-181f69045879 for instance with vm_state building and task_state spawning.
Nov 15 02:50:04 user nova-compute[75391]: INFO nova.compute.manager [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Took 6.85 seconds to build instance.
Nov 15 02:50:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-09a4a5d8-d81e-4cd0-bc43-71126dcb23b0 tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "fdcb81ad-9c87-408d-abed-9b7cd2a7a646" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.981s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "054d3064-549d-442e-85ea-4c7bfde518cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "054d3064-549d-442e-85ea-4c7bfde518cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:08 user nova-compute[75391]: INFO nova.compute.manager [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Detaching volume b64b2bd5-408d-409f-91d1-53b9f79ca6fd
Nov 15 02:50:08 user nova-compute[75391]: INFO nova.virt.block_device [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Attempting to driver detach volume b64b2bd5-408d-409f-91d1-53b9f79ca6fd from mountpoint /dev/vdb
Nov 15 02:50:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Attempting to detach device vdb from instance 054d3064-549d-442e-85ea-4c7bfde518cb from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:50:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:50:08 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:50:08 user nova-compute[75391]:   <source dev="/dev/sdc"/>
Nov 15 02:50:08 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:50:08 user nova-compute[75391]:   <serial>b64b2bd5-408d-409f-91d1-53b9f79ca6fd</serial>
Nov 15 02:50:08 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:50:08 user nova-compute[75391]: </disk>
Nov 15 02:50:08 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:50:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "054d3064-549d-442e-85ea-4c7bfde518cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:08 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Successfully detached device vdb from instance 054d3064-549d-442e-85ea-4c7bfde518cb from the persistent domain config.
Nov 15 02:50:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 054d3064-549d-442e-85ea-4c7bfde518cb from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 02:50:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:50:08 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:50:08 user nova-compute[75391]:   <source dev="/dev/sdc"/>
Nov 15 02:50:08 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:50:08 user nova-compute[75391]:   <serial>b64b2bd5-408d-409f-91d1-53b9f79ca6fd</serial>
Nov 15 02:50:08 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:50:08 user nova-compute[75391]: </disk>
Nov 15 02:50:08 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:50:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 054d3064-549d-442e-85ea-4c7bfde518cb {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 02:50:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:17 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:21 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "d36e2f64-11cb-4b35-8471-9a4df7f4c227" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "d36e2f64-11cb-4b35-8471-9a4df7f4c227" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:21 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:50:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:21 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:50:21 user nova-compute[75391]: INFO nova.compute.claims [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Claim successful on node user
Nov 15 02:50:22 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:22 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:50:22 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:50:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:22 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:50:22 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:50:22 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:50:22 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:50:22 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:50:22 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:50:22 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:50:22 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Creating image(s)
Nov 15 02:50:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "/opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "/opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "/opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:22 user nova-compute[75391]: DEBUG nova.policy [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0aa106a59c374dde99b7697f94407339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63a88a9fe824c3e9c0807a50b569d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:50:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.176s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.171s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk 1073741824" returned: 0 in 0.062s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.192s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:23 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:50:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:23 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Cannot resize image /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:50:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:50:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Ensure instance console log exists: /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:50:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:23 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Successfully created port: 0a8cd0f0-6967-4cec-a752-5699a32298b1 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:50:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Successfully updated port: 0a8cd0f0-6967-4cec-a752-5699a32298b1 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "refresh_cache-d36e2f64-11cb-4b35-8471-9a4df7f4c227" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquired lock "refresh_cache-d36e2f64-11cb-4b35-8471-9a4df7f4c227" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.compute.manager [req-b50fa376-6955-4513-a7d1-5a98ab40b526 req-c2eed1ff-32dd-4205-b7ee-254d81181d02 service nova] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Received event network-changed-0a8cd0f0-6967-4cec-a752-5699a32298b1 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.compute.manager [req-b50fa376-6955-4513-a7d1-5a98ab40b526 req-c2eed1ff-32dd-4205-b7ee-254d81181d02 service nova] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Refreshing instance network info cache due to event network-changed-0a8cd0f0-6967-4cec-a752-5699a32298b1. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b50fa376-6955-4513-a7d1-5a98ab40b526 req-c2eed1ff-32dd-4205-b7ee-254d81181d02 service nova] Acquiring lock "refresh_cache-d36e2f64-11cb-4b35-8471-9a4df7f4c227" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Updating instance_info_cache with network_info: [{"id": "0a8cd0f0-6967-4cec-a752-5699a32298b1", "address": "fa:16:3e:6d:7a:4e", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a8cd0f0-69", "ovs_interfaceid": "0a8cd0f0-6967-4cec-a752-5699a32298b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Releasing lock "refresh_cache-d36e2f64-11cb-4b35-8471-9a4df7f4c227" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Instance network_info: |[{"id": "0a8cd0f0-6967-4cec-a752-5699a32298b1", "address": "fa:16:3e:6d:7a:4e", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a8cd0f0-69", "ovs_interfaceid": "0a8cd0f0-6967-4cec-a752-5699a32298b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b50fa376-6955-4513-a7d1-5a98ab40b526 req-c2eed1ff-32dd-4205-b7ee-254d81181d02 service nova] Acquired lock "refresh_cache-d36e2f64-11cb-4b35-8471-9a4df7f4c227" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.network.neutron [req-b50fa376-6955-4513-a7d1-5a98ab40b526 req-c2eed1ff-32dd-4205-b7ee-254d81181d02 service nova] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Refreshing network info cache for port 0a8cd0f0-6967-4cec-a752-5699a32298b1 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Start _get_guest_xml network_info=[{"id": "0a8cd0f0-6967-4cec-a752-5699a32298b1", "address": "fa:16:3e:6d:7a:4e", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a8cd0f0-69", "ovs_interfaceid": "0a8cd0f0-6967-4cec-a752-5699a32298b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:50:25 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:50:25 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1234907394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1234907394',id=25,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e63a88a9fe824c3e9c0807a50b569d54',ramdisk_id='',reservation_id='r-grnkznr9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-141063167',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:50:23Z,user_data=None,user_id='0aa106a59c374dde99b7697f94407339',uuid=d36e2f64-11cb-4b35-8471-9a4df7f4c227,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a8cd0f0-6967-4cec-a752-5699a32298b1", "address": "fa:16:3e:6d:7a:4e", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a8cd0f0-69", "ovs_interfaceid": "0a8cd0f0-6967-4cec-a752-5699a32298b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Converting VIF {"id": "0a8cd0f0-6967-4cec-a752-5699a32298b1", "address": "fa:16:3e:6d:7a:4e", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a8cd0f0-69", "ovs_interfaceid": "0a8cd0f0-6967-4cec-a752-5699a32298b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:7a:4e,bridge_name='br-int',has_traffic_filtering=True,id=0a8cd0f0-6967-4cec-a752-5699a32298b1,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a8cd0f0-69') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.objects.instance [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lazy-loading 'pci_devices' on Instance uuid d36e2f64-11cb-4b35-8471-9a4df7f4c227 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:50:25 user nova-compute[75391]:   <uuid>d36e2f64-11cb-4b35-8471-9a4df7f4c227</uuid>
Nov 15 02:50:25 user nova-compute[75391]:   <name>instance-00000019</name>
Nov 15 02:50:25 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:50:25 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:50:25 user nova-compute[75391]:   <metadata>
Nov 15 02:50:25 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:50:25 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:50:25 user nova-compute[75391]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1234907394</nova:name>
Nov 15 02:50:25 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:50:25</nova:creationTime>
Nov 15 02:50:25 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:50:25 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:50:25 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:50:25 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:50:25 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:50:25 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:50:25 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:50:25 user nova-compute[75391]:       <nova:owner>
Nov 15 02:50:25 user nova-compute[75391]:         <nova:user uuid="0aa106a59c374dde99b7697f94407339">tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member</nova:user>
Nov 15 02:50:25 user nova-compute[75391]:         <nova:project uuid="e63a88a9fe824c3e9c0807a50b569d54">tempest-ServerBootFromVolumeStableRescueTest-141063167</nova:project>
Nov 15 02:50:25 user nova-compute[75391]:       </nova:owner>
Nov 15 02:50:25 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:50:25 user nova-compute[75391]:       <nova:ports>
Nov 15 02:50:25 user nova-compute[75391]:         <nova:port uuid="0a8cd0f0-6967-4cec-a752-5699a32298b1">
Nov 15 02:50:25 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 02:50:25 user nova-compute[75391]:         </nova:port>
Nov 15 02:50:25 user nova-compute[75391]:       </nova:ports>
Nov 15 02:50:25 user nova-compute[75391]:     </nova:instance>
Nov 15 02:50:25 user nova-compute[75391]:   </metadata>
Nov 15 02:50:25 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:50:25 user nova-compute[75391]:     <system>
Nov 15 02:50:25 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:50:25 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:50:25 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:50:25 user nova-compute[75391]:       <entry name="serial">d36e2f64-11cb-4b35-8471-9a4df7f4c227</entry>
Nov 15 02:50:25 user nova-compute[75391]:       <entry name="uuid">d36e2f64-11cb-4b35-8471-9a4df7f4c227</entry>
Nov 15 02:50:25 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:50:25 user nova-compute[75391]:     </system>
Nov 15 02:50:25 user nova-compute[75391]:   </sysinfo>
Nov 15 02:50:25 user nova-compute[75391]:   <os>
Nov 15 02:50:25 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:50:25 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:50:25 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:50:25 user nova-compute[75391]:   </os>
Nov 15 02:50:25 user nova-compute[75391]:   <features>
Nov 15 02:50:25 user nova-compute[75391]:     <acpi/>
Nov 15 02:50:25 user nova-compute[75391]:     <apic/>
Nov 15 02:50:25 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:50:25 user nova-compute[75391]:   </features>
Nov 15 02:50:25 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:50:25 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:50:25 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:50:25 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:50:25 user nova-compute[75391]:   </clock>
Nov 15 02:50:25 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:50:25 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:50:25 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:50:25 user nova-compute[75391]:   </cpu>
Nov 15 02:50:25 user nova-compute[75391]:   <devices>
Nov 15 02:50:25 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:50:25 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:50:25 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk"/>
Nov 15 02:50:25 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:50:25 user nova-compute[75391]:     </disk>
Nov 15 02:50:25 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:50:25 user nova-compute[75391]:       <mac address="fa:16:3e:6d:7a:4e"/>
Nov 15 02:50:25 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:50:25 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:50:25 user nova-compute[75391]:       <target dev="tap0a8cd0f0-69"/>
Nov 15 02:50:25 user nova-compute[75391]:     </interface>
Nov 15 02:50:25 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:50:25 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/console.log" append="off"/>
Nov 15 02:50:25 user nova-compute[75391]:     </serial>
Nov 15 02:50:25 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:50:25 user nova-compute[75391]:     <video>
Nov 15 02:50:25 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:50:25 user nova-compute[75391]:     </video>
Nov 15 02:50:25 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:50:25 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:50:25 user nova-compute[75391]:     </rng>
Nov 15 02:50:25 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:50:25 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:50:25 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:50:25 user nova-compute[75391]:     </memballoon>
Nov 15 02:50:25 user nova-compute[75391]:   </devices>
Nov 15 02:50:25 user nova-compute[75391]: </domain>
Nov 15 02:50:25 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1234907394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1234907394',id=25,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e63a88a9fe824c3e9c0807a50b569d54',ramdisk_id='',reservation_id='r-grnkznr9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-141063167',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:50:23Z,user_data=None,user_id='0aa106a59c374dde99b7697f94407339',uuid=d36e2f64-11cb-4b35-8471-9a4df7f4c227,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a8cd0f0-6967-4cec-a752-5699a32298b1", "address": "fa:16:3e:6d:7a:4e", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a8cd0f0-69", "ovs_interfaceid": "0a8cd0f0-6967-4cec-a752-5699a32298b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Converting VIF {"id": "0a8cd0f0-6967-4cec-a752-5699a32298b1", "address": "fa:16:3e:6d:7a:4e", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a8cd0f0-69", "ovs_interfaceid": "0a8cd0f0-6967-4cec-a752-5699a32298b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:7a:4e,bridge_name='br-int',has_traffic_filtering=True,id=0a8cd0f0-6967-4cec-a752-5699a32298b1,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a8cd0f0-69') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG os_vif [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:7a:4e,bridge_name='br-int',has_traffic_filtering=True,id=0a8cd0f0-6967-4cec-a752-5699a32298b1,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a8cd0f0-69') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43a854c4-cd53-58f0-bf81-149bad356287', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a8cd0f0-69, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a8cd0f0-69, col_values=(('qos', UUID('774123e9-ee7a-476d-8c27-5e5f77d57786')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a8cd0f0-69, col_values=(('external_ids', {'iface-id': '0a8cd0f0-6967-4cec-a752-5699a32298b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:7a:4e', 'vm-uuid': 'd36e2f64-11cb-4b35-8471-9a4df7f4c227'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:25 user nova-compute[75391]: INFO os_vif [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:7a:4e,bridge_name='br-int',has_traffic_filtering=True,id=0a8cd0f0-6967-4cec-a752-5699a32298b1,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a8cd0f0-69')
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:50:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] No VIF found with MAC fa:16:3e:6d:7a:4e, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:50:26 user nova-compute[75391]: DEBUG nova.network.neutron [req-b50fa376-6955-4513-a7d1-5a98ab40b526 req-c2eed1ff-32dd-4205-b7ee-254d81181d02 service nova] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Updated VIF entry in instance network info cache for port 0a8cd0f0-6967-4cec-a752-5699a32298b1. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:50:26 user nova-compute[75391]: DEBUG nova.network.neutron [req-b50fa376-6955-4513-a7d1-5a98ab40b526 req-c2eed1ff-32dd-4205-b7ee-254d81181d02 service nova] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Updating instance_info_cache with network_info: [{"id": "0a8cd0f0-6967-4cec-a752-5699a32298b1", "address": "fa:16:3e:6d:7a:4e", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a8cd0f0-69", "ovs_interfaceid": "0a8cd0f0-6967-4cec-a752-5699a32298b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:50:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b50fa376-6955-4513-a7d1-5a98ab40b526 req-c2eed1ff-32dd-4205-b7ee-254d81181d02 service nova] Releasing lock "refresh_cache-d36e2f64-11cb-4b35-8471-9a4df7f4c227" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:50:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "9909ae6b-7900-4f71-8900-2bf25185e436" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "9909ae6b-7900-4f71-8900-2bf25185e436" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:26 user nova-compute[75391]: DEBUG nova.compute.manager [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:50:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:26 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:50:26 user nova-compute[75391]: INFO nova.compute.claims [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Claim successful on node user
Nov 15 02:50:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG nova.compute.manager [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG nova.compute.manager [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:50:27 user nova-compute[75391]: INFO nova.compute.claims [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Claim successful on node user
Nov 15 02:50:27 user nova-compute[75391]: DEBUG nova.compute.manager [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG nova.network.neutron [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:50:27 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:50:27 user nova-compute[75391]: DEBUG nova.compute.manager [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG nova.policy [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b3fc7a83f6c4c5baa7621163e9f62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfe79a4e16f4fa89437bcc50fc4b356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-19d5496d-e837-488a-aba0-248b80e1fc3f req-de0446c4-3f70-4156-906a-a4433f541647 service nova] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Received event network-vif-plugged-0a8cd0f0-6967-4cec-a752-5699a32298b1 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-19d5496d-e837-488a-aba0-248b80e1fc3f req-de0446c4-3f70-4156-906a-a4433f541647 service nova] Acquiring lock "d36e2f64-11cb-4b35-8471-9a4df7f4c227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-19d5496d-e837-488a-aba0-248b80e1fc3f req-de0446c4-3f70-4156-906a-a4433f541647 service nova] Lock "d36e2f64-11cb-4b35-8471-9a4df7f4c227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-19d5496d-e837-488a-aba0-248b80e1fc3f req-de0446c4-3f70-4156-906a-a4433f541647 service nova] Lock "d36e2f64-11cb-4b35-8471-9a4df7f4c227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-19d5496d-e837-488a-aba0-248b80e1fc3f req-de0446c4-3f70-4156-906a-a4433f541647 service nova] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] No waiting events found dispatching network-vif-plugged-0a8cd0f0-6967-4cec-a752-5699a32298b1 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:50:27 user nova-compute[75391]: WARNING nova.compute.manager [req-19d5496d-e837-488a-aba0-248b80e1fc3f req-de0446c4-3f70-4156-906a-a4433f541647 service nova] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Received unexpected event network-vif-plugged-0a8cd0f0-6967-4cec-a752-5699a32298b1 for instance with vm_state building and task_state spawning.
Nov 15 02:50:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG nova.compute.manager [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:50:27 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Creating image(s)
Nov 15 02:50:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "/opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "/opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "/opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.204s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.177s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk 1073741824" returned: 0 in 0.068s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG nova.network.neutron [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Successfully created port: 45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.758s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:27 user nova-compute[75391]: DEBUG nova.compute.manager [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG nova.compute.manager [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG nova.network.neutron [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.192s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:28 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:50:28 user nova-compute[75391]: DEBUG nova.compute.manager [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG nova.policy [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b3fc7a83f6c4c5baa7621163e9f62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfe79a4e16f4fa89437bcc50fc4b356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Cannot resize image /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Ensure instance console log exists: /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG nova.compute.manager [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:50:28 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Creating image(s)
Nov 15 02:50:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "/opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "/opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "/opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.181s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.178s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk 1073741824" returned: 0 in 0.049s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG nova.network.neutron [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Successfully updated port: 45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "refresh_cache-9909ae6b-7900-4f71-8900-2bf25185e436" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquired lock "refresh_cache-9909ae6b-7900-4f71-8900-2bf25185e436" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG nova.network.neutron [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.210s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:50:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:29 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 054d3064-549d-442e-85ea-4c7bfde518cb is timed out.
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.compute.manager [req-fb6e42b6-7523-4505-9042-46a75d7a8b98 req-e8b1d8ce-d435-4a08-8d17-063dde856416 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Received event network-changed-45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.compute.manager [req-fb6e42b6-7523-4505-9042-46a75d7a8b98 req-e8b1d8ce-d435-4a08-8d17-063dde856416 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Refreshing instance network info cache due to event network-changed-45919066-22c9-4df6-b411-e07851e743b6. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-fb6e42b6-7523-4505-9042-46a75d7a8b98 req-e8b1d8ce-d435-4a08-8d17-063dde856416 service nova] Acquiring lock "refresh_cache-9909ae6b-7900-4f71-8900-2bf25185e436" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:50:29 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Successfully detached device vdb from instance 054d3064-549d-442e-85ea-4c7bfde518cb from the live domain config.
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.network.neutron [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Successfully created port: 5ef68714-0fbe-470d-b208-7d482f023640 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'keuziEXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:50:29 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:50:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[769764e6-b0b4-47e2-ac7a-53f16ff7ab0e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:50:29 user nova-compute[75391]: No targets found.
Nov 15 02:50:29 user nova-compute[75391]: iSNS:
Nov 15 02:50:29 user nova-compute[75391]: No targets found.
Nov 15 02:50:29 user nova-compute[75391]: STATIC:
Nov 15 02:50:29 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd
Nov 15 02:50:29 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:50:29 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:50:29 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8
Nov 15 02:50:29 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:50:29 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:50:29 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a
Nov 15 02:50:29 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:50:29 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:50:29 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:50:29 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:50:29 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:50:29 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea
Nov 15 02:50:29 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:50:29 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:50:29 user nova-compute[75391]: FIRMWARE:
Nov 15 02:50:29 user nova-compute[75391]: No targets found.
Nov 15 02:50:29 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:50:29 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:50:29 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.network.neutron [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1420e7a8-335d-42a5-87ea-f41fb85a5652]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dfb71a-b15d-4cc8-822b-0f5d908fa44b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:50:29 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:50:29 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:50:29 user nova-compute[75391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:50:29 user nova-compute[75391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd (non-flash)
Nov 15 02:50:29 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:50:29 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:50:29 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:50:29 user nova-compute[75391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:50:29 user nova-compute[75391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd (non-flash)
Nov 15 02:50:29 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6247bee7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd'): ({'sdc'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Removing single pathed devices sdc {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Cannot resize image /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Ensure instance console log exists: /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee34cb8e-fe2f-49c0-9e8c-d2b4ef0594d5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6015802-17bb-4356-afe5-41452a98b4ce]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Flushing IO for device /dev/sdc {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6566b7de-12fa-4b93-8635-e87322b92e1b]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3faf07-f805-4456-ba90-f795ac85e8e4]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] SCSI volumes sdc have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1f5595-e2fe-454d-8d2a-b7138768d86c]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd929fd-207a-4aaa-ac2a-cc0281afc810]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd, portal: 172.16.0.220,3260]
Nov 15 02:50:29 user nova-compute[75391]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd, portal: 172.16.0.220,3260] successful.
Nov 15 02:50:29 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[104c3a62-0b97-453e-ba17-1d825e6cb8dc]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] <== disconnect_volume: return (330ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.compute.manager [req-14474b9f-3bce-4441-8e2e-de8fff43146f req-7adcdf0f-abe4-48e4-b6a5-83e94c2a4263 service nova] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Received event network-vif-plugged-0a8cd0f0-6967-4cec-a752-5699a32298b1 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-14474b9f-3bce-4441-8e2e-de8fff43146f req-7adcdf0f-abe4-48e4-b6a5-83e94c2a4263 service nova] Acquiring lock "d36e2f64-11cb-4b35-8471-9a4df7f4c227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-14474b9f-3bce-4441-8e2e-de8fff43146f req-7adcdf0f-abe4-48e4-b6a5-83e94c2a4263 service nova] Lock "d36e2f64-11cb-4b35-8471-9a4df7f4c227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-14474b9f-3bce-4441-8e2e-de8fff43146f req-7adcdf0f-abe4-48e4-b6a5-83e94c2a4263 service nova] Lock "d36e2f64-11cb-4b35-8471-9a4df7f4c227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.compute.manager [req-14474b9f-3bce-4441-8e2e-de8fff43146f req-7adcdf0f-abe4-48e4-b6a5-83e94c2a4263 service nova] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] No waiting events found dispatching network-vif-plugged-0a8cd0f0-6967-4cec-a752-5699a32298b1 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:50:29 user nova-compute[75391]: WARNING nova.compute.manager [req-14474b9f-3bce-4441-8e2e-de8fff43146f req-7adcdf0f-abe4-48e4-b6a5-83e94c2a4263 service nova] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Received unexpected event network-vif-plugged-0a8cd0f0-6967-4cec-a752-5699a32298b1 for instance with vm_state building and task_state spawning.
Nov 15 02:50:29 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Instance spawned successfully.
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.network.neutron [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Updating instance_info_cache with network_info: [{"id": "45919066-22c9-4df6-b411-e07851e743b6", "address": "fa:16:3e:86:62:a8", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45919066-22", "ovs_interfaceid": "45919066-22c9-4df6-b411-e07851e743b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Releasing lock "refresh_cache-9909ae6b-7900-4f71-8900-2bf25185e436" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.compute.manager [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Instance network_info: |[{"id": "45919066-22c9-4df6-b411-e07851e743b6", "address": "fa:16:3e:86:62:a8", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45919066-22", "ovs_interfaceid": "45919066-22c9-4df6-b411-e07851e743b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-fb6e42b6-7523-4505-9042-46a75d7a8b98 req-e8b1d8ce-d435-4a08-8d17-063dde856416 service nova] Acquired lock "refresh_cache-9909ae6b-7900-4f71-8900-2bf25185e436" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.network.neutron [req-fb6e42b6-7523-4505-9042-46a75d7a8b98 req-e8b1d8ce-d435-4a08-8d17-063dde856416 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Refreshing network info cache for port 45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Start _get_guest_xml network_info=[{"id": "45919066-22c9-4df6-b411-e07851e743b6", "address": "fa:16:3e:86:62:a8", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45919066-22", "ovs_interfaceid": "45919066-22c9-4df6-b411-e07851e743b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:50:29 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:50:29 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:50:29 user nova-compute[75391]: INFO nova.compute.manager [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Took 6.94 seconds to spawn the instance on the hypervisor.
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2116588976',display_name='tempest-ServerRescueNegativeTestJSON-server-2116588976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2116588976',id=26,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bfe79a4e16f4fa89437bcc50fc4b356',ramdisk_id='',reservation_id='r-68s69sl3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-388649299',owner_user_name='tempest-ServerRescueNegativeTestJSON-388649299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:50:27Z,user_data=None,user_id='9b3fc7a83f6c4c5baa7621163e9f62aa',uuid=9909ae6b-7900-4f71-8900-2bf25185e436,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45919066-22c9-4df6-b411-e07851e743b6", "address": "fa:16:3e:86:62:a8", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45919066-22", "ovs_interfaceid": "45919066-22c9-4df6-b411-e07851e743b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Converting VIF {"id": "45919066-22c9-4df6-b411-e07851e743b6", "address": "fa:16:3e:86:62:a8", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45919066-22", "ovs_interfaceid": "45919066-22c9-4df6-b411-e07851e743b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:62:a8,bridge_name='br-int',has_traffic_filtering=True,id=45919066-22c9-4df6-b411-e07851e743b6,network=Network(079437cd-2e7d-40ea-98c0-24a1c9091aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45919066-22') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.objects.instance [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'pci_devices' on Instance uuid 9909ae6b-7900-4f71-8900-2bf25185e436 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:50:29 user nova-compute[75391]:   <uuid>9909ae6b-7900-4f71-8900-2bf25185e436</uuid>
Nov 15 02:50:29 user nova-compute[75391]:   <name>instance-0000001a</name>
Nov 15 02:50:29 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:50:29 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:50:29 user nova-compute[75391]:   <metadata>
Nov 15 02:50:29 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:50:29 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:50:29 user nova-compute[75391]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2116588976</nova:name>
Nov 15 02:50:29 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:50:29</nova:creationTime>
Nov 15 02:50:29 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:50:29 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:50:29 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:50:29 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:50:29 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:50:29 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:50:29 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:50:29 user nova-compute[75391]:       <nova:owner>
Nov 15 02:50:29 user nova-compute[75391]:         <nova:user uuid="9b3fc7a83f6c4c5baa7621163e9f62aa">tempest-ServerRescueNegativeTestJSON-388649299-project-member</nova:user>
Nov 15 02:50:29 user nova-compute[75391]:         <nova:project uuid="8bfe79a4e16f4fa89437bcc50fc4b356">tempest-ServerRescueNegativeTestJSON-388649299</nova:project>
Nov 15 02:50:29 user nova-compute[75391]:       </nova:owner>
Nov 15 02:50:29 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:50:29 user nova-compute[75391]:       <nova:ports>
Nov 15 02:50:29 user nova-compute[75391]:         <nova:port uuid="45919066-22c9-4df6-b411-e07851e743b6">
Nov 15 02:50:29 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 02:50:29 user nova-compute[75391]:         </nova:port>
Nov 15 02:50:29 user nova-compute[75391]:       </nova:ports>
Nov 15 02:50:29 user nova-compute[75391]:     </nova:instance>
Nov 15 02:50:29 user nova-compute[75391]:   </metadata>
Nov 15 02:50:29 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:50:29 user nova-compute[75391]:     <system>
Nov 15 02:50:29 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:50:29 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:50:29 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:50:29 user nova-compute[75391]:       <entry name="serial">9909ae6b-7900-4f71-8900-2bf25185e436</entry>
Nov 15 02:50:29 user nova-compute[75391]:       <entry name="uuid">9909ae6b-7900-4f71-8900-2bf25185e436</entry>
Nov 15 02:50:29 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:50:29 user nova-compute[75391]:     </system>
Nov 15 02:50:29 user nova-compute[75391]:   </sysinfo>
Nov 15 02:50:29 user nova-compute[75391]:   <os>
Nov 15 02:50:29 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:50:29 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:50:29 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:50:29 user nova-compute[75391]:   </os>
Nov 15 02:50:29 user nova-compute[75391]:   <features>
Nov 15 02:50:29 user nova-compute[75391]:     <acpi/>
Nov 15 02:50:29 user nova-compute[75391]:     <apic/>
Nov 15 02:50:29 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:50:29 user nova-compute[75391]:   </features>
Nov 15 02:50:29 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:50:29 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:50:29 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:50:29 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:50:29 user nova-compute[75391]:   </clock>
Nov 15 02:50:29 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:50:29 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:50:29 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:50:29 user nova-compute[75391]:   </cpu>
Nov 15 02:50:29 user nova-compute[75391]:   <devices>
Nov 15 02:50:29 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:50:29 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:50:29 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk"/>
Nov 15 02:50:29 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:50:29 user nova-compute[75391]:     </disk>
Nov 15 02:50:29 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:50:29 user nova-compute[75391]:       <mac address="fa:16:3e:86:62:a8"/>
Nov 15 02:50:29 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:50:29 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:50:29 user nova-compute[75391]:       <target dev="tap45919066-22"/>
Nov 15 02:50:29 user nova-compute[75391]:     </interface>
Nov 15 02:50:29 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:50:29 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/console.log" append="off"/>
Nov 15 02:50:29 user nova-compute[75391]:     </serial>
Nov 15 02:50:29 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:50:29 user nova-compute[75391]:     <video>
Nov 15 02:50:29 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:50:29 user nova-compute[75391]:     </video>
Nov 15 02:50:29 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:50:29 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:50:29 user nova-compute[75391]:     </rng>
Nov 15 02:50:29 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:50:29 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:50:29 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:50:29 user nova-compute[75391]:     </memballoon>
Nov 15 02:50:29 user nova-compute[75391]:   </devices>
Nov 15 02:50:29 user nova-compute[75391]: </domain>
Nov 15 02:50:29 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2116588976',display_name='tempest-ServerRescueNegativeTestJSON-server-2116588976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2116588976',id=26,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bfe79a4e16f4fa89437bcc50fc4b356',ramdisk_id='',reservation_id='r-68s69sl3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-388649299',owner_user_name='tempest-ServerRescueNegativeTestJSON-388649299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:50:27Z,user_data=None,user_id='9b3fc7a83f6c4c5baa7621163e9f62aa',uuid=9909ae6b-7900-4f71-8900-2bf25185e436,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45919066-22c9-4df6-b411-e07851e743b6", "address": "fa:16:3e:86:62:a8", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45919066-22", "ovs_interfaceid": "45919066-22c9-4df6-b411-e07851e743b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Converting VIF {"id": "45919066-22c9-4df6-b411-e07851e743b6", "address": "fa:16:3e:86:62:a8", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45919066-22", "ovs_interfaceid": "45919066-22c9-4df6-b411-e07851e743b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:62:a8,bridge_name='br-int',has_traffic_filtering=True,id=45919066-22c9-4df6-b411-e07851e743b6,network=Network(079437cd-2e7d-40ea-98c0-24a1c9091aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45919066-22') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG os_vif [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:62:a8,bridge_name='br-int',has_traffic_filtering=True,id=45919066-22c9-4df6-b411-e07851e743b6,network=Network(079437cd-2e7d-40ea-98c0-24a1c9091aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45919066-22') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25eab370-b12d-5975-97a5-696bcf9eef28', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45919066-22, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap45919066-22, col_values=(('qos', UUID('2b55a2e5-dd9f-4191-89fc-730efb292d29')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap45919066-22, col_values=(('external_ids', {'iface-id': '45919066-22c9-4df6-b411-e07851e743b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:62:a8', 'vm-uuid': '9909ae6b-7900-4f71-8900-2bf25185e436'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:29 user nova-compute[75391]: INFO os_vif [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:62:a8,bridge_name='br-int',has_traffic_filtering=True,id=45919066-22c9-4df6-b411-e07851e743b6,network=Network(079437cd-2e7d-40ea-98c0-24a1c9091aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45919066-22')
Nov 15 02:50:29 user nova-compute[75391]: INFO nova.compute.manager [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Took 7.79 seconds to build instance.
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] No VIF found with MAC fa:16:3e:86:62:a8, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:50:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f0b8a7c1-e5a2-4a98-89ab-d2b50c247745 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "d36e2f64-11cb-4b35-8471-9a4df7f4c227" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.880s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:30 user nova-compute[75391]: DEBUG nova.objects.instance [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lazy-loading 'flavor' on Instance uuid 054d3064-549d-442e-85ea-4c7bfde518cb {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:50:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-47ce89fe-8a26-40b8-a7a7-514b12000324 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "054d3064-549d-442e-85ea-4c7bfde518cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.896s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "054d3064-549d-442e-85ea-4c7bfde518cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.767s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "054d3064-549d-442e-85ea-4c7bfde518cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "054d3064-549d-442e-85ea-4c7bfde518cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "054d3064-549d-442e-85ea-4c7bfde518cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:30 user nova-compute[75391]: INFO nova.compute.manager [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Terminating instance
Nov 15 02:50:30 user nova-compute[75391]: DEBUG nova.compute.manager [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:50:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:30 user nova-compute[75391]: DEBUG nova.network.neutron [req-fb6e42b6-7523-4505-9042-46a75d7a8b98 req-e8b1d8ce-d435-4a08-8d17-063dde856416 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Updated VIF entry in instance network info cache for port 45919066-22c9-4df6-b411-e07851e743b6. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:50:30 user nova-compute[75391]: DEBUG nova.network.neutron [req-fb6e42b6-7523-4505-9042-46a75d7a8b98 req-e8b1d8ce-d435-4a08-8d17-063dde856416 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Updating instance_info_cache with network_info: [{"id": "45919066-22c9-4df6-b411-e07851e743b6", "address": "fa:16:3e:86:62:a8", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45919066-22", "ovs_interfaceid": "45919066-22c9-4df6-b411-e07851e743b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:50:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-fb6e42b6-7523-4505-9042-46a75d7a8b98 req-e8b1d8ce-d435-4a08-8d17-063dde856416 service nova] Releasing lock "refresh_cache-9909ae6b-7900-4f71-8900-2bf25185e436" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:50:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:30 user nova-compute[75391]: DEBUG nova.network.neutron [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Successfully updated port: 5ef68714-0fbe-470d-b208-7d482f023640 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:50:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "refresh_cache-7bd332f2-0f74-4a43-96a2-2322b6cbf982" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:50:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquired lock "refresh_cache-7bd332f2-0f74-4a43-96a2-2322b6cbf982" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:50:30 user nova-compute[75391]: DEBUG nova.network.neutron [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:50:30 user nova-compute[75391]: DEBUG nova.network.neutron [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:50:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:30 user nova-compute[75391]: INFO nova.compute.manager [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Terminating instance
Nov 15 02:50:30 user nova-compute[75391]: DEBUG nova.compute.manager [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:50:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.network.neutron [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Updating instance_info_cache with network_info: [{"id": "5ef68714-0fbe-470d-b208-7d482f023640", "address": "fa:16:3e:0f:8e:b7", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef68714-0f", "ovs_interfaceid": "5ef68714-0fbe-470d-b208-7d482f023640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.compute.manager [req-7408fc93-8370-496a-9bcc-d59fb0dc5d28 req-20a7f30c-1677-4f6b-b38a-28bd7c1ec84a service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Received event network-changed-5ef68714-0fbe-470d-b208-7d482f023640 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.compute.manager [req-7408fc93-8370-496a-9bcc-d59fb0dc5d28 req-20a7f30c-1677-4f6b-b38a-28bd7c1ec84a service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Refreshing instance network info cache due to event network-changed-5ef68714-0fbe-470d-b208-7d482f023640. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7408fc93-8370-496a-9bcc-d59fb0dc5d28 req-20a7f30c-1677-4f6b-b38a-28bd7c1ec84a service nova] Acquiring lock "refresh_cache-7bd332f2-0f74-4a43-96a2-2322b6cbf982" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Releasing lock "refresh_cache-7bd332f2-0f74-4a43-96a2-2322b6cbf982" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.compute.manager [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Instance network_info: |[{"id": "5ef68714-0fbe-470d-b208-7d482f023640", "address": "fa:16:3e:0f:8e:b7", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef68714-0f", "ovs_interfaceid": "5ef68714-0fbe-470d-b208-7d482f023640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7408fc93-8370-496a-9bcc-d59fb0dc5d28 req-20a7f30c-1677-4f6b-b38a-28bd7c1ec84a service nova] Acquired lock "refresh_cache-7bd332f2-0f74-4a43-96a2-2322b6cbf982" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.network.neutron [req-7408fc93-8370-496a-9bcc-d59fb0dc5d28 req-20a7f30c-1677-4f6b-b38a-28bd7c1ec84a service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Refreshing network info cache for port 5ef68714-0fbe-470d-b208-7d482f023640 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Start _get_guest_xml network_info=[{"id": "5ef68714-0fbe-470d-b208-7d482f023640", "address": "fa:16:3e:0f:8e:b7", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef68714-0f", "ovs_interfaceid": "5ef68714-0fbe-470d-b208-7d482f023640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:31 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:50:31 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-411570943',display_name='tempest-ServerRescueNegativeTestJSON-server-411570943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-411570943',id=27,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bfe79a4e16f4fa89437bcc50fc4b356',ramdisk_id='',reservation_id='r-9ge07iwt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-388649299',owner_user_name='tempest-ServerRescueNegativeTestJSON-388649299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:50:28Z,user_data=None,user_id='9b3fc7a83f6c4c5baa7621163e9f62aa',uuid=7bd332f2-0f74-4a43-96a2-2322b6cbf982,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ef68714-0fbe-470d-b208-7d482f023640", "address": "fa:16:3e:0f:8e:b7", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef68714-0f", "ovs_interfaceid": "5ef68714-0fbe-470d-b208-7d482f023640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Converting VIF {"id": "5ef68714-0fbe-470d-b208-7d482f023640", "address": "fa:16:3e:0f:8e:b7", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef68714-0f", "ovs_interfaceid": "5ef68714-0fbe-470d-b208-7d482f023640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:8e:b7,bridge_name='br-int',has_traffic_filtering=True,id=5ef68714-0fbe-470d-b208-7d482f023640,network=Network(079437cd-2e7d-40ea-98c0-24a1c9091aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef68714-0f') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.objects.instance [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'pci_devices' on Instance uuid 7bd332f2-0f74-4a43-96a2-2322b6cbf982 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:50:31 user nova-compute[75391]:   <uuid>7bd332f2-0f74-4a43-96a2-2322b6cbf982</uuid>
Nov 15 02:50:31 user nova-compute[75391]:   <name>instance-0000001b</name>
Nov 15 02:50:31 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:50:31 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:50:31 user nova-compute[75391]:   <metadata>
Nov 15 02:50:31 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:50:31 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:50:31 user nova-compute[75391]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-411570943</nova:name>
Nov 15 02:50:31 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:50:31</nova:creationTime>
Nov 15 02:50:31 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:50:31 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:50:31 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:50:31 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:50:31 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:50:31 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:50:31 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:50:31 user nova-compute[75391]:       <nova:owner>
Nov 15 02:50:31 user nova-compute[75391]:         <nova:user uuid="9b3fc7a83f6c4c5baa7621163e9f62aa">tempest-ServerRescueNegativeTestJSON-388649299-project-member</nova:user>
Nov 15 02:50:31 user nova-compute[75391]:         <nova:project uuid="8bfe79a4e16f4fa89437bcc50fc4b356">tempest-ServerRescueNegativeTestJSON-388649299</nova:project>
Nov 15 02:50:31 user nova-compute[75391]:       </nova:owner>
Nov 15 02:50:31 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:50:31 user nova-compute[75391]:       <nova:ports>
Nov 15 02:50:31 user nova-compute[75391]:         <nova:port uuid="5ef68714-0fbe-470d-b208-7d482f023640">
Nov 15 02:50:31 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 02:50:31 user nova-compute[75391]:         </nova:port>
Nov 15 02:50:31 user nova-compute[75391]:       </nova:ports>
Nov 15 02:50:31 user nova-compute[75391]:     </nova:instance>
Nov 15 02:50:31 user nova-compute[75391]:   </metadata>
Nov 15 02:50:31 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:50:31 user nova-compute[75391]:     <system>
Nov 15 02:50:31 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:50:31 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:50:31 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:50:31 user nova-compute[75391]:       <entry name="serial">7bd332f2-0f74-4a43-96a2-2322b6cbf982</entry>
Nov 15 02:50:31 user nova-compute[75391]:       <entry name="uuid">7bd332f2-0f74-4a43-96a2-2322b6cbf982</entry>
Nov 15 02:50:31 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:50:31 user nova-compute[75391]:     </system>
Nov 15 02:50:31 user nova-compute[75391]:   </sysinfo>
Nov 15 02:50:31 user nova-compute[75391]:   <os>
Nov 15 02:50:31 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:50:31 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:50:31 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:50:31 user nova-compute[75391]:   </os>
Nov 15 02:50:31 user nova-compute[75391]:   <features>
Nov 15 02:50:31 user nova-compute[75391]:     <acpi/>
Nov 15 02:50:31 user nova-compute[75391]:     <apic/>
Nov 15 02:50:31 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:50:31 user nova-compute[75391]:   </features>
Nov 15 02:50:31 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:50:31 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:50:31 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:50:31 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:50:31 user nova-compute[75391]:   </clock>
Nov 15 02:50:31 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:50:31 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:50:31 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:50:31 user nova-compute[75391]:   </cpu>
Nov 15 02:50:31 user nova-compute[75391]:   <devices>
Nov 15 02:50:31 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:50:31 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:50:31 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk"/>
Nov 15 02:50:31 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:50:31 user nova-compute[75391]:     </disk>
Nov 15 02:50:31 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:50:31 user nova-compute[75391]:       <mac address="fa:16:3e:0f:8e:b7"/>
Nov 15 02:50:31 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:50:31 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:50:31 user nova-compute[75391]:       <target dev="tap5ef68714-0f"/>
Nov 15 02:50:31 user nova-compute[75391]:     </interface>
Nov 15 02:50:31 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:50:31 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/console.log" append="off"/>
Nov 15 02:50:31 user nova-compute[75391]:     </serial>
Nov 15 02:50:31 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:50:31 user nova-compute[75391]:     <video>
Nov 15 02:50:31 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:50:31 user nova-compute[75391]:     </video>
Nov 15 02:50:31 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:50:31 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:50:31 user nova-compute[75391]:     </rng>
Nov 15 02:50:31 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:50:31 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:50:31 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:50:31 user nova-compute[75391]:     </memballoon>
Nov 15 02:50:31 user nova-compute[75391]:   </devices>
Nov 15 02:50:31 user nova-compute[75391]: </domain>
Nov 15 02:50:31 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-411570943',display_name='tempest-ServerRescueNegativeTestJSON-server-411570943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-411570943',id=27,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bfe79a4e16f4fa89437bcc50fc4b356',ramdisk_id='',reservation_id='r-9ge07iwt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-388649299',owner_user_name='tempest-ServerRescueNegativeTestJSON-388649299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:50:28Z,user_data=None,user_id='9b3fc7a83f6c4c5baa7621163e9f62aa',uuid=7bd332f2-0f74-4a43-96a2-2322b6cbf982,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ef68714-0fbe-470d-b208-7d482f023640", "address": "fa:16:3e:0f:8e:b7", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef68714-0f", "ovs_interfaceid": "5ef68714-0fbe-470d-b208-7d482f023640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Converting VIF {"id": "5ef68714-0fbe-470d-b208-7d482f023640", "address": "fa:16:3e:0f:8e:b7", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef68714-0f", "ovs_interfaceid": "5ef68714-0fbe-470d-b208-7d482f023640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:8e:b7,bridge_name='br-int',has_traffic_filtering=True,id=5ef68714-0fbe-470d-b208-7d482f023640,network=Network(079437cd-2e7d-40ea-98c0-24a1c9091aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef68714-0f') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG os_vif [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:8e:b7,bridge_name='br-int',has_traffic_filtering=True,id=5ef68714-0fbe-470d-b208-7d482f023640,network=Network(079437cd-2e7d-40ea-98c0-24a1c9091aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef68714-0f') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3bd5bb7e-8d00-5e2f-b03b-f29ef35ede0f', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ef68714-0f, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ef68714-0f, col_values=(('qos', UUID('cc56f703-5027-439d-a88e-06cf9054617e')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ef68714-0f, col_values=(('external_ids', {'iface-id': '5ef68714-0fbe-470d-b208-7d482f023640', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:8e:b7', 'vm-uuid': '7bd332f2-0f74-4a43-96a2-2322b6cbf982'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:31 user nova-compute[75391]: INFO os_vif [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:8e:b7,bridge_name='br-int',has_traffic_filtering=True,id=5ef68714-0fbe-470d-b208-7d482f023640,network=Network(079437cd-2e7d-40ea-98c0-24a1c9091aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef68714-0f')
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] No VIF found with MAC fa:16:3e:0f:8e:b7, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.compute.manager [req-31566091-b633-4fd9-ae14-ee3826662801 req-7270ef6a-a958-4886-be27-370d46d15b0c service nova] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Received event network-vif-unplugged-b4140c76-b437-46c4-b8f4-dfafb44d7431 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-31566091-b633-4fd9-ae14-ee3826662801 req-7270ef6a-a958-4886-be27-370d46d15b0c service nova] Acquiring lock "054d3064-549d-442e-85ea-4c7bfde518cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-31566091-b633-4fd9-ae14-ee3826662801 req-7270ef6a-a958-4886-be27-370d46d15b0c service nova] Lock "054d3064-549d-442e-85ea-4c7bfde518cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-31566091-b633-4fd9-ae14-ee3826662801 req-7270ef6a-a958-4886-be27-370d46d15b0c service nova] Lock "054d3064-549d-442e-85ea-4c7bfde518cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.compute.manager [req-31566091-b633-4fd9-ae14-ee3826662801 req-7270ef6a-a958-4886-be27-370d46d15b0c service nova] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] No waiting events found dispatching network-vif-unplugged-b4140c76-b437-46c4-b8f4-dfafb44d7431 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.compute.manager [req-31566091-b633-4fd9-ae14-ee3826662801 req-7270ef6a-a958-4886-be27-370d46d15b0c service nova] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Received event network-vif-unplugged-b4140c76-b437-46c4-b8f4-dfafb44d7431 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.compute.manager [req-31566091-b633-4fd9-ae14-ee3826662801 req-7270ef6a-a958-4886-be27-370d46d15b0c service nova] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Received event network-vif-plugged-b4140c76-b437-46c4-b8f4-dfafb44d7431 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-31566091-b633-4fd9-ae14-ee3826662801 req-7270ef6a-a958-4886-be27-370d46d15b0c service nova] Acquiring lock "054d3064-549d-442e-85ea-4c7bfde518cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-31566091-b633-4fd9-ae14-ee3826662801 req-7270ef6a-a958-4886-be27-370d46d15b0c service nova] Lock "054d3064-549d-442e-85ea-4c7bfde518cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-31566091-b633-4fd9-ae14-ee3826662801 req-7270ef6a-a958-4886-be27-370d46d15b0c service nova] Lock "054d3064-549d-442e-85ea-4c7bfde518cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.compute.manager [req-31566091-b633-4fd9-ae14-ee3826662801 req-7270ef6a-a958-4886-be27-370d46d15b0c service nova] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] No waiting events found dispatching network-vif-plugged-b4140c76-b437-46c4-b8f4-dfafb44d7431 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:50:31 user nova-compute[75391]: WARNING nova.compute.manager [req-31566091-b633-4fd9-ae14-ee3826662801 req-7270ef6a-a958-4886-be27-370d46d15b0c service nova] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Received unexpected event network-vif-plugged-b4140c76-b437-46c4-b8f4-dfafb44d7431 for instance with vm_state active and task_state deleting.
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.network.neutron [req-7408fc93-8370-496a-9bcc-d59fb0dc5d28 req-20a7f30c-1677-4f6b-b38a-28bd7c1ec84a service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Updated VIF entry in instance network info cache for port 5ef68714-0fbe-470d-b208-7d482f023640. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG nova.network.neutron [req-7408fc93-8370-496a-9bcc-d59fb0dc5d28 req-20a7f30c-1677-4f6b-b38a-28bd7c1ec84a service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Updating instance_info_cache with network_info: [{"id": "5ef68714-0fbe-470d-b208-7d482f023640", "address": "fa:16:3e:0f:8e:b7", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef68714-0f", "ovs_interfaceid": "5ef68714-0fbe-470d-b208-7d482f023640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7408fc93-8370-496a-9bcc-d59fb0dc5d28 req-20a7f30c-1677-4f6b-b38a-28bd7c1ec84a service nova] Releasing lock "refresh_cache-7bd332f2-0f74-4a43-96a2-2322b6cbf982" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:32 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Instance destroyed successfully.
Nov 15 02:50:32 user nova-compute[75391]: DEBUG nova.objects.instance [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lazy-loading 'resources' on Instance uuid 054d3064-549d-442e-85ea-4c7bfde518cb {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:47:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1698704570',display_name='tempest-VolumesSnapshotTestJSON-instance-1698704570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1698704570',id=21,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwgsG2kAX0YzxGKviRlSX9Du8AhDC3KYkFm4bxPVp18IP4rWRKvNzfm9Q1/uOMEvhPg3E0890taPOWtnUpr2+ZdF0RGy/rJJhxJpyFknH5tluoyZcMWc9bnEhSgUGR77w==',key_name='tempest-keypair-970550916',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:48:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c96a31c2c4cb4586857b6179adf48ec0',ramdisk_id='',reservation_id='r-lll0pqkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1270812690',owner_user_name='tempest-VolumesSnapshotTestJSON-1270812690-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:48:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a5832ec3e834e4c8e11d671f7891cdf',uuid=054d3064-549d-442e-85ea-4c7bfde518cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4140c76-b437-46c4-b8f4-dfafb44d7431", "address": "fa:16:3e:0c:35:87", "network": {"id": "07cd9e35-dfd4-4a08-ac37-52c7bfefa42e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1490748469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96a31c2c4cb4586857b6179adf48ec0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4140c76-b4", "ovs_interfaceid": "b4140c76-b437-46c4-b8f4-dfafb44d7431", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Converting VIF {"id": "b4140c76-b437-46c4-b8f4-dfafb44d7431", "address": "fa:16:3e:0c:35:87", "network": {"id": "07cd9e35-dfd4-4a08-ac37-52c7bfefa42e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1490748469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96a31c2c4cb4586857b6179adf48ec0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4140c76-b4", "ovs_interfaceid": "b4140c76-b437-46c4-b8f4-dfafb44d7431", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:35:87,bridge_name='br-int',has_traffic_filtering=True,id=b4140c76-b437-46c4-b8f4-dfafb44d7431,network=Network(07cd9e35-dfd4-4a08-ac37-52c7bfefa42e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4140c76-b4') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG os_vif [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:35:87,bridge_name='br-int',has_traffic_filtering=True,id=b4140c76-b437-46c4-b8f4-dfafb44d7431,network=Network(07cd9e35-dfd4-4a08-ac37-52c7bfefa42e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4140c76-b4') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4140c76-b4, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cd455c2b-d5d1-4b66-b668-93f89a0ca98a) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:32 user nova-compute[75391]: INFO os_vif [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:35:87,bridge_name='br-int',has_traffic_filtering=True,id=b4140c76-b437-46c4-b8f4-dfafb44d7431,network=Network(07cd9e35-dfd4-4a08-ac37-52c7bfefa42e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4140c76-b4')
Nov 15 02:50:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'keuziEXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:50:32 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:50:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e338d4ab-26b1-4f74-8f1e-930cd86153b0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:50:32 user nova-compute[75391]: No targets found.
Nov 15 02:50:32 user nova-compute[75391]: iSNS:
Nov 15 02:50:32 user nova-compute[75391]: No targets found.
Nov 15 02:50:32 user nova-compute[75391]: STATIC:
Nov 15 02:50:32 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8
Nov 15 02:50:32 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:50:32 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:50:32 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a
Nov 15 02:50:32 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:50:32 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:50:32 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:50:32 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:50:32 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:50:32 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea
Nov 15 02:50:32 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:50:32 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:50:32 user nova-compute[75391]: FIRMWARE:
Nov 15 02:50:32 user nova-compute[75391]: No targets found.
Nov 15 02:50:32 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:50:32 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:50:32 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b64b2bd5-408d-409f-91d1-53b9f79ca6fd', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52d03bf-6ca2-41b8-b5b5-9c4da661f22e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2913891-6477-469c-852a-65ea3cfb31ea]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:50:32 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:50:32 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:50:32 user nova-compute[75391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:50:32 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:50:32 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:50:32 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:50:32 user nova-compute[75391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:50:32 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f622460fc70>, {}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Disconnecting from: [] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] <== disconnect_volume: return (73ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:50:32 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Deleting instance files /opt/stack/data/nova/instances/054d3064-549d-442e-85ea-4c7bfde518cb_del
Nov 15 02:50:32 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Deletion of /opt/stack/data/nova/instances/054d3064-549d-442e-85ea-4c7bfde518cb_del complete
Nov 15 02:50:32 user nova-compute[75391]: INFO nova.compute.manager [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Took 2.71 seconds to destroy the instance on the hypervisor.
Nov 15 02:50:32 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:50:32 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:50:33 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Instance destroyed successfully.
Nov 15 02:50:33 user nova-compute[75391]: DEBUG nova.objects.instance [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lazy-loading 'resources' on Instance uuid ebb7e616-3c05-4d99-a0b3-76dc1723e82d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-55ca8563-4ec9-48ac-abcf-bc237b964585 req-78f4b91f-124b-4a3e-8679-07df172caf57 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Received event network-vif-unplugged-c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-55ca8563-4ec9-48ac-abcf-bc237b964585 req-78f4b91f-124b-4a3e-8679-07df172caf57 service nova] Acquiring lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-55ca8563-4ec9-48ac-abcf-bc237b964585 req-78f4b91f-124b-4a3e-8679-07df172caf57 service nova] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-55ca8563-4ec9-48ac-abcf-bc237b964585 req-78f4b91f-124b-4a3e-8679-07df172caf57 service nova] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-55ca8563-4ec9-48ac-abcf-bc237b964585 req-78f4b91f-124b-4a3e-8679-07df172caf57 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] No waiting events found dispatching network-vif-unplugged-c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-55ca8563-4ec9-48ac-abcf-bc237b964585 req-78f4b91f-124b-4a3e-8679-07df172caf57 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Received event network-vif-unplugged-c9643afc-4454-4d29-b8a2-5422753857b0 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-55ca8563-4ec9-48ac-abcf-bc237b964585 req-78f4b91f-124b-4a3e-8679-07df172caf57 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Received event network-vif-plugged-c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-55ca8563-4ec9-48ac-abcf-bc237b964585 req-78f4b91f-124b-4a3e-8679-07df172caf57 service nova] Acquiring lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-55ca8563-4ec9-48ac-abcf-bc237b964585 req-78f4b91f-124b-4a3e-8679-07df172caf57 service nova] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-55ca8563-4ec9-48ac-abcf-bc237b964585 req-78f4b91f-124b-4a3e-8679-07df172caf57 service nova] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-55ca8563-4ec9-48ac-abcf-bc237b964585 req-78f4b91f-124b-4a3e-8679-07df172caf57 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] No waiting events found dispatching network-vif-plugged-c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:50:33 user nova-compute[75391]: WARNING nova.compute.manager [req-55ca8563-4ec9-48ac-abcf-bc237b964585 req-78f4b91f-124b-4a3e-8679-07df172caf57 service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Received unexpected event network-vif-plugged-c9643afc-4454-4d29-b8a2-5422753857b0 for instance with vm_state active and task_state deleting.
Nov 15 02:50:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-55ca8563-4ec9-48ac-abcf-bc237b964585 req-78f4b91f-124b-4a3e-8679-07df172caf57 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Received event network-vif-plugged-45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-55ca8563-4ec9-48ac-abcf-bc237b964585 req-78f4b91f-124b-4a3e-8679-07df172caf57 service nova] Acquiring lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-55ca8563-4ec9-48ac-abcf-bc237b964585 req-78f4b91f-124b-4a3e-8679-07df172caf57 service nova] Lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-55ca8563-4ec9-48ac-abcf-bc237b964585 req-78f4b91f-124b-4a3e-8679-07df172caf57 service nova] Lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-55ca8563-4ec9-48ac-abcf-bc237b964585 req-78f4b91f-124b-4a3e-8679-07df172caf57 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] No waiting events found dispatching network-vif-plugged-45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:50:33 user nova-compute[75391]: WARNING nova.compute.manager [req-55ca8563-4ec9-48ac-abcf-bc237b964585 req-78f4b91f-124b-4a3e-8679-07df172caf57 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Received unexpected event network-vif-plugged-45919066-22c9-4df6-b411-e07851e743b6 for instance with vm_state building and task_state spawning.
Nov 15 02:50:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-55ca8563-4ec9-48ac-abcf-bc237b964585 req-78f4b91f-124b-4a3e-8679-07df172caf57 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Received event network-vif-plugged-45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-55ca8563-4ec9-48ac-abcf-bc237b964585 req-78f4b91f-124b-4a3e-8679-07df172caf57 service nova] Acquiring lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-55ca8563-4ec9-48ac-abcf-bc237b964585 req-78f4b91f-124b-4a3e-8679-07df172caf57 service nova] Lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-55ca8563-4ec9-48ac-abcf-bc237b964585 req-78f4b91f-124b-4a3e-8679-07df172caf57 service nova] Lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-55ca8563-4ec9-48ac-abcf-bc237b964585 req-78f4b91f-124b-4a3e-8679-07df172caf57 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] No waiting events found dispatching network-vif-plugged-45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:50:33 user nova-compute[75391]: WARNING nova.compute.manager [req-55ca8563-4ec9-48ac-abcf-bc237b964585 req-78f4b91f-124b-4a3e-8679-07df172caf57 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Received unexpected event network-vif-plugged-45919066-22c9-4df6-b411-e07851e743b6 for instance with vm_state building and task_state spawning.
Nov 15 02:50:33 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-689614808',display_name='tempest-ServerActionsTestOtherB-server-689614808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-689614808',id=2,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2usIoDVXl+b9hE3o9jGzEYasMoeupEZWjgdC34QhkyFhqHaktIVO5IuSwbU0DElzd5MkeVTBrP68npXS/361ypXFAC7mDzbXraFDprW+Txm/mxv6ZY7FykX6U+2H5j7A==',key_name='tempest-keypair-1921719925',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:47:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dfefdbf9f31b47d4a76d8fb06414eb5a',ramdisk_id='',reservation_id='r-qacecpst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-5763420',owner_user_name='tempest-ServerActionsTestOtherB-5763420-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:47:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34b23ed566024cc3a90f97206ea8162d',uuid=ebb7e616-3c05-4d99-a0b3-76dc1723e82d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Converting VIF {"id": "c9643afc-4454-4d29-b8a2-5422753857b0", "address": "fa:16:3e:79:35:a3", "network": {"id": "db549bf7-e039-4ea4-ac62-b5c090652e6c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1586176386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfefdbf9f31b47d4a76d8fb06414eb5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9643afc-44", "ovs_interfaceid": "c9643afc-4454-4d29-b8a2-5422753857b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:35:a3,bridge_name='br-int',has_traffic_filtering=True,id=c9643afc-4454-4d29-b8a2-5422753857b0,network=Network(db549bf7-e039-4ea4-ac62-b5c090652e6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9643afc-44') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG os_vif [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:35:a3,bridge_name='br-int',has_traffic_filtering=True,id=c9643afc-4454-4d29-b8a2-5422753857b0,network=Network(db549bf7-e039-4ea4-ac62-b5c090652e6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9643afc-44') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9643afc-44, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de326fa4-93f1-4bb2-9264-0f49a72d406b) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:33 user nova-compute[75391]: INFO os_vif [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:35:a3,bridge_name='br-int',has_traffic_filtering=True,id=c9643afc-4454-4d29-b8a2-5422753857b0,network=Network(db549bf7-e039-4ea4-ac62-b5c090652e6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9643afc-44')
Nov 15 02:50:33 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dfGrvENV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:50:33 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:50:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[546073d9-c9a3-4c47-a856-c5ffb7fbdbc8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:50:33 user nova-compute[75391]: No targets found.
Nov 15 02:50:33 user nova-compute[75391]: iSNS:
Nov 15 02:50:33 user nova-compute[75391]: No targets found.
Nov 15 02:50:33 user nova-compute[75391]: STATIC:
Nov 15 02:50:33 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8
Nov 15 02:50:33 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:50:33 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:50:33 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a
Nov 15 02:50:33 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:50:33 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:50:33 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:50:33 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:50:33 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:50:33 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea
Nov 15 02:50:33 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:50:33 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:50:33 user nova-compute[75391]: FIRMWARE:
Nov 15 02:50:33 user nova-compute[75391]: No targets found.
Nov 15 02:50:33 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:50:33 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:50:33 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb897af-79e4-47ad-abb3-8992d7cf215c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dab5b1-73c2-440e-84c9-ecd2a4f8289b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:50:33 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:50:33 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:50:33 user nova-compute[75391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:50:33 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:50:33 user nova-compute[75391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a (non-flash)
Nov 15 02:50:33 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:50:33 user nova-compute[75391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:50:33 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f622463e7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a'): ({'sdg'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Removing single pathed devices sdg {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[67023096-9698-46ca-8b8f-afe2f0dbabff]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d179d619-9836-490d-9c00-1d83995d37c9]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Flushing IO for device /dev/sdg {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5204235-448a-4e05-8a64-e49e0234db33]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.054s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[948f6383-ff67-4319-868c-e7becf64777f]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] SCSI volumes sdg have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b9524a-7f20-4da9-9073-df82701d307a]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f192a87-54e6-4855-af26-335779031691]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a, portal: 172.16.0.220,3260]
Nov 15 02:50:33 user nova-compute[75391]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a, portal: 172.16.0.220,3260] successful.
Nov 15 02:50:33 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:223d22cc-ebb2-4b73-8103-54aacfd3b44a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c393a9d-031b-4915-8c32-6bda0c39996c]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] <== disconnect_volume: return (352ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:50:33 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Deleting instance files /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d_del
Nov 15 02:50:33 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Deletion of /opt/stack/data/nova/instances/ebb7e616-3c05-4d99-a0b3-76dc1723e82d_del complete
Nov 15 02:50:33 user nova-compute[75391]: INFO nova.compute.manager [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Took 3.05 seconds to destroy the instance on the hypervisor.
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-400a4fe6-b0f4-429f-acd1-8de9fb9b827f req-dc4f64ac-4aa1-49aa-8e9e-9b555faad3ac service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Received event network-vif-plugged-5ef68714-0fbe-470d-b208-7d482f023640 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-400a4fe6-b0f4-429f-acd1-8de9fb9b827f req-dc4f64ac-4aa1-49aa-8e9e-9b555faad3ac service nova] Acquiring lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-400a4fe6-b0f4-429f-acd1-8de9fb9b827f req-dc4f64ac-4aa1-49aa-8e9e-9b555faad3ac service nova] Lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-400a4fe6-b0f4-429f-acd1-8de9fb9b827f req-dc4f64ac-4aa1-49aa-8e9e-9b555faad3ac service nova] Lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-400a4fe6-b0f4-429f-acd1-8de9fb9b827f req-dc4f64ac-4aa1-49aa-8e9e-9b555faad3ac service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] No waiting events found dispatching network-vif-plugged-5ef68714-0fbe-470d-b208-7d482f023640 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:50:33 user nova-compute[75391]: WARNING nova.compute.manager [req-400a4fe6-b0f4-429f-acd1-8de9fb9b827f req-dc4f64ac-4aa1-49aa-8e9e-9b555faad3ac service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Received unexpected event network-vif-plugged-5ef68714-0fbe-470d-b208-7d482f023640 for instance with vm_state building and task_state spawning.
Nov 15 02:50:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:34 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:50:34 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Took 1.26 seconds to deallocate network for instance.
Nov 15 02:50:34 user nova-compute[75391]: WARNING nova.volume.cinder [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Attachment 2a634b3a-5e29-47d5-a061-9f07e4023793 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 2a634b3a-5e29-47d5-a061-9f07e4023793. (HTTP 404) (Request-ID: req-19167de2-9df5-4e4e-aa2d-2487491d8a06)
Nov 15 02:50:34 user nova-compute[75391]: INFO nova.compute.manager [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Took 0.03 seconds to detach 1 volumes for instance.
Nov 15 02:50:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:34 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:50:34 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:50:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:34 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:50:34 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Deleted allocations for instance 054d3064-549d-442e-85ea-4c7bfde518cb
Nov 15 02:50:34 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Took 1.14 seconds to deallocate network for instance.
Nov 15 02:50:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-48a1104d-28db-4ec7-aabe-a1963095905f tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "054d3064-549d-442e-85ea-4c7bfde518cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.651s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:35 user nova-compute[75391]: DEBUG nova.compute.manager [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:50:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:50:35 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Instance spawned successfully.
Nov 15 02:50:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:50:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:50:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:50:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:50:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:50:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:50:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:50:35 user nova-compute[75391]: INFO nova.compute.manager [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Took 7.69 seconds to spawn the instance on the hypervisor.
Nov 15 02:50:35 user nova-compute[75391]: DEBUG nova.compute.manager [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:50:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-83c931df-6396-409a-8d41-0e7140de5523 req-54f65155-9997-41e3-b240-78578a481eaa service nova] [instance: 054d3064-549d-442e-85ea-4c7bfde518cb] Received event network-vif-deleted-b4140c76-b437-46c4-b8f4-dfafb44d7431 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:50:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-83c931df-6396-409a-8d41-0e7140de5523 req-54f65155-9997-41e3-b240-78578a481eaa service nova] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Received event network-vif-deleted-c9643afc-4454-4d29-b8a2-5422753857b0 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:50:35 user nova-compute[75391]: INFO nova.compute.manager [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Took 8.61 seconds to build instance.
Nov 15 02:50:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-89657622-a3d1-4722-83a2-736b1d57f3e9 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "9909ae6b-7900-4f71-8900-2bf25185e436" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.751s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:35 user nova-compute[75391]: INFO nova.compute.manager [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] [instance: ebb7e616-3c05-4d99-a0b3-76dc1723e82d] Took 0.84 seconds to detach 1 volumes for instance.
Nov 15 02:50:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-5e75166d-d8ad-4f20-a51c-14b023905b45 req-fb176658-9a9a-4f9a-8588-0607a2afada4 service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Received event network-vif-plugged-5ef68714-0fbe-470d-b208-7d482f023640 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:50:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5e75166d-d8ad-4f20-a51c-14b023905b45 req-fb176658-9a9a-4f9a-8588-0607a2afada4 service nova] Acquiring lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5e75166d-d8ad-4f20-a51c-14b023905b45 req-fb176658-9a9a-4f9a-8588-0607a2afada4 service nova] Lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5e75166d-d8ad-4f20-a51c-14b023905b45 req-fb176658-9a9a-4f9a-8588-0607a2afada4 service nova] Lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-5e75166d-d8ad-4f20-a51c-14b023905b45 req-fb176658-9a9a-4f9a-8588-0607a2afada4 service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] No waiting events found dispatching network-vif-plugged-5ef68714-0fbe-470d-b208-7d482f023640 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:50:35 user nova-compute[75391]: WARNING nova.compute.manager [req-5e75166d-d8ad-4f20-a51c-14b023905b45 req-fb176658-9a9a-4f9a-8588-0607a2afada4 service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Received unexpected event network-vif-plugged-5ef68714-0fbe-470d-b208-7d482f023640 for instance with vm_state building and task_state spawning.
Nov 15 02:50:35 user nova-compute[75391]: DEBUG nova.compute.manager [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:50:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:50:35 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Instance spawned successfully.
Nov 15 02:50:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:50:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "a4171d96-bb26-473f-a322-178dadbaab0a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "a4171d96-bb26-473f-a322-178dadbaab0a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:36 user nova-compute[75391]: INFO nova.compute.manager [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Detaching volume 400f1ca0-2998-4527-83c4-829f0cbe09ea
Nov 15 02:50:36 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:50:36 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:50:36 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:50:36 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:50:36 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:50:36 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:50:36 user nova-compute[75391]: INFO nova.virt.block_device [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Attempting to driver detach volume 400f1ca0-2998-4527-83c4-829f0cbe09ea from mountpoint /dev/vdb
Nov 15 02:50:36 user nova-compute[75391]: INFO nova.compute.manager [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Took 7.76 seconds to spawn the instance on the hypervisor.
Nov 15 02:50:36 user nova-compute[75391]: DEBUG nova.compute.manager [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:50:36 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:50:36 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Attempting to detach device vdb from instance a4171d96-bb26-473f-a322-178dadbaab0a from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:50:36 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:50:36 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:50:36 user nova-compute[75391]:   <source dev="/dev/sdh"/>
Nov 15 02:50:36 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:50:36 user nova-compute[75391]:   <serial>400f1ca0-2998-4527-83c4-829f0cbe09ea</serial>
Nov 15 02:50:36 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 02:50:36 user nova-compute[75391]: </disk>
Nov 15 02:50:36 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:50:36 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:50:36 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Successfully detached device vdb from instance a4171d96-bb26-473f-a322-178dadbaab0a from the persistent domain config.
Nov 15 02:50:36 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a4171d96-bb26-473f-a322-178dadbaab0a from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 02:50:36 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:50:36 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:50:36 user nova-compute[75391]:   <source dev="/dev/sdh"/>
Nov 15 02:50:36 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:50:36 user nova-compute[75391]:   <serial>400f1ca0-2998-4527-83c4-829f0cbe09ea</serial>
Nov 15 02:50:36 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 02:50:36 user nova-compute[75391]: </disk>
Nov 15 02:50:36 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:50:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:36 user nova-compute[75391]: INFO nova.compute.manager [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Took 8.98 seconds to build instance.
Nov 15 02:50:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-581a3d32-cd83-43d0-9b72-5b6779ec69df tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.145s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:36 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Deleted allocations for instance ebb7e616-3c05-4d99-a0b3-76dc1723e82d
Nov 15 02:50:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-25a8c72e-a09a-40c6-8150-65ef20b53c84 tempest-ServerActionsTestOtherB-5763420 tempest-ServerActionsTestOtherB-5763420-project-member] Lock "ebb7e616-3c05-4d99-a0b3-76dc1723e82d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.680s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:36 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a4171d96-bb26-473f-a322-178dadbaab0a {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 02:50:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "4ab2dd85-9758-4ea9-8282-9396a2653393" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:43 user nova-compute[75391]: DEBUG nova.objects.instance [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lazy-loading 'flavor' on Instance uuid 4ab2dd85-9758-4ea9-8282-9396a2653393 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:50:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "4ab2dd85-9758-4ea9-8282-9396a2653393" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:43 user nova-compute[75391]: INFO nova.compute.manager [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Attaching volume f9acc09b-a762-4d5c-a96e-693ae14062c0 to /dev/vdb
Nov 15 02:50:43 user nova-compute[75391]: DEBUG os_brick.utils [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:50:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:43 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c5ff1c-e819-4b8b-925f-8ff0f3a3e1ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:43 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb17b48-a369-47e4-bda3-301887fb1655]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:43 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[125cf6b9-b0bd-467b-9dea-ec5b0d4ddf66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:43 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b6f126-61ec-4dc6-9fe3-f2f54e1c95cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:50:43 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:50:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:50:43 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:50:43 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe7eb3c-6b6c-491f-bba3-95d5510a8813]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:43 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:50:43 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:50:43 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:50:43 user nova-compute[75391]: DEBUG os_brick.utils [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:50:43 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Updating existing volume attachment record: 24c42a1b-1795-4e3d-80a8-93623495dc60 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:50:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Acquiring lock "d51ffdd2-a462-4360-bc03-49f91c2ef45a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lock "d51ffdd2-a462-4360-bc03-49f91c2ef45a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:48 user nova-compute[75391]: DEBUG nova.objects.instance [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lazy-loading 'flavor' on Instance uuid d51ffdd2-a462-4360-bc03-49f91c2ef45a {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:50:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lock "d51ffdd2-a462-4360-bc03-49f91c2ef45a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Acquiring lock "d51ffdd2-a462-4360-bc03-49f91c2ef45a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lock "d51ffdd2-a462-4360-bc03-49f91c2ef45a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:48 user nova-compute[75391]: INFO nova.compute.manager [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Attaching volume 0a1f6b59-76f3-4cd6-9d4c-16185d31a408 to /dev/vdb
Nov 15 02:50:48 user nova-compute[75391]: DEBUG os_brick.utils [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:50:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[03edac83-4fdb-4796-a79b-2bbe863f46b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c626c43a-27cf-447d-a588-04676b1f4e86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:49 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[890fdf97-e0d6-47e4-b3d9-4f08359f9c9b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:49 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1d40b9-f259-4c08-9b8a-f4143b791eda]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:50:49 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:50:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:50:49 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:50:49 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[acadadad-e792-44ee-9115-7f93412437e6]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:49 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:50:49 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:50:49 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:50:49 user nova-compute[75391]: DEBUG os_brick.utils [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] <== get_connector_properties: return (187ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:50:49 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Updating existing volume attachment record: c1ee75ca-43ae-4cb3-ba5e-fda9c31f21ac {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:50:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ylWIruoF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:50:55 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:50:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:50:55 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:50:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:50:55 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb19d8b-c8e1-42db-910f-b6b3d7a3d10f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:50:55 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPyfprFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:50:55 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:50:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2506e94c-7fb9-45d3-b860-6ad424bc7e83]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0] added
Nov 15 02:50:55 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e3f485-8cde-4a22-9231-1a14fa0b3a11]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0a7d7c-21c3-403c-a24b-739996341e78]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ylWIruoF {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ylWIruoF" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c377f7b9-48e6-4744-b980-9268e1924e4e]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ylWIruoF'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f0682c-fbf2-4c05-a33c-e30048afd16e]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[578aba1c-1130-47d6-a2d2-18fa4bd1cdbb]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:50:55 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:50:55 user nova-compute[75391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:50:55 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:50:55 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:50:55 user nova-compute[75391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:50:55 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b225849-a119-45bf-b2d6-6e93b360a030]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0, portal: 172.16.0.220,3260]
Nov 15 02:50:55 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0, portal: 172.16.0.220,3260] successful.
Nov 15 02:50:55 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b4e192-84d2-4190-a2fd-6d6a2929e756]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94dfa0a-7552-48cc-9e39-292eb1f06643]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:50:55 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:50:55 user nova-compute[75391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:50:55 user nova-compute[75391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 (non-flash)
Nov 15 02:50:55 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:50:55 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:50:55 user nova-compute[75391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:50:55 user nova-compute[75391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 (non-flash)
Nov 15 02:50:55 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6f79dc-3405-49ee-aba8-95f9ed1be223]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:50:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ylWIruoF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23562646663636263', 'path': '/dev/sdc'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562646663636263', 'path': '/dev/sdc'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.312s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:50:56 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:50:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:50:56 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG nova.objects.instance [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lazy-loading 'flavor' on Instance uuid 4ab2dd85-9758-4ea9-8282-9396a2653393 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6b5fe1-e518-4c2d-a1e1-e992f2670cb7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:50:56 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45211d2-035b-47a7-af4b-4e36338ee1cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408] added
Nov 15 02:50:56 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 02:50:56 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:50:56 user nova-compute[75391]:   <source dev="/dev/sdc"/>
Nov 15 02:50:56 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:50:56 user nova-compute[75391]:   <serial>f9acc09b-a762-4d5c-a96e-693ae14062c0</serial>
Nov 15 02:50:56 user nova-compute[75391]: </disk>
Nov 15 02:50:56 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[917343fc-f844-4903-b9c9-7eec0a581fb7]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76935e5-2817-42ba-9648-427bb1cc5ba6]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sPyfprFc {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sPyfprFc" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[684c9345-2c32-4efc-ba31-7f2498ffc7e7]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sPyfprFc'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[66469c92-df75-41a7-b734-d28b0662aacd]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[18411d75-eff4-421b-abc0-2b80ffaff5ec]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:50:56 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:50:56 user nova-compute[75391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:50:56 user nova-compute[75391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 (non-flash)
Nov 15 02:50:56 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:50:56 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:50:56 user nova-compute[75391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:50:56 user nova-compute[75391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 (non-flash)
Nov 15 02:50:56 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:56 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a4171d96-bb26-473f-a322-178dadbaab0a is timed out.
Nov 15 02:50:56 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Successfully detached device vdb from instance a4171d96-bb26-473f-a322-178dadbaab0a from the live domain config.
Nov 15 02:50:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JajWuoHZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:50:56 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:50:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dfdc4c-5cc3-44c7-aa9c-9fa5995443bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408, portal: 172.16.0.220,3260]
Nov 15 02:50:56 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408, portal: 172.16.0.220,3260] successful.
Nov 15 02:50:56 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca392424-ff08-423e-9760-204407beb092]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0336ae9-a430-4d12-92e7-e2092b664f35]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:50:56 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:50:56 user nova-compute[75391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:50:56 user nova-compute[75391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 (non-flash)
Nov 15 02:50:56 user nova-compute[75391]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 (non-flash)
Nov 15 02:50:56 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:50:56 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:50:56 user nova-compute[75391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:50:56 user nova-compute[75391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 (non-flash)
Nov 15 02:50:56 user nova-compute[75391]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 (non-flash)
Nov 15 02:50:56 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd61e97-0d01-4a56-b069-71674bb627ad]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPyfprFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:50:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] No VIF found with MAC fa:16:3e:f2:fd:21, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-61981ffa-ba1d-4453-a477-6fe9d3812e98 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.644s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] <== connect_volume: return (2702ms) {'type': 'block', 'scsi_wwn': '26462643537326332', 'path': '/dev/sdd'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462643537326332', 'path': '/dev/sdd'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.154s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG nova.objects.instance [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lazy-loading 'flavor' on Instance uuid d51ffdd2-a462-4360-bc03-49f91c2ef45a {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[235fc0de-d397-4397-8b49-8f94318f7d62]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:50:57 user nova-compute[75391]: No targets found.
Nov 15 02:50:57 user nova-compute[75391]: iSNS:
Nov 15 02:50:57 user nova-compute[75391]: No targets found.
Nov 15 02:50:57 user nova-compute[75391]: STATIC:
Nov 15 02:50:57 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8
Nov 15 02:50:57 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:50:57 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:50:57 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408
Nov 15 02:50:57 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:50:57 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:50:57 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0
Nov 15 02:50:57 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:50:57 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:50:57 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:50:57 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:50:57 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:50:57 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea
Nov 15 02:50:57 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:50:57 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:50:57 user nova-compute[75391]: FIRMWARE:
Nov 15 02:50:57 user nova-compute[75391]: No targets found.
Nov 15 02:50:57 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:50:57 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:50:57 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 02:50:57 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:50:57 user nova-compute[75391]:   <source dev="/dev/sdd"/>
Nov 15 02:50:57 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:50:57 user nova-compute[75391]:   <serial>0a1f6b59-76f3-4cd6-9d4c-16185d31a408</serial>
Nov 15 02:50:57 user nova-compute[75391]: </disk>
Nov 15 02:50:57 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31287e7-dcdb-4ee5-883e-0b23b6831c65]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[de875f17-599b-42b2-9883-69cee87583c6]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:50:57 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:50:57 user nova-compute[75391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:50:57 user nova-compute[75391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 (non-flash)
Nov 15 02:50:57 user nova-compute[75391]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 (non-flash)
Nov 15 02:50:57 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:50:57 user nova-compute[75391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea (non-flash)
Nov 15 02:50:57 user nova-compute[75391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:50:57 user nova-compute[75391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 (non-flash)
Nov 15 02:50:57 user nova-compute[75391]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 (non-flash)
Nov 15 02:50:57 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f622466dfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea'): ({'sdh'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Removing single pathed devices sdh {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23edd9c-9b9b-4a26-b126-d336b7b23d3f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfa491c-f86e-42e2-b8a1-24206680f036]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Flushing IO for device /dev/sdh {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ade8fc-2436-433b-b097-edc3ac6d1169]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:50:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.048s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a54461-4910-45a8-9ef8-57f94b8ed1c8]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] SCSI volumes sdh have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bbef85-04f9-42ff-89d8-3635b66579b6]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fa6005-e7e7-43a8-83de-3fd610a462c8]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea, portal: 172.16.0.220,3260]
Nov 15 02:50:58 user nova-compute[75391]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea, portal: 172.16.0.220,3260] successful.
Nov 15 02:50:58 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400f1ca0-2998-4527-83c4-829f0cbe09ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d18b24c-f9ab-4d58-85ce-b77bcbcb6c07]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] <== disconnect_volume: return (1512ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] No VIF found with MAC fa:16:3e:25:63:85, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2bf68860-d951-4064-8fb3-effaad3ec31c tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lock "d51ffdd2-a462-4360-bc03-49f91c2ef45a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.583s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Acquiring lock "d51ffdd2-a462-4360-bc03-49f91c2ef45a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lock "d51ffdd2-a462-4360-bc03-49f91c2ef45a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Acquiring lock "d51ffdd2-a462-4360-bc03-49f91c2ef45a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lock "d51ffdd2-a462-4360-bc03-49f91c2ef45a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lock "d51ffdd2-a462-4360-bc03-49f91c2ef45a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:58 user nova-compute[75391]: INFO nova.compute.manager [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Terminating instance
Nov 15 02:50:58 user nova-compute[75391]: DEBUG nova.compute.manager [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG nova.objects.instance [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lazy-loading 'flavor' on Instance uuid a4171d96-bb26-473f-a322-178dadbaab0a {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5c41cabb-7891-48f1-ae9e-58052f5e2fcf tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "a4171d96-bb26-473f-a322-178dadbaab0a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.989s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG nova.compute.manager [req-466b606a-49e8-4073-ba28-23b2fa4d5937 req-cbd5da24-067b-408f-9c74-698c03abbd43 service nova] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Received event network-vif-unplugged-a0049ee3-4dd2-44f9-a1ec-21124057a196 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-466b606a-49e8-4073-ba28-23b2fa4d5937 req-cbd5da24-067b-408f-9c74-698c03abbd43 service nova] Acquiring lock "d51ffdd2-a462-4360-bc03-49f91c2ef45a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-466b606a-49e8-4073-ba28-23b2fa4d5937 req-cbd5da24-067b-408f-9c74-698c03abbd43 service nova] Lock "d51ffdd2-a462-4360-bc03-49f91c2ef45a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-466b606a-49e8-4073-ba28-23b2fa4d5937 req-cbd5da24-067b-408f-9c74-698c03abbd43 service nova] Lock "d51ffdd2-a462-4360-bc03-49f91c2ef45a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG nova.compute.manager [req-466b606a-49e8-4073-ba28-23b2fa4d5937 req-cbd5da24-067b-408f-9c74-698c03abbd43 service nova] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] No waiting events found dispatching network-vif-unplugged-a0049ee3-4dd2-44f9-a1ec-21124057a196 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG nova.compute.manager [req-466b606a-49e8-4073-ba28-23b2fa4d5937 req-cbd5da24-067b-408f-9c74-698c03abbd43 service nova] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Received event network-vif-unplugged-a0049ee3-4dd2-44f9-a1ec-21124057a196 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:50:59 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Instance destroyed successfully.
Nov 15 02:50:59 user nova-compute[75391]: DEBUG nova.objects.instance [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lazy-loading 'resources' on Instance uuid d51ffdd2-a462-4360-bc03-49f91c2ef45a {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:48:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-519251436',display_name='tempest-DeleteServersTestJSON-server-519251436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-519251436',id=23,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:49:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c6fd7f1be6840779673284167a8b26b',ramdisk_id='',reservation_id='r-sdedsm4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-886416817',owner_user_name='tempest-DeleteServersTestJSON-886416817-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:49:06Z,user_data=None,user_id='261877700997440592893f3f56ad6219',uuid=d51ffdd2-a462-4360-bc03-49f91c2ef45a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0049ee3-4dd2-44f9-a1ec-21124057a196", "address": "fa:16:3e:25:63:85", "network": {"id": "f5f7ca9d-040f-4350-8824-3d647c168282", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1458266999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6fd7f1be6840779673284167a8b26b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0049ee3-4d", "ovs_interfaceid": "a0049ee3-4dd2-44f9-a1ec-21124057a196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Converting VIF {"id": "a0049ee3-4dd2-44f9-a1ec-21124057a196", "address": "fa:16:3e:25:63:85", "network": {"id": "f5f7ca9d-040f-4350-8824-3d647c168282", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1458266999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6fd7f1be6840779673284167a8b26b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0049ee3-4d", "ovs_interfaceid": "a0049ee3-4dd2-44f9-a1ec-21124057a196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:63:85,bridge_name='br-int',has_traffic_filtering=True,id=a0049ee3-4dd2-44f9-a1ec-21124057a196,network=Network(f5f7ca9d-040f-4350-8824-3d647c168282),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0049ee3-4d') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG os_vif [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:63:85,bridge_name='br-int',has_traffic_filtering=True,id=a0049ee3-4dd2-44f9-a1ec-21124057a196,network=Network(f5f7ca9d-040f-4350-8824-3d647c168282),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0049ee3-4d') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0049ee3-4d, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=22cc6d6d-4831-47f4-a6be-0c238409a8d9) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:50:59 user nova-compute[75391]: INFO os_vif [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:63:85,bridge_name='br-int',has_traffic_filtering=True,id=a0049ee3-4dd2-44f9-a1ec-21124057a196,network=Network(f5f7ca9d-040f-4350-8824-3d647c168282),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0049ee3-4d')
Nov 15 02:50:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPyfprFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:50:59 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:50:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca8bdb9-094d-4971-9486-26128cb3d5df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:50:59 user nova-compute[75391]: No targets found.
Nov 15 02:50:59 user nova-compute[75391]: iSNS:
Nov 15 02:50:59 user nova-compute[75391]: No targets found.
Nov 15 02:50:59 user nova-compute[75391]: STATIC:
Nov 15 02:50:59 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8
Nov 15 02:50:59 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:50:59 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:50:59 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408
Nov 15 02:50:59 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:50:59 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:50:59 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0
Nov 15 02:50:59 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:50:59 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:50:59 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:50:59 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:50:59 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:50:59 user nova-compute[75391]: FIRMWARE:
Nov 15 02:50:59 user nova-compute[75391]: No targets found.
Nov 15 02:50:59 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:50:59 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:50:59 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d4f2e0-b567-49ed-ad4f-7e6db41bf56b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[169f1bc4-0eaa-4004-9604-67eb655ce5a8]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:50:59 user nova-compute[75391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:50:59 user nova-compute[75391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 (non-flash)
Nov 15 02:50:59 user nova-compute[75391]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 (non-flash)
Nov 15 02:50:59 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:50:59 user nova-compute[75391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:50:59 user nova-compute[75391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 (non-flash)
Nov 15 02:50:59 user nova-compute[75391]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 (non-flash)
Nov 15 02:50:59 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62446fd900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408'): ({'sdd'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Removing single pathed devices sdd {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c12d9d-3fb5-400a-981f-4b58fd384900]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-6400a5f3-0ec9-4484-930c-1f5061ae5374" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-6400a5f3-0ec9-4484-930c-1f5061ae5374" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ed0a1b-1f51-4911-bec9-8dee403eb036]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Flushing IO for device /dev/sdd {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb6fd62-7bf9-4d69-8857-a759c064aac9]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c6f433-f60d-437d-ade8-3fc14ce15b07]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] SCSI volumes sdd have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeef9776-0849-45c3-8024-19c0d145879d]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5599ebe-f745-423f-956e-dff7e26fd117]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408, portal: 172.16.0.220,3260]
Nov 15 02:50:59 user nova-compute[75391]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408, portal: 172.16.0.220,3260] successful.
Nov 15 02:50:59 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:50:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1f6b59-76f3-4cd6-9d4c-16185d31a408 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[21253651-2822-4bf0-b8e8-bd7e30b1bb32]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:51:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:51:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:51:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] <== disconnect_volume: return (316ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:51:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:51:00 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Deleting instance files /opt/stack/data/nova/instances/d51ffdd2-a462-4360-bc03-49f91c2ef45a_del
Nov 15 02:51:00 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Deletion of /opt/stack/data/nova/instances/d51ffdd2-a462-4360-bc03-49f91c2ef45a_del complete
Nov 15 02:51:00 user nova-compute[75391]: INFO nova.compute.manager [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Took 1.41 seconds to destroy the instance on the hypervisor.
Nov 15 02:51:00 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:51:00 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:51:00 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:51:00 user nova-compute[75391]: DEBUG nova.compute.manager [req-18e42d5b-fb82-405b-b552-548350b6e1bb req-1b86d927-938f-4177-a6f6-66a22fee135a service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Received event network-changed-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:51:00 user nova-compute[75391]: DEBUG nova.compute.manager [req-18e42d5b-fb82-405b-b552-548350b6e1bb req-1b86d927-938f-4177-a6f6-66a22fee135a service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Refreshing instance network info cache due to event network-changed-70574492-ddbc-47cd-b32c-cd5cb88b8ff7. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:51:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-18e42d5b-fb82-405b-b552-548350b6e1bb req-1b86d927-938f-4177-a6f6-66a22fee135a service nova] Acquiring lock "refresh_cache-4ab2dd85-9758-4ea9-8282-9396a2653393" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:51:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-18e42d5b-fb82-405b-b552-548350b6e1bb req-1b86d927-938f-4177-a6f6-66a22fee135a service nova] Acquired lock "refresh_cache-4ab2dd85-9758-4ea9-8282-9396a2653393" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:51:00 user nova-compute[75391]: DEBUG nova.network.neutron [req-18e42d5b-fb82-405b-b552-548350b6e1bb req-1b86d927-938f-4177-a6f6-66a22fee135a service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Refreshing network info cache for port 70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:51:01 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Updating instance_info_cache with network_info: [{"id": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "address": "fa:16:3e:84:8e:2f", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f803b5-4e", "ovs_interfaceid": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:51:01 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:51:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-6400a5f3-0ec9-4484-930c-1f5061ae5374" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:51:01 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 02:51:01 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:51:01 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:51:01 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:51:01 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:51:01 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:51:01 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:51:01 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:51:01 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:51:01 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Took 0.96 seconds to deallocate network for instance.
Nov 15 02:51:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:01 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:51:01 user nova-compute[75391]: DEBUG nova.compute.manager [req-3560b165-5622-48f6-9cc0-22704297e251 req-9ff0b9cb-9892-435c-a6e8-b7f64de53ed1 service nova] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Received event network-vif-plugged-a0049ee3-4dd2-44f9-a1ec-21124057a196 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:51:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3560b165-5622-48f6-9cc0-22704297e251 req-9ff0b9cb-9892-435c-a6e8-b7f64de53ed1 service nova] Acquiring lock "d51ffdd2-a462-4360-bc03-49f91c2ef45a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3560b165-5622-48f6-9cc0-22704297e251 req-9ff0b9cb-9892-435c-a6e8-b7f64de53ed1 service nova] Lock "d51ffdd2-a462-4360-bc03-49f91c2ef45a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3560b165-5622-48f6-9cc0-22704297e251 req-9ff0b9cb-9892-435c-a6e8-b7f64de53ed1 service nova] Lock "d51ffdd2-a462-4360-bc03-49f91c2ef45a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:01 user nova-compute[75391]: DEBUG nova.compute.manager [req-3560b165-5622-48f6-9cc0-22704297e251 req-9ff0b9cb-9892-435c-a6e8-b7f64de53ed1 service nova] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] No waiting events found dispatching network-vif-plugged-a0049ee3-4dd2-44f9-a1ec-21124057a196 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:51:01 user nova-compute[75391]: WARNING nova.compute.manager [req-3560b165-5622-48f6-9cc0-22704297e251 req-9ff0b9cb-9892-435c-a6e8-b7f64de53ed1 service nova] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Received unexpected event network-vif-plugged-a0049ee3-4dd2-44f9-a1ec-21124057a196 for instance with vm_state active and task_state deleting.
Nov 15 02:51:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcb81ad-9c87-408d-abed-9b7cd2a7a646/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcb81ad-9c87-408d-abed-9b7cd2a7a646/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcb81ad-9c87-408d-abed-9b7cd2a7a646/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:01 user nova-compute[75391]: DEBUG nova.network.neutron [req-18e42d5b-fb82-405b-b552-548350b6e1bb req-1b86d927-938f-4177-a6f6-66a22fee135a service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Updated VIF entry in instance network info cache for port 70574492-ddbc-47cd-b32c-cd5cb88b8ff7. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:51:01 user nova-compute[75391]: DEBUG nova.network.neutron [req-18e42d5b-fb82-405b-b552-548350b6e1bb req-1b86d927-938f-4177-a6f6-66a22fee135a service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Updating instance_info_cache with network_info: [{"id": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "address": "fa:16:3e:f2:fd:21", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70574492-dd", "ovs_interfaceid": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:51:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-18e42d5b-fb82-405b-b552-548350b6e1bb req-1b86d927-938f-4177-a6f6-66a22fee135a service nova] Releasing lock "refresh_cache-4ab2dd85-9758-4ea9-8282-9396a2653393" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:51:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcb81ad-9c87-408d-abed-9b7cd2a7a646/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:02 user nova-compute[75391]: INFO nova.compute.manager [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Took 0.95 seconds to detach 1 volumes for instance.
Nov 15 02:51:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:02 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:51:02 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:51:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.531s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:02 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Deleted allocations for instance d51ffdd2-a462-4360-bc03-49f91c2ef45a
Nov 15 02:51:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-b12cfe98-c583-43ab-8a36-95b72fd341a7 req-18130bae-0857-46bd-ab76-e4468f2a2fa5 service nova] [instance: d51ffdd2-a462-4360-bc03-49f91c2ef45a] Received event network-vif-deleted-a0049ee3-4dd2-44f9-a1ec-21124057a196 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:51:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3dcf7101-062d-483f-af78-abae2f50bced tempest-DeleteServersTestJSON-886416817 tempest-DeleteServersTestJSON-886416817-project-member] Lock "d51ffdd2-a462-4360-bc03-49f91c2ef45a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.146s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:51:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:03 user nova-compute[75391]: DEBUG nova.compute.manager [req-d1d7cea4-d5da-4eae-932d-180bb1608a1a req-1243e130-8db3-4e17-932e-4529e9898902 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Received event network-changed-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:51:03 user nova-compute[75391]: DEBUG nova.compute.manager [req-d1d7cea4-d5da-4eae-932d-180bb1608a1a req-1243e130-8db3-4e17-932e-4529e9898902 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Refreshing instance network info cache due to event network-changed-70574492-ddbc-47cd-b32c-cd5cb88b8ff7. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:51:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d1d7cea4-d5da-4eae-932d-180bb1608a1a req-1243e130-8db3-4e17-932e-4529e9898902 service nova] Acquiring lock "refresh_cache-4ab2dd85-9758-4ea9-8282-9396a2653393" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:51:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d1d7cea4-d5da-4eae-932d-180bb1608a1a req-1243e130-8db3-4e17-932e-4529e9898902 service nova] Acquired lock "refresh_cache-4ab2dd85-9758-4ea9-8282-9396a2653393" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:51:03 user nova-compute[75391]: DEBUG nova.network.neutron [req-d1d7cea4-d5da-4eae-932d-180bb1608a1a req-1243e130-8db3-4e17-932e-4529e9898902 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Refreshing network info cache for port 70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:51:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:51:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:51:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:04 user nova-compute[75391]: DEBUG nova.network.neutron [req-d1d7cea4-d5da-4eae-932d-180bb1608a1a req-1243e130-8db3-4e17-932e-4529e9898902 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Updated VIF entry in instance network info cache for port 70574492-ddbc-47cd-b32c-cd5cb88b8ff7. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:51:04 user nova-compute[75391]: DEBUG nova.network.neutron [req-d1d7cea4-d5da-4eae-932d-180bb1608a1a req-1243e130-8db3-4e17-932e-4529e9898902 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Updating instance_info_cache with network_info: [{"id": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "address": "fa:16:3e:f2:fd:21", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70574492-dd", "ovs_interfaceid": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:51:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-fecaadd2-7bdf-4e5a-baa0-c7fedea45bdb tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "4ab2dd85-9758-4ea9-8282-9396a2653393" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-fecaadd2-7bdf-4e5a-baa0-c7fedea45bdb tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:04 user nova-compute[75391]: INFO nova.compute.manager [None req-fecaadd2-7bdf-4e5a-baa0-c7fedea45bdb tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Rebooting instance
Nov 15 02:51:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d1d7cea4-d5da-4eae-932d-180bb1608a1a req-1243e130-8db3-4e17-932e-4529e9898902 service nova] Releasing lock "refresh_cache-4ab2dd85-9758-4ea9-8282-9396a2653393" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:51:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-fecaadd2-7bdf-4e5a-baa0-c7fedea45bdb tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "refresh_cache-4ab2dd85-9758-4ea9-8282-9396a2653393" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:51:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-fecaadd2-7bdf-4e5a-baa0-c7fedea45bdb tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquired lock "refresh_cache-4ab2dd85-9758-4ea9-8282-9396a2653393" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:51:04 user nova-compute[75391]: DEBUG nova.network.neutron [None req-fecaadd2-7bdf-4e5a-baa0-c7fedea45bdb tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:51:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:04 user nova-compute[75391]: DEBUG nova.network.neutron [None req-fecaadd2-7bdf-4e5a-baa0-c7fedea45bdb tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Updating instance_info_cache with network_info: [{"id": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "address": "fa:16:3e:f2:fd:21", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70574492-dd", "ovs_interfaceid": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:51:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-fecaadd2-7bdf-4e5a-baa0-c7fedea45bdb tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Releasing lock "refresh_cache-4ab2dd85-9758-4ea9-8282-9396a2653393" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:51:04 user nova-compute[75391]: DEBUG nova.compute.manager [None req-fecaadd2-7bdf-4e5a-baa0-c7fedea45bdb tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:51:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:05 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:51:05 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:51:05 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=7400MB free_disk=25.027603149414062GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:51:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:05 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9744c8a1-046e-4a00-92e0-92ebb3275ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:51:05 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance fc9484c0-9083-4797-8ab1-2ad392822ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:51:05 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6400a5f3-0ec9-4484-930c-1f5061ae5374 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:51:05 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance a4171d96-bb26-473f-a322-178dadbaab0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:51:05 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:51:05 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 4ab2dd85-9758-4ea9-8282-9396a2653393 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:51:05 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance fdcb81ad-9c87-408d-abed-9b7cd2a7a646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:51:05 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance d36e2f64-11cb-4b35-8471-9a4df7f4c227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:51:05 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9909ae6b-7900-4f71-8900-2bf25185e436 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:51:05 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 7bd332f2-0f74-4a43-96a2-2322b6cbf982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:51:05 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:51:05 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:51:06 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:51:06 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:51:06 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:51:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.489s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-9cc34972-d20b-4be6-81ea-f8dd6da37195 req-7b6f2188-96da-4603-b820-0d657eb2d7e0 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Received event network-vif-unplugged-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:51:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9cc34972-d20b-4be6-81ea-f8dd6da37195 req-7b6f2188-96da-4603-b820-0d657eb2d7e0 service nova] Acquiring lock "4ab2dd85-9758-4ea9-8282-9396a2653393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9cc34972-d20b-4be6-81ea-f8dd6da37195 req-7b6f2188-96da-4603-b820-0d657eb2d7e0 service nova] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9cc34972-d20b-4be6-81ea-f8dd6da37195 req-7b6f2188-96da-4603-b820-0d657eb2d7e0 service nova] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-9cc34972-d20b-4be6-81ea-f8dd6da37195 req-7b6f2188-96da-4603-b820-0d657eb2d7e0 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] No waiting events found dispatching network-vif-unplugged-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:51:07 user nova-compute[75391]: WARNING nova.compute.manager [req-9cc34972-d20b-4be6-81ea-f8dd6da37195 req-7b6f2188-96da-4603-b820-0d657eb2d7e0 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Received unexpected event network-vif-unplugged-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 for instance with vm_state active and task_state reboot_started.
Nov 15 02:51:08 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-fecaadd2-7bdf-4e5a-baa0-c7fedea45bdb tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Instance shutdown successfully.
Nov 15 02:51:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:09 user nova-compute[75391]: DEBUG nova.compute.manager [req-b24cc77a-c85e-45c2-acd4-ea6fcd717f7f req-1ae4c869-c786-4317-b60b-9aab79041396 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Received event network-vif-plugged-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:51:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b24cc77a-c85e-45c2-acd4-ea6fcd717f7f req-1ae4c869-c786-4317-b60b-9aab79041396 service nova] Acquiring lock "4ab2dd85-9758-4ea9-8282-9396a2653393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b24cc77a-c85e-45c2-acd4-ea6fcd717f7f req-1ae4c869-c786-4317-b60b-9aab79041396 service nova] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b24cc77a-c85e-45c2-acd4-ea6fcd717f7f req-1ae4c869-c786-4317-b60b-9aab79041396 service nova] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:09 user nova-compute[75391]: DEBUG nova.compute.manager [req-b24cc77a-c85e-45c2-acd4-ea6fcd717f7f req-1ae4c869-c786-4317-b60b-9aab79041396 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] No waiting events found dispatching network-vif-plugged-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:51:09 user nova-compute[75391]: WARNING nova.compute.manager [req-b24cc77a-c85e-45c2-acd4-ea6fcd717f7f req-1ae4c869-c786-4317-b60b-9aab79041396 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Received unexpected event network-vif-plugged-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 for instance with vm_state active and task_state reboot_started.
Nov 15 02:51:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:09 user nova-compute[75391]: DEBUG nova.compute.manager [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:51:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:09 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:51:09 user nova-compute[75391]: INFO nova.compute.claims [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Claim successful on node user
Nov 15 02:51:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:10 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:51:10 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:51:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:10 user nova-compute[75391]: DEBUG nova.compute.manager [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:51:10 user nova-compute[75391]: DEBUG nova.compute.manager [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:51:10 user nova-compute[75391]: DEBUG nova.network.neutron [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:51:10 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:51:10 user nova-compute[75391]: DEBUG nova.compute.manager [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:51:10 user nova-compute[75391]: DEBUG nova.policy [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0a5832ec3e834e4c8e11d671f7891cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a31c2c4cb4586857b6179adf48ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:51:10 user nova-compute[75391]: DEBUG nova.compute.manager [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:51:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:51:10 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Creating image(s)
Nov 15 02:51:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "/opt/stack/data/nova/instances/4dd99dea-60d3-4eed-86c7-8d9d0522ae84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "/opt/stack/data/nova/instances/4dd99dea-60d3-4eed-86c7-8d9d0522ae84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "/opt/stack/data/nova/instances/4dd99dea-60d3-4eed-86c7-8d9d0522ae84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:10 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:10 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.178s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:10 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.186s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/4dd99dea-60d3-4eed-86c7-8d9d0522ae84/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/4dd99dea-60d3-4eed-86c7-8d9d0522ae84/disk 1073741824" returned: 0 in 0.059s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.199s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:11 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4dd99dea-60d3-4eed-86c7-8d9d0522ae84/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:51:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dd99dea-60d3-4eed-86c7-8d9d0522ae84/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dd99dea-60d3-4eed-86c7-8d9d0522ae84/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:11 user nova-compute[75391]: DEBUG nova.network.neutron [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Successfully created port: d76118a0-ca86-4748-a834-00ed12aa1b23 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:51:11 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Cannot resize image /opt/stack/data/nova/instances/4dd99dea-60d3-4eed-86c7-8d9d0522ae84/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:51:11 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:51:11 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Ensure instance console log exists: /opt/stack/data/nova/instances/4dd99dea-60d3-4eed-86c7-8d9d0522ae84/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:51:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:11 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Instance running successfully.
Nov 15 02:51:11 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-fecaadd2-7bdf-4e5a-baa0-c7fedea45bdb tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Instance soft rebooted successfully.
Nov 15 02:51:11 user nova-compute[75391]: DEBUG nova.compute.manager [None req-fecaadd2-7bdf-4e5a-baa0-c7fedea45bdb tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:51:11 user nova-compute[75391]: DEBUG nova.compute.manager [req-60bb1442-ecb1-4bb8-a54e-52d56789ddc3 req-5a8710f2-d9cf-49b4-bcf6-7cedf9552044 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Received event network-vif-plugged-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:51:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-60bb1442-ecb1-4bb8-a54e-52d56789ddc3 req-5a8710f2-d9cf-49b4-bcf6-7cedf9552044 service nova] Acquiring lock "4ab2dd85-9758-4ea9-8282-9396a2653393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-60bb1442-ecb1-4bb8-a54e-52d56789ddc3 req-5a8710f2-d9cf-49b4-bcf6-7cedf9552044 service nova] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-60bb1442-ecb1-4bb8-a54e-52d56789ddc3 req-5a8710f2-d9cf-49b4-bcf6-7cedf9552044 service nova] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:11 user nova-compute[75391]: DEBUG nova.compute.manager [req-60bb1442-ecb1-4bb8-a54e-52d56789ddc3 req-5a8710f2-d9cf-49b4-bcf6-7cedf9552044 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] No waiting events found dispatching network-vif-plugged-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:51:11 user nova-compute[75391]: WARNING nova.compute.manager [req-60bb1442-ecb1-4bb8-a54e-52d56789ddc3 req-5a8710f2-d9cf-49b4-bcf6-7cedf9552044 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Received unexpected event network-vif-plugged-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 for instance with vm_state active and task_state reboot_started.
Nov 15 02:51:11 user nova-compute[75391]: DEBUG nova.compute.manager [req-60bb1442-ecb1-4bb8-a54e-52d56789ddc3 req-5a8710f2-d9cf-49b4-bcf6-7cedf9552044 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Received event network-vif-plugged-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:51:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-60bb1442-ecb1-4bb8-a54e-52d56789ddc3 req-5a8710f2-d9cf-49b4-bcf6-7cedf9552044 service nova] Acquiring lock "4ab2dd85-9758-4ea9-8282-9396a2653393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-60bb1442-ecb1-4bb8-a54e-52d56789ddc3 req-5a8710f2-d9cf-49b4-bcf6-7cedf9552044 service nova] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-60bb1442-ecb1-4bb8-a54e-52d56789ddc3 req-5a8710f2-d9cf-49b4-bcf6-7cedf9552044 service nova] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:11 user nova-compute[75391]: DEBUG nova.compute.manager [req-60bb1442-ecb1-4bb8-a54e-52d56789ddc3 req-5a8710f2-d9cf-49b4-bcf6-7cedf9552044 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] No waiting events found dispatching network-vif-plugged-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:51:11 user nova-compute[75391]: WARNING nova.compute.manager [req-60bb1442-ecb1-4bb8-a54e-52d56789ddc3 req-5a8710f2-d9cf-49b4-bcf6-7cedf9552044 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Received unexpected event network-vif-plugged-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 for instance with vm_state active and task_state reboot_started.
Nov 15 02:51:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-fecaadd2-7bdf-4e5a-baa0-c7fedea45bdb tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.519s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.network.neutron [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Successfully updated port: d76118a0-ca86-4748-a834-00ed12aa1b23 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "refresh_cache-4dd99dea-60d3-4eed-86c7-8d9d0522ae84" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquired lock "refresh_cache-4dd99dea-60d3-4eed-86c7-8d9d0522ae84" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.network.neutron [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.network.neutron [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.network.neutron [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Updating instance_info_cache with network_info: [{"id": "d76118a0-ca86-4748-a834-00ed12aa1b23", "address": "fa:16:3e:7b:22:f3", "network": {"id": "07cd9e35-dfd4-4a08-ac37-52c7bfefa42e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1490748469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96a31c2c4cb4586857b6179adf48ec0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd76118a0-ca", "ovs_interfaceid": "d76118a0-ca86-4748-a834-00ed12aa1b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Releasing lock "refresh_cache-4dd99dea-60d3-4eed-86c7-8d9d0522ae84" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.compute.manager [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Instance network_info: |[{"id": "d76118a0-ca86-4748-a834-00ed12aa1b23", "address": "fa:16:3e:7b:22:f3", "network": {"id": "07cd9e35-dfd4-4a08-ac37-52c7bfefa42e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1490748469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96a31c2c4cb4586857b6179adf48ec0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd76118a0-ca", "ovs_interfaceid": "d76118a0-ca86-4748-a834-00ed12aa1b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Start _get_guest_xml network_info=[{"id": "d76118a0-ca86-4748-a834-00ed12aa1b23", "address": "fa:16:3e:7b:22:f3", "network": {"id": "07cd9e35-dfd4-4a08-ac37-52c7bfefa42e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1490748469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96a31c2c4cb4586857b6179adf48ec0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd76118a0-ca", "ovs_interfaceid": "d76118a0-ca86-4748-a834-00ed12aa1b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:51:12 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:51:12 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:51:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1741925017',display_name='tempest-VolumesSnapshotTestJSON-instance-1741925017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1741925017',id=28,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJxxT62jsmc4HPH0QPlQT1pK3htbJm5DTQWqHcv/oDWrnX29fnZVpaNW1iN0egjL4NNFFkvciNNoHPgLqUIm9Tek6Wq0OfcnQmsQsHLhGyi9+n0Yzay9Ix3mgT3z9GO+Q==',key_name='tempest-keypair-1887836886',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c96a31c2c4cb4586857b6179adf48ec0',ramdisk_id='',reservation_id='r-k1yv8mxa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1270812690',owner_user_name='tempest-VolumesSnapshotTestJSON-1270812690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:51:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a5832ec3e834e4c8e11d671f7891cdf',uuid=4dd99dea-60d3-4eed-86c7-8d9d0522ae84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d76118a0-ca86-4748-a834-00ed12aa1b23", "address": "fa:16:3e:7b:22:f3", "network": {"id": "07cd9e35-dfd4-4a08-ac37-52c7bfefa42e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1490748469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96a31c2c4cb4586857b6179adf48ec0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd76118a0-ca", "ovs_interfaceid": "d76118a0-ca86-4748-a834-00ed12aa1b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Converting VIF {"id": "d76118a0-ca86-4748-a834-00ed12aa1b23", "address": "fa:16:3e:7b:22:f3", "network": {"id": "07cd9e35-dfd4-4a08-ac37-52c7bfefa42e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1490748469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96a31c2c4cb4586857b6179adf48ec0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd76118a0-ca", "ovs_interfaceid": "d76118a0-ca86-4748-a834-00ed12aa1b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:22:f3,bridge_name='br-int',has_traffic_filtering=True,id=d76118a0-ca86-4748-a834-00ed12aa1b23,network=Network(07cd9e35-dfd4-4a08-ac37-52c7bfefa42e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd76118a0-ca') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.objects.instance [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lazy-loading 'pci_devices' on Instance uuid 4dd99dea-60d3-4eed-86c7-8d9d0522ae84 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:51:12 user nova-compute[75391]:   <uuid>4dd99dea-60d3-4eed-86c7-8d9d0522ae84</uuid>
Nov 15 02:51:12 user nova-compute[75391]:   <name>instance-0000001c</name>
Nov 15 02:51:12 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:51:12 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:51:12 user nova-compute[75391]:   <metadata>
Nov 15 02:51:12 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:51:12 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:51:12 user nova-compute[75391]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1741925017</nova:name>
Nov 15 02:51:12 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:51:12</nova:creationTime>
Nov 15 02:51:12 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:51:12 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:51:12 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:51:12 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:51:12 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:51:12 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:51:12 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:51:12 user nova-compute[75391]:       <nova:owner>
Nov 15 02:51:12 user nova-compute[75391]:         <nova:user uuid="0a5832ec3e834e4c8e11d671f7891cdf">tempest-VolumesSnapshotTestJSON-1270812690-project-member</nova:user>
Nov 15 02:51:12 user nova-compute[75391]:         <nova:project uuid="c96a31c2c4cb4586857b6179adf48ec0">tempest-VolumesSnapshotTestJSON-1270812690</nova:project>
Nov 15 02:51:12 user nova-compute[75391]:       </nova:owner>
Nov 15 02:51:12 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:51:12 user nova-compute[75391]:       <nova:ports>
Nov 15 02:51:12 user nova-compute[75391]:         <nova:port uuid="d76118a0-ca86-4748-a834-00ed12aa1b23">
Nov 15 02:51:12 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 02:51:12 user nova-compute[75391]:         </nova:port>
Nov 15 02:51:12 user nova-compute[75391]:       </nova:ports>
Nov 15 02:51:12 user nova-compute[75391]:     </nova:instance>
Nov 15 02:51:12 user nova-compute[75391]:   </metadata>
Nov 15 02:51:12 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:51:12 user nova-compute[75391]:     <system>
Nov 15 02:51:12 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:51:12 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:51:12 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:51:12 user nova-compute[75391]:       <entry name="serial">4dd99dea-60d3-4eed-86c7-8d9d0522ae84</entry>
Nov 15 02:51:12 user nova-compute[75391]:       <entry name="uuid">4dd99dea-60d3-4eed-86c7-8d9d0522ae84</entry>
Nov 15 02:51:12 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:51:12 user nova-compute[75391]:     </system>
Nov 15 02:51:12 user nova-compute[75391]:   </sysinfo>
Nov 15 02:51:12 user nova-compute[75391]:   <os>
Nov 15 02:51:12 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:51:12 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:51:12 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:51:12 user nova-compute[75391]:   </os>
Nov 15 02:51:12 user nova-compute[75391]:   <features>
Nov 15 02:51:12 user nova-compute[75391]:     <acpi/>
Nov 15 02:51:12 user nova-compute[75391]:     <apic/>
Nov 15 02:51:12 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:51:12 user nova-compute[75391]:   </features>
Nov 15 02:51:12 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:51:12 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:51:12 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:51:12 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:51:12 user nova-compute[75391]:   </clock>
Nov 15 02:51:12 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:51:12 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:51:12 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:51:12 user nova-compute[75391]:   </cpu>
Nov 15 02:51:12 user nova-compute[75391]:   <devices>
Nov 15 02:51:12 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:51:12 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:51:12 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/4dd99dea-60d3-4eed-86c7-8d9d0522ae84/disk"/>
Nov 15 02:51:12 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:51:12 user nova-compute[75391]:     </disk>
Nov 15 02:51:12 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:51:12 user nova-compute[75391]:       <mac address="fa:16:3e:7b:22:f3"/>
Nov 15 02:51:12 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:51:12 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:51:12 user nova-compute[75391]:       <target dev="tapd76118a0-ca"/>
Nov 15 02:51:12 user nova-compute[75391]:     </interface>
Nov 15 02:51:12 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:51:12 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/4dd99dea-60d3-4eed-86c7-8d9d0522ae84/console.log" append="off"/>
Nov 15 02:51:12 user nova-compute[75391]:     </serial>
Nov 15 02:51:12 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:51:12 user nova-compute[75391]:     <video>
Nov 15 02:51:12 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:51:12 user nova-compute[75391]:     </video>
Nov 15 02:51:12 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:51:12 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:51:12 user nova-compute[75391]:     </rng>
Nov 15 02:51:12 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:51:12 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:51:12 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:51:12 user nova-compute[75391]:     </memballoon>
Nov 15 02:51:12 user nova-compute[75391]:   </devices>
Nov 15 02:51:12 user nova-compute[75391]: </domain>
Nov 15 02:51:12 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:51:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1741925017',display_name='tempest-VolumesSnapshotTestJSON-instance-1741925017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1741925017',id=28,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJxxT62jsmc4HPH0QPlQT1pK3htbJm5DTQWqHcv/oDWrnX29fnZVpaNW1iN0egjL4NNFFkvciNNoHPgLqUIm9Tek6Wq0OfcnQmsQsHLhGyi9+n0Yzay9Ix3mgT3z9GO+Q==',key_name='tempest-keypair-1887836886',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c96a31c2c4cb4586857b6179adf48ec0',ramdisk_id='',reservation_id='r-k1yv8mxa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1270812690',owner_user_name='tempest-VolumesSnapshotTestJSON-1270812690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:51:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a5832ec3e834e4c8e11d671f7891cdf',uuid=4dd99dea-60d3-4eed-86c7-8d9d0522ae84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d76118a0-ca86-4748-a834-00ed12aa1b23", "address": "fa:16:3e:7b:22:f3", "network": {"id": "07cd9e35-dfd4-4a08-ac37-52c7bfefa42e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1490748469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96a31c2c4cb4586857b6179adf48ec0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd76118a0-ca", "ovs_interfaceid": "d76118a0-ca86-4748-a834-00ed12aa1b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Converting VIF {"id": "d76118a0-ca86-4748-a834-00ed12aa1b23", "address": "fa:16:3e:7b:22:f3", "network": {"id": "07cd9e35-dfd4-4a08-ac37-52c7bfefa42e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1490748469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96a31c2c4cb4586857b6179adf48ec0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd76118a0-ca", "ovs_interfaceid": "d76118a0-ca86-4748-a834-00ed12aa1b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:22:f3,bridge_name='br-int',has_traffic_filtering=True,id=d76118a0-ca86-4748-a834-00ed12aa1b23,network=Network(07cd9e35-dfd4-4a08-ac37-52c7bfefa42e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd76118a0-ca') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG os_vif [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:22:f3,bridge_name='br-int',has_traffic_filtering=True,id=d76118a0-ca86-4748-a834-00ed12aa1b23,network=Network(07cd9e35-dfd4-4a08-ac37-52c7bfefa42e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd76118a0-ca') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b05ebcb4-f250-5f92-bdfe-8b4aead34129', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd76118a0-ca, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd76118a0-ca, col_values=(('qos', UUID('e17141e9-f92d-4cd6-81c3-672dd051bb26')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd76118a0-ca, col_values=(('external_ids', {'iface-id': 'd76118a0-ca86-4748-a834-00ed12aa1b23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:22:f3', 'vm-uuid': '4dd99dea-60d3-4eed-86c7-8d9d0522ae84'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:12 user nova-compute[75391]: INFO os_vif [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:22:f3,bridge_name='br-int',has_traffic_filtering=True,id=d76118a0-ca86-4748-a834-00ed12aa1b23,network=Network(07cd9e35-dfd4-4a08-ac37-52c7bfefa42e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd76118a0-ca')
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:51:12 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] No VIF found with MAC fa:16:3e:7b:22:f3, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:51:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:13 user nova-compute[75391]: DEBUG nova.compute.manager [req-f847e870-3bc9-4dfe-9267-f268f7eb1c37 req-5174bd57-09b6-4483-8081-084c7005dd55 service nova] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Received event network-changed-d76118a0-ca86-4748-a834-00ed12aa1b23 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:51:13 user nova-compute[75391]: DEBUG nova.compute.manager [req-f847e870-3bc9-4dfe-9267-f268f7eb1c37 req-5174bd57-09b6-4483-8081-084c7005dd55 service nova] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Refreshing instance network info cache due to event network-changed-d76118a0-ca86-4748-a834-00ed12aa1b23. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:51:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f847e870-3bc9-4dfe-9267-f268f7eb1c37 req-5174bd57-09b6-4483-8081-084c7005dd55 service nova] Acquiring lock "refresh_cache-4dd99dea-60d3-4eed-86c7-8d9d0522ae84" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:51:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f847e870-3bc9-4dfe-9267-f268f7eb1c37 req-5174bd57-09b6-4483-8081-084c7005dd55 service nova] Acquired lock "refresh_cache-4dd99dea-60d3-4eed-86c7-8d9d0522ae84" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:51:13 user nova-compute[75391]: DEBUG nova.network.neutron [req-f847e870-3bc9-4dfe-9267-f268f7eb1c37 req-5174bd57-09b6-4483-8081-084c7005dd55 service nova] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Refreshing network info cache for port d76118a0-ca86-4748-a834-00ed12aa1b23 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:51:14 user nova-compute[75391]: DEBUG nova.network.neutron [req-f847e870-3bc9-4dfe-9267-f268f7eb1c37 req-5174bd57-09b6-4483-8081-084c7005dd55 service nova] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Updated VIF entry in instance network info cache for port d76118a0-ca86-4748-a834-00ed12aa1b23. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:51:14 user nova-compute[75391]: DEBUG nova.network.neutron [req-f847e870-3bc9-4dfe-9267-f268f7eb1c37 req-5174bd57-09b6-4483-8081-084c7005dd55 service nova] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Updating instance_info_cache with network_info: [{"id": "d76118a0-ca86-4748-a834-00ed12aa1b23", "address": "fa:16:3e:7b:22:f3", "network": {"id": "07cd9e35-dfd4-4a08-ac37-52c7bfefa42e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1490748469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96a31c2c4cb4586857b6179adf48ec0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd76118a0-ca", "ovs_interfaceid": "d76118a0-ca86-4748-a834-00ed12aa1b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:51:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f847e870-3bc9-4dfe-9267-f268f7eb1c37 req-5174bd57-09b6-4483-8081-084c7005dd55 service nova] Releasing lock "refresh_cache-4dd99dea-60d3-4eed-86c7-8d9d0522ae84" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:51:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:15 user nova-compute[75391]: DEBUG nova.compute.manager [req-9acba664-373d-4e63-b214-e3c6b3525d27 req-18b53052-cb41-4235-96b2-aef9961b7cb9 service nova] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Received event network-vif-plugged-d76118a0-ca86-4748-a834-00ed12aa1b23 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:51:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9acba664-373d-4e63-b214-e3c6b3525d27 req-18b53052-cb41-4235-96b2-aef9961b7cb9 service nova] Acquiring lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9acba664-373d-4e63-b214-e3c6b3525d27 req-18b53052-cb41-4235-96b2-aef9961b7cb9 service nova] Lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9acba664-373d-4e63-b214-e3c6b3525d27 req-18b53052-cb41-4235-96b2-aef9961b7cb9 service nova] Lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:15 user nova-compute[75391]: DEBUG nova.compute.manager [req-9acba664-373d-4e63-b214-e3c6b3525d27 req-18b53052-cb41-4235-96b2-aef9961b7cb9 service nova] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] No waiting events found dispatching network-vif-plugged-d76118a0-ca86-4748-a834-00ed12aa1b23 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:51:15 user nova-compute[75391]: WARNING nova.compute.manager [req-9acba664-373d-4e63-b214-e3c6b3525d27 req-18b53052-cb41-4235-96b2-aef9961b7cb9 service nova] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Received unexpected event network-vif-plugged-d76118a0-ca86-4748-a834-00ed12aa1b23 for instance with vm_state building and task_state spawning.
Nov 15 02:51:15 user nova-compute[75391]: DEBUG nova.compute.manager [req-9acba664-373d-4e63-b214-e3c6b3525d27 req-18b53052-cb41-4235-96b2-aef9961b7cb9 service nova] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Received event network-vif-plugged-d76118a0-ca86-4748-a834-00ed12aa1b23 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:51:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9acba664-373d-4e63-b214-e3c6b3525d27 req-18b53052-cb41-4235-96b2-aef9961b7cb9 service nova] Acquiring lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9acba664-373d-4e63-b214-e3c6b3525d27 req-18b53052-cb41-4235-96b2-aef9961b7cb9 service nova] Lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9acba664-373d-4e63-b214-e3c6b3525d27 req-18b53052-cb41-4235-96b2-aef9961b7cb9 service nova] Lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:15 user nova-compute[75391]: DEBUG nova.compute.manager [req-9acba664-373d-4e63-b214-e3c6b3525d27 req-18b53052-cb41-4235-96b2-aef9961b7cb9 service nova] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] No waiting events found dispatching network-vif-plugged-d76118a0-ca86-4748-a834-00ed12aa1b23 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:51:15 user nova-compute[75391]: WARNING nova.compute.manager [req-9acba664-373d-4e63-b214-e3c6b3525d27 req-18b53052-cb41-4235-96b2-aef9961b7cb9 service nova] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Received unexpected event network-vif-plugged-d76118a0-ca86-4748-a834-00ed12aa1b23 for instance with vm_state building and task_state spawning.
Nov 15 02:51:16 user nova-compute[75391]: DEBUG nova.compute.manager [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:51:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:51:16 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Instance spawned successfully.
Nov 15 02:51:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:51:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:51:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:51:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:51:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:51:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:51:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:51:16 user nova-compute[75391]: INFO nova.compute.manager [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Took 5.97 seconds to spawn the instance on the hypervisor.
Nov 15 02:51:16 user nova-compute[75391]: DEBUG nova.compute.manager [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:51:16 user nova-compute[75391]: INFO nova.compute.manager [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Took 6.81 seconds to build instance.
Nov 15 02:51:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cda12be9-c847-43cb-b21f-eef3c7040f33 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.910s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:17 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:22 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5ab69343-1596-4655-bb21-8b32829e3d34 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "a4171d96-bb26-473f-a322-178dadbaab0a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5ab69343-1596-4655-bb21-8b32829e3d34 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "a4171d96-bb26-473f-a322-178dadbaab0a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5ab69343-1596-4655-bb21-8b32829e3d34 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "a4171d96-bb26-473f-a322-178dadbaab0a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5ab69343-1596-4655-bb21-8b32829e3d34 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "a4171d96-bb26-473f-a322-178dadbaab0a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5ab69343-1596-4655-bb21-8b32829e3d34 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "a4171d96-bb26-473f-a322-178dadbaab0a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:26 user nova-compute[75391]: INFO nova.compute.manager [None req-5ab69343-1596-4655-bb21-8b32829e3d34 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Terminating instance
Nov 15 02:51:26 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5ab69343-1596-4655-bb21-8b32829e3d34 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:51:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-267a1cb3-65c7-414a-b75b-eb08ad407fb7 req-8551fd0b-d017-4a24-8678-8bae14aa3dc5 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Received event network-vif-unplugged-2a223503-a5c6-4851-b555-f4b3c9ce26bf {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:51:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-267a1cb3-65c7-414a-b75b-eb08ad407fb7 req-8551fd0b-d017-4a24-8678-8bae14aa3dc5 service nova] Acquiring lock "a4171d96-bb26-473f-a322-178dadbaab0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-267a1cb3-65c7-414a-b75b-eb08ad407fb7 req-8551fd0b-d017-4a24-8678-8bae14aa3dc5 service nova] Lock "a4171d96-bb26-473f-a322-178dadbaab0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-267a1cb3-65c7-414a-b75b-eb08ad407fb7 req-8551fd0b-d017-4a24-8678-8bae14aa3dc5 service nova] Lock "a4171d96-bb26-473f-a322-178dadbaab0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-267a1cb3-65c7-414a-b75b-eb08ad407fb7 req-8551fd0b-d017-4a24-8678-8bae14aa3dc5 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] No waiting events found dispatching network-vif-unplugged-2a223503-a5c6-4851-b555-f4b3c9ce26bf {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:51:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-267a1cb3-65c7-414a-b75b-eb08ad407fb7 req-8551fd0b-d017-4a24-8678-8bae14aa3dc5 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Received event network-vif-unplugged-2a223503-a5c6-4851-b555-f4b3c9ce26bf for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:51:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:27 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Instance destroyed successfully.
Nov 15 02:51:27 user nova-compute[75391]: DEBUG nova.objects.instance [None req-5ab69343-1596-4655-bb21-8b32829e3d34 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lazy-loading 'resources' on Instance uuid a4171d96-bb26-473f-a322-178dadbaab0a {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:51:27 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-5ab69343-1596-4655-bb21-8b32829e3d34 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T02:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-94225325',display_name='tempest-ServerActionsTestOtherA-server-528519161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-94225325',id=15,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmhK+EJhHmIDrZeRSNrf3UHZ5JLeQLAhGX/u9JkQb0ZIxg+Hha5DuE4jWuovQg5sU4I3Rt0gf/qTiKk2CMFhsxz1MyhTUWVIT75bqS2ShQt+vRSNlu3Pq6uyTO9HgnnNg==',key_name='tempest-keypair-537215865',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:48:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81798f0465704c4d9c09d8c3d3175ac5',ramdisk_id='',reservation_id='r-9oodw1p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1177660790',owner_user_name='tempest-ServerActionsTestOtherA-1177660790-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:48:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ea5480ad1e49afa394e636c37e3b70',uuid=a4171d96-bb26-473f-a322-178dadbaab0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "address": "fa:16:3e:5b:49:f4", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a223503-a5", "ovs_interfaceid": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:51:27 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-5ab69343-1596-4655-bb21-8b32829e3d34 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converting VIF {"id": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "address": "fa:16:3e:5b:49:f4", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a223503-a5", "ovs_interfaceid": "2a223503-a5c6-4851-b555-f4b3c9ce26bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:51:27 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-5ab69343-1596-4655-bb21-8b32829e3d34 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:49:f4,bridge_name='br-int',has_traffic_filtering=True,id=2a223503-a5c6-4851-b555-f4b3c9ce26bf,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a223503-a5') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:51:27 user nova-compute[75391]: DEBUG os_vif [None req-5ab69343-1596-4655-bb21-8b32829e3d34 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:49:f4,bridge_name='br-int',has_traffic_filtering=True,id=2a223503-a5c6-4851-b555-f4b3c9ce26bf,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a223503-a5') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:51:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a223503-a5, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:51:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:51:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b1c7b7c-8146-471e-968f-5d1595f6aae5) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:51:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:27 user nova-compute[75391]: INFO os_vif [None req-5ab69343-1596-4655-bb21-8b32829e3d34 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:49:f4,bridge_name='br-int',has_traffic_filtering=True,id=2a223503-a5c6-4851-b555-f4b3c9ce26bf,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a223503-a5')
Nov 15 02:51:27 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-5ab69343-1596-4655-bb21-8b32829e3d34 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Deleting instance files /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a_del
Nov 15 02:51:27 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-5ab69343-1596-4655-bb21-8b32829e3d34 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Deletion of /opt/stack/data/nova/instances/a4171d96-bb26-473f-a322-178dadbaab0a_del complete
Nov 15 02:51:27 user nova-compute[75391]: INFO nova.compute.manager [None req-5ab69343-1596-4655-bb21-8b32829e3d34 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 15 02:51:27 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-5ab69343-1596-4655-bb21-8b32829e3d34 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:51:27 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:51:27 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:51:28 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:51:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:28 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Took 1.05 seconds to deallocate network for instance.
Nov 15 02:51:28 user nova-compute[75391]: DEBUG nova.compute.manager [req-f00bc459-87c1-4e61-9c8b-620da097aab5 req-0ae949e7-4170-4a47-b0b8-2aa39e93d5f4 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Received event network-vif-deleted-2a223503-a5c6-4851-b555-f4b3c9ce26bf {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:51:28 user nova-compute[75391]: INFO nova.compute.manager [req-f00bc459-87c1-4e61-9c8b-620da097aab5 req-0ae949e7-4170-4a47-b0b8-2aa39e93d5f4 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Neutron deleted interface 2a223503-a5c6-4851-b555-f4b3c9ce26bf; detaching it from the instance and deleting it from the info cache
Nov 15 02:51:28 user nova-compute[75391]: DEBUG nova.network.neutron [req-f00bc459-87c1-4e61-9c8b-620da097aab5 req-0ae949e7-4170-4a47-b0b8-2aa39e93d5f4 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:51:28 user nova-compute[75391]: DEBUG nova.compute.manager [req-f00bc459-87c1-4e61-9c8b-620da097aab5 req-0ae949e7-4170-4a47-b0b8-2aa39e93d5f4 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Detach interface failed, port_id=2a223503-a5c6-4851-b555-f4b3c9ce26bf, reason: Instance a4171d96-bb26-473f-a322-178dadbaab0a could not be found. {{(pid=75391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 02:51:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5ab69343-1596-4655-bb21-8b32829e3d34 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5ab69343-1596-4655-bb21-8b32829e3d34 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:28 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-5ab69343-1596-4655-bb21-8b32829e3d34 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:51:28 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-5ab69343-1596-4655-bb21-8b32829e3d34 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:51:28 user nova-compute[75391]: DEBUG nova.compute.manager [req-bf6437cd-5378-4d78-b022-019ffe5a1f1f req-bbd7d669-902a-449b-b1cc-96d2446a72c5 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Received event network-vif-plugged-2a223503-a5c6-4851-b555-f4b3c9ce26bf {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:51:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bf6437cd-5378-4d78-b022-019ffe5a1f1f req-bbd7d669-902a-449b-b1cc-96d2446a72c5 service nova] Acquiring lock "a4171d96-bb26-473f-a322-178dadbaab0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bf6437cd-5378-4d78-b022-019ffe5a1f1f req-bbd7d669-902a-449b-b1cc-96d2446a72c5 service nova] Lock "a4171d96-bb26-473f-a322-178dadbaab0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bf6437cd-5378-4d78-b022-019ffe5a1f1f req-bbd7d669-902a-449b-b1cc-96d2446a72c5 service nova] Lock "a4171d96-bb26-473f-a322-178dadbaab0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:28 user nova-compute[75391]: DEBUG nova.compute.manager [req-bf6437cd-5378-4d78-b022-019ffe5a1f1f req-bbd7d669-902a-449b-b1cc-96d2446a72c5 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] No waiting events found dispatching network-vif-plugged-2a223503-a5c6-4851-b555-f4b3c9ce26bf {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:51:28 user nova-compute[75391]: WARNING nova.compute.manager [req-bf6437cd-5378-4d78-b022-019ffe5a1f1f req-bbd7d669-902a-449b-b1cc-96d2446a72c5 service nova] [instance: a4171d96-bb26-473f-a322-178dadbaab0a] Received unexpected event network-vif-plugged-2a223503-a5c6-4851-b555-f4b3c9ce26bf for instance with vm_state deleted and task_state None.
Nov 15 02:51:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5ab69343-1596-4655-bb21-8b32829e3d34 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:28 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-5ab69343-1596-4655-bb21-8b32829e3d34 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Deleted allocations for instance a4171d96-bb26-473f-a322-178dadbaab0a
Nov 15 02:51:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5ab69343-1596-4655-bb21-8b32829e3d34 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "a4171d96-bb26-473f-a322-178dadbaab0a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.592s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:31 user nova-compute[75391]: INFO nova.compute.manager [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Detaching volume 48cae43a-b3bd-4e69-b14c-d2104d2065c8
Nov 15 02:51:31 user nova-compute[75391]: INFO nova.virt.block_device [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Attempting to driver detach volume 48cae43a-b3bd-4e69-b14c-d2104d2065c8 from mountpoint /dev/vdb
Nov 15 02:51:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Attempting to detach device vdb from instance da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:51:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:51:31 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:51:31 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 02:51:31 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:51:31 user nova-compute[75391]:   <serial>48cae43a-b3bd-4e69-b14c-d2104d2065c8</serial>
Nov 15 02:51:31 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 02:51:31 user nova-compute[75391]: </disk>
Nov 15 02:51:31 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:51:31 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Successfully detached device vdb from instance da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f from the persistent domain config.
Nov 15 02:51:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 02:51:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:51:31 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:51:31 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 02:51:31 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:51:31 user nova-compute[75391]:   <serial>48cae43a-b3bd-4e69-b14c-d2104d2065c8</serial>
Nov 15 02:51:31 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 02:51:31 user nova-compute[75391]: </disk>
Nov 15 02:51:31 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:51:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 02:51:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:36 user nova-compute[75391]: DEBUG nova.compute.manager [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:51:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:37 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:51:37 user nova-compute[75391]: INFO nova.compute.claims [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Claim successful on node user
Nov 15 02:51:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:37 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:51:37 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:51:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:37 user nova-compute[75391]: DEBUG nova.compute.manager [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:51:37 user nova-compute[75391]: DEBUG nova.compute.manager [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:51:37 user nova-compute[75391]: DEBUG nova.network.neutron [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:51:37 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:51:37 user nova-compute[75391]: DEBUG nova.compute.manager [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:51:37 user nova-compute[75391]: DEBUG nova.policy [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e55cae841f994756843bc97a063ebe86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ec3021653b4209a509852c7a28bf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:51:37 user nova-compute[75391]: DEBUG nova.compute.manager [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:51:37 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:51:37 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Creating image(s)
Nov 15 02:51:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "/opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "/opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "/opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.185s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.175s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk 1073741824" returned: 0 in 0.045s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:38 user nova-compute[75391]: DEBUG nova.network.neutron [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Successfully created port: f81de438-c24a-4cc9-93ab-508fea76d915 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:51:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.175s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:38 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Checking if we can resize image /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:51:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:38 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Cannot resize image /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:51:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:51:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Ensure instance console log exists: /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:51:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:38 user nova-compute[75391]: DEBUG nova.network.neutron [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Successfully updated port: f81de438-c24a-4cc9-93ab-508fea76d915 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:51:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "refresh_cache-341dfd0a-e264-4a6f-9537-35ba9ed980c4" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:51:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquired lock "refresh_cache-341dfd0a-e264-4a6f-9537-35ba9ed980c4" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:51:38 user nova-compute[75391]: DEBUG nova.network.neutron [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:51:38 user nova-compute[75391]: DEBUG nova.compute.manager [req-82e9a7e7-1801-42a4-9e0b-95f54caa153c req-cd67834c-7dbf-4c15-807c-0209f4ea9210 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Received event network-changed-f81de438-c24a-4cc9-93ab-508fea76d915 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:51:38 user nova-compute[75391]: DEBUG nova.compute.manager [req-82e9a7e7-1801-42a4-9e0b-95f54caa153c req-cd67834c-7dbf-4c15-807c-0209f4ea9210 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Refreshing instance network info cache due to event network-changed-f81de438-c24a-4cc9-93ab-508fea76d915. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:51:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-82e9a7e7-1801-42a4-9e0b-95f54caa153c req-cd67834c-7dbf-4c15-807c-0209f4ea9210 service nova] Acquiring lock "refresh_cache-341dfd0a-e264-4a6f-9537-35ba9ed980c4" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:51:38 user nova-compute[75391]: DEBUG nova.network.neutron [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.network.neutron [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Updating instance_info_cache with network_info: [{"id": "f81de438-c24a-4cc9-93ab-508fea76d915", "address": "fa:16:3e:47:1f:19", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81de438-c2", "ovs_interfaceid": "f81de438-c24a-4cc9-93ab-508fea76d915", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Releasing lock "refresh_cache-341dfd0a-e264-4a6f-9537-35ba9ed980c4" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.compute.manager [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Instance network_info: |[{"id": "f81de438-c24a-4cc9-93ab-508fea76d915", "address": "fa:16:3e:47:1f:19", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81de438-c2", "ovs_interfaceid": "f81de438-c24a-4cc9-93ab-508fea76d915", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-82e9a7e7-1801-42a4-9e0b-95f54caa153c req-cd67834c-7dbf-4c15-807c-0209f4ea9210 service nova] Acquired lock "refresh_cache-341dfd0a-e264-4a6f-9537-35ba9ed980c4" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.network.neutron [req-82e9a7e7-1801-42a4-9e0b-95f54caa153c req-cd67834c-7dbf-4c15-807c-0209f4ea9210 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Refreshing network info cache for port f81de438-c24a-4cc9-93ab-508fea76d915 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Start _get_guest_xml network_info=[{"id": "f81de438-c24a-4cc9-93ab-508fea76d915", "address": "fa:16:3e:47:1f:19", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81de438-c2", "ovs_interfaceid": "f81de438-c24a-4cc9-93ab-508fea76d915", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:51:39 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:51:39 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:51:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1537643616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1537643616',id=29,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCu4IfiOZPm3KyuOaYSN4M4+7uOjK/OnaZ7mhQIa6lz/tRN9r5cdTcBKJ4tzvISaaZiS/s0sLlyzlSseEUIXJd+JaUm/xpbxsb+yeAKpEvDCq1oFjmVIJOgsVJAbcyB/w==',key_name='tempest-keypair-1968484645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1ec3021653b4209a509852c7a28bf46',ramdisk_id='',reservation_id='r-mwaawx6j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1315675398',owner_user_name='tempest-AttachVolumeShelveTestJSON-1315675398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:51:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e55cae841f994756843bc97a063ebe86',uuid=341dfd0a-e264-4a6f-9537-35ba9ed980c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f81de438-c24a-4cc9-93ab-508fea76d915", "address": "fa:16:3e:47:1f:19", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81de438-c2", "ovs_interfaceid": "f81de438-c24a-4cc9-93ab-508fea76d915", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Converting VIF {"id": "f81de438-c24a-4cc9-93ab-508fea76d915", "address": "fa:16:3e:47:1f:19", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81de438-c2", "ovs_interfaceid": "f81de438-c24a-4cc9-93ab-508fea76d915", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:1f:19,bridge_name='br-int',has_traffic_filtering=True,id=f81de438-c24a-4cc9-93ab-508fea76d915,network=Network(64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf81de438-c2') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.objects.instance [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lazy-loading 'pci_devices' on Instance uuid 341dfd0a-e264-4a6f-9537-35ba9ed980c4 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:51:39 user nova-compute[75391]:   <uuid>341dfd0a-e264-4a6f-9537-35ba9ed980c4</uuid>
Nov 15 02:51:39 user nova-compute[75391]:   <name>instance-0000001d</name>
Nov 15 02:51:39 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:51:39 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:51:39 user nova-compute[75391]:   <metadata>
Nov 15 02:51:39 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:51:39 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:51:39 user nova-compute[75391]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1537643616</nova:name>
Nov 15 02:51:39 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:51:39</nova:creationTime>
Nov 15 02:51:39 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:51:39 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:51:39 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:51:39 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:51:39 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:51:39 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:51:39 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:51:39 user nova-compute[75391]:       <nova:owner>
Nov 15 02:51:39 user nova-compute[75391]:         <nova:user uuid="e55cae841f994756843bc97a063ebe86">tempest-AttachVolumeShelveTestJSON-1315675398-project-member</nova:user>
Nov 15 02:51:39 user nova-compute[75391]:         <nova:project uuid="f1ec3021653b4209a509852c7a28bf46">tempest-AttachVolumeShelveTestJSON-1315675398</nova:project>
Nov 15 02:51:39 user nova-compute[75391]:       </nova:owner>
Nov 15 02:51:39 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:51:39 user nova-compute[75391]:       <nova:ports>
Nov 15 02:51:39 user nova-compute[75391]:         <nova:port uuid="f81de438-c24a-4cc9-93ab-508fea76d915">
Nov 15 02:51:39 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 02:51:39 user nova-compute[75391]:         </nova:port>
Nov 15 02:51:39 user nova-compute[75391]:       </nova:ports>
Nov 15 02:51:39 user nova-compute[75391]:     </nova:instance>
Nov 15 02:51:39 user nova-compute[75391]:   </metadata>
Nov 15 02:51:39 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:51:39 user nova-compute[75391]:     <system>
Nov 15 02:51:39 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:51:39 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:51:39 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:51:39 user nova-compute[75391]:       <entry name="serial">341dfd0a-e264-4a6f-9537-35ba9ed980c4</entry>
Nov 15 02:51:39 user nova-compute[75391]:       <entry name="uuid">341dfd0a-e264-4a6f-9537-35ba9ed980c4</entry>
Nov 15 02:51:39 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:51:39 user nova-compute[75391]:     </system>
Nov 15 02:51:39 user nova-compute[75391]:   </sysinfo>
Nov 15 02:51:39 user nova-compute[75391]:   <os>
Nov 15 02:51:39 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:51:39 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:51:39 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:51:39 user nova-compute[75391]:   </os>
Nov 15 02:51:39 user nova-compute[75391]:   <features>
Nov 15 02:51:39 user nova-compute[75391]:     <acpi/>
Nov 15 02:51:39 user nova-compute[75391]:     <apic/>
Nov 15 02:51:39 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:51:39 user nova-compute[75391]:   </features>
Nov 15 02:51:39 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:51:39 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:51:39 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:51:39 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:51:39 user nova-compute[75391]:   </clock>
Nov 15 02:51:39 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:51:39 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:51:39 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:51:39 user nova-compute[75391]:   </cpu>
Nov 15 02:51:39 user nova-compute[75391]:   <devices>
Nov 15 02:51:39 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:51:39 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:51:39 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk"/>
Nov 15 02:51:39 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:51:39 user nova-compute[75391]:     </disk>
Nov 15 02:51:39 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:51:39 user nova-compute[75391]:       <mac address="fa:16:3e:47:1f:19"/>
Nov 15 02:51:39 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:51:39 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:51:39 user nova-compute[75391]:       <target dev="tapf81de438-c2"/>
Nov 15 02:51:39 user nova-compute[75391]:     </interface>
Nov 15 02:51:39 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:51:39 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/console.log" append="off"/>
Nov 15 02:51:39 user nova-compute[75391]:     </serial>
Nov 15 02:51:39 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:51:39 user nova-compute[75391]:     <video>
Nov 15 02:51:39 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:51:39 user nova-compute[75391]:     </video>
Nov 15 02:51:39 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:51:39 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:51:39 user nova-compute[75391]:     </rng>
Nov 15 02:51:39 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:51:39 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:51:39 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:51:39 user nova-compute[75391]:     </memballoon>
Nov 15 02:51:39 user nova-compute[75391]:   </devices>
Nov 15 02:51:39 user nova-compute[75391]: </domain>
Nov 15 02:51:39 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:51:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1537643616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1537643616',id=29,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCu4IfiOZPm3KyuOaYSN4M4+7uOjK/OnaZ7mhQIa6lz/tRN9r5cdTcBKJ4tzvISaaZiS/s0sLlyzlSseEUIXJd+JaUm/xpbxsb+yeAKpEvDCq1oFjmVIJOgsVJAbcyB/w==',key_name='tempest-keypair-1968484645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1ec3021653b4209a509852c7a28bf46',ramdisk_id='',reservation_id='r-mwaawx6j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1315675398',owner_user_name='tempest-AttachVolumeShelveTestJSON-1315675398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:51:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e55cae841f994756843bc97a063ebe86',uuid=341dfd0a-e264-4a6f-9537-35ba9ed980c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f81de438-c24a-4cc9-93ab-508fea76d915", "address": "fa:16:3e:47:1f:19", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81de438-c2", "ovs_interfaceid": "f81de438-c24a-4cc9-93ab-508fea76d915", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Converting VIF {"id": "f81de438-c24a-4cc9-93ab-508fea76d915", "address": "fa:16:3e:47:1f:19", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81de438-c2", "ovs_interfaceid": "f81de438-c24a-4cc9-93ab-508fea76d915", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:1f:19,bridge_name='br-int',has_traffic_filtering=True,id=f81de438-c24a-4cc9-93ab-508fea76d915,network=Network(64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf81de438-c2') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG os_vif [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:1f:19,bridge_name='br-int',has_traffic_filtering=True,id=f81de438-c24a-4cc9-93ab-508fea76d915,network=Network(64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf81de438-c2') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd6f2c5a0-e1b6-58de-ac1f-ff9b04265767', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf81de438-c2, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf81de438-c2, col_values=(('qos', UUID('b063b279-3239-4566-909b-3799e46005d7')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf81de438-c2, col_values=(('external_ids', {'iface-id': 'f81de438-c24a-4cc9-93ab-508fea76d915', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:1f:19', 'vm-uuid': '341dfd0a-e264-4a6f-9537-35ba9ed980c4'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:39 user nova-compute[75391]: INFO os_vif [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:1f:19,bridge_name='br-int',has_traffic_filtering=True,id=f81de438-c24a-4cc9-93ab-508fea76d915,network=Network(64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf81de438-c2')
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] No VIF found with MAC fa:16:3e:47:1f:19, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.network.neutron [req-82e9a7e7-1801-42a4-9e0b-95f54caa153c req-cd67834c-7dbf-4c15-807c-0209f4ea9210 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Updated VIF entry in instance network info cache for port f81de438-c24a-4cc9-93ab-508fea76d915. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG nova.network.neutron [req-82e9a7e7-1801-42a4-9e0b-95f54caa153c req-cd67834c-7dbf-4c15-807c-0209f4ea9210 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Updating instance_info_cache with network_info: [{"id": "f81de438-c24a-4cc9-93ab-508fea76d915", "address": "fa:16:3e:47:1f:19", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81de438-c2", "ovs_interfaceid": "f81de438-c24a-4cc9-93ab-508fea76d915", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:51:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-82e9a7e7-1801-42a4-9e0b-95f54caa153c req-cd67834c-7dbf-4c15-807c-0209f4ea9210 service nova] Releasing lock "refresh_cache-341dfd0a-e264-4a6f-9537-35ba9ed980c4" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:51:40 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:40 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:40 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:41 user nova-compute[75391]: DEBUG nova.compute.manager [req-38ea3335-5cf4-4a4d-9199-d306b78bef0b req-3a389c1d-4721-4b3b-8e42-06cf9a3e56f6 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Received event network-vif-plugged-f81de438-c24a-4cc9-93ab-508fea76d915 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:51:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-38ea3335-5cf4-4a4d-9199-d306b78bef0b req-3a389c1d-4721-4b3b-8e42-06cf9a3e56f6 service nova] Acquiring lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-38ea3335-5cf4-4a4d-9199-d306b78bef0b req-3a389c1d-4721-4b3b-8e42-06cf9a3e56f6 service nova] Lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-38ea3335-5cf4-4a4d-9199-d306b78bef0b req-3a389c1d-4721-4b3b-8e42-06cf9a3e56f6 service nova] Lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:41 user nova-compute[75391]: DEBUG nova.compute.manager [req-38ea3335-5cf4-4a4d-9199-d306b78bef0b req-3a389c1d-4721-4b3b-8e42-06cf9a3e56f6 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] No waiting events found dispatching network-vif-plugged-f81de438-c24a-4cc9-93ab-508fea76d915 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:51:41 user nova-compute[75391]: WARNING nova.compute.manager [req-38ea3335-5cf4-4a4d-9199-d306b78bef0b req-3a389c1d-4721-4b3b-8e42-06cf9a3e56f6 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Received unexpected event network-vif-plugged-f81de438-c24a-4cc9-93ab-508fea76d915 for instance with vm_state building and task_state spawning.
Nov 15 02:51:42 user nova-compute[75391]: DEBUG nova.compute.manager [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:51:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:51:42 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Instance spawned successfully.
Nov 15 02:51:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:51:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:51:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:51:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:51:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:51:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:51:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:51:42 user nova-compute[75391]: INFO nova.compute.manager [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 15 02:51:42 user nova-compute[75391]: DEBUG nova.compute.manager [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:51:42 user nova-compute[75391]: INFO nova.compute.manager [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Took 5.88 seconds to build instance.
Nov 15 02:51:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0dc56d36-f080-4c9a-8c96-44b034d1bc60 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.980s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:43 user nova-compute[75391]: DEBUG nova.compute.manager [req-f09b8f91-4754-48f1-9acf-eadeac6c9725 req-b142a3f1-45a8-43fa-b33d-6cc0ef1bb447 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Received event network-vif-plugged-f81de438-c24a-4cc9-93ab-508fea76d915 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:51:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f09b8f91-4754-48f1-9acf-eadeac6c9725 req-b142a3f1-45a8-43fa-b33d-6cc0ef1bb447 service nova] Acquiring lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f09b8f91-4754-48f1-9acf-eadeac6c9725 req-b142a3f1-45a8-43fa-b33d-6cc0ef1bb447 service nova] Lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f09b8f91-4754-48f1-9acf-eadeac6c9725 req-b142a3f1-45a8-43fa-b33d-6cc0ef1bb447 service nova] Lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:43 user nova-compute[75391]: DEBUG nova.compute.manager [req-f09b8f91-4754-48f1-9acf-eadeac6c9725 req-b142a3f1-45a8-43fa-b33d-6cc0ef1bb447 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] No waiting events found dispatching network-vif-plugged-f81de438-c24a-4cc9-93ab-508fea76d915 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:51:43 user nova-compute[75391]: WARNING nova.compute.manager [req-f09b8f91-4754-48f1-9acf-eadeac6c9725 req-b142a3f1-45a8-43fa-b33d-6cc0ef1bb447 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Received unexpected event network-vif-plugged-f81de438-c24a-4cc9-93ab-508fea76d915 for instance with vm_state active and task_state None.
Nov 15 02:51:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-224975c8-51f0-4e39-a41e-dba1fead1cda tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Acquiring lock "fdcb81ad-9c87-408d-abed-9b7cd2a7a646" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-224975c8-51f0-4e39-a41e-dba1fead1cda tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "fdcb81ad-9c87-408d-abed-9b7cd2a7a646" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-224975c8-51f0-4e39-a41e-dba1fead1cda tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Acquiring lock "fdcb81ad-9c87-408d-abed-9b7cd2a7a646-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-224975c8-51f0-4e39-a41e-dba1fead1cda tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "fdcb81ad-9c87-408d-abed-9b7cd2a7a646-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-224975c8-51f0-4e39-a41e-dba1fead1cda tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "fdcb81ad-9c87-408d-abed-9b7cd2a7a646-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:48 user nova-compute[75391]: INFO nova.compute.manager [None req-224975c8-51f0-4e39-a41e-dba1fead1cda tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Terminating instance
Nov 15 02:51:48 user nova-compute[75391]: DEBUG nova.compute.manager [None req-224975c8-51f0-4e39-a41e-dba1fead1cda tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG nova.compute.manager [req-8732e2d7-ae08-4fce-a70e-b28bbc06ffb9 req-257d4c51-a868-4c46-b8db-5dce65888112 service nova] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Received event network-vif-unplugged-7b9c6c03-700b-4dbe-944f-181f69045879 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8732e2d7-ae08-4fce-a70e-b28bbc06ffb9 req-257d4c51-a868-4c46-b8db-5dce65888112 service nova] Acquiring lock "fdcb81ad-9c87-408d-abed-9b7cd2a7a646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8732e2d7-ae08-4fce-a70e-b28bbc06ffb9 req-257d4c51-a868-4c46-b8db-5dce65888112 service nova] Lock "fdcb81ad-9c87-408d-abed-9b7cd2a7a646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8732e2d7-ae08-4fce-a70e-b28bbc06ffb9 req-257d4c51-a868-4c46-b8db-5dce65888112 service nova] Lock "fdcb81ad-9c87-408d-abed-9b7cd2a7a646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG nova.compute.manager [req-8732e2d7-ae08-4fce-a70e-b28bbc06ffb9 req-257d4c51-a868-4c46-b8db-5dce65888112 service nova] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] No waiting events found dispatching network-vif-unplugged-7b9c6c03-700b-4dbe-944f-181f69045879 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG nova.compute.manager [req-8732e2d7-ae08-4fce-a70e-b28bbc06ffb9 req-257d4c51-a868-4c46-b8db-5dce65888112 service nova] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Received event network-vif-unplugged-7b9c6c03-700b-4dbe-944f-181f69045879 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:51:48 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Instance destroyed successfully.
Nov 15 02:51:48 user nova-compute[75391]: DEBUG nova.objects.instance [None req-224975c8-51f0-4e39-a41e-dba1fead1cda tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lazy-loading 'resources' on Instance uuid fdcb81ad-9c87-408d-abed-9b7cd2a7a646 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-224975c8-51f0-4e39-a41e-dba1fead1cda tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:49:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2051821792',display_name='tempest-VolumesActionsTest-instance-2051821792',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2051821792',id=24,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:50:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='238e9fdacbfe47c7bdd8c638872c6ca2',ramdisk_id='',reservation_id='r-oa5t10hh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-712553389',owner_user_name='tempest-VolumesActionsTest-712553389-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:50:04Z,user_data=None,user_id='6725c61101204b09be4fd561231c4123',uuid=fdcb81ad-9c87-408d-abed-9b7cd2a7a646,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b9c6c03-700b-4dbe-944f-181f69045879", "address": "fa:16:3e:80:9f:9a", "network": {"id": "fe3b43e0-6135-45f0-97ec-8b2af5fa26fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1391931283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "238e9fdacbfe47c7bdd8c638872c6ca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9c6c03-70", "ovs_interfaceid": "7b9c6c03-700b-4dbe-944f-181f69045879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-224975c8-51f0-4e39-a41e-dba1fead1cda tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Converting VIF {"id": "7b9c6c03-700b-4dbe-944f-181f69045879", "address": "fa:16:3e:80:9f:9a", "network": {"id": "fe3b43e0-6135-45f0-97ec-8b2af5fa26fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1391931283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "238e9fdacbfe47c7bdd8c638872c6ca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9c6c03-70", "ovs_interfaceid": "7b9c6c03-700b-4dbe-944f-181f69045879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-224975c8-51f0-4e39-a41e-dba1fead1cda tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:9f:9a,bridge_name='br-int',has_traffic_filtering=True,id=7b9c6c03-700b-4dbe-944f-181f69045879,network=Network(fe3b43e0-6135-45f0-97ec-8b2af5fa26fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b9c6c03-70') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG os_vif [None req-224975c8-51f0-4e39-a41e-dba1fead1cda tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:9f:9a,bridge_name='br-int',has_traffic_filtering=True,id=7b9c6c03-700b-4dbe-944f-181f69045879,network=Network(fe3b43e0-6135-45f0-97ec-8b2af5fa26fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b9c6c03-70') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b9c6c03-70, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=921033d9-517d-4311-a686-016b61b6264c) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:48 user nova-compute[75391]: INFO os_vif [None req-224975c8-51f0-4e39-a41e-dba1fead1cda tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:9f:9a,bridge_name='br-int',has_traffic_filtering=True,id=7b9c6c03-700b-4dbe-944f-181f69045879,network=Network(fe3b43e0-6135-45f0-97ec-8b2af5fa26fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b9c6c03-70')
Nov 15 02:51:48 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-224975c8-51f0-4e39-a41e-dba1fead1cda tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Deleting instance files /opt/stack/data/nova/instances/fdcb81ad-9c87-408d-abed-9b7cd2a7a646_del
Nov 15 02:51:48 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-224975c8-51f0-4e39-a41e-dba1fead1cda tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Deletion of /opt/stack/data/nova/instances/fdcb81ad-9c87-408d-abed-9b7cd2a7a646_del complete
Nov 15 02:51:48 user nova-compute[75391]: INFO nova.compute.manager [None req-224975c8-51f0-4e39-a41e-dba1fead1cda tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 15 02:51:48 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-224975c8-51f0-4e39-a41e-dba1fead1cda tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:51:48 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:51:49 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:51:49 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Took 0.38 seconds to deallocate network for instance.
Nov 15 02:51:49 user nova-compute[75391]: DEBUG nova.compute.manager [req-5e4d7956-4466-4faa-8e98-c9808c34e307 req-7e2b1dd7-c5b9-44a0-b3dc-8a233773acff service nova] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Received event network-vif-deleted-7b9c6c03-700b-4dbe-944f-181f69045879 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:51:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-224975c8-51f0-4e39-a41e-dba1fead1cda tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-224975c8-51f0-4e39-a41e-dba1fead1cda tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:49 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-224975c8-51f0-4e39-a41e-dba1fead1cda tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:51:49 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-224975c8-51f0-4e39-a41e-dba1fead1cda tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:51:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-224975c8-51f0-4e39-a41e-dba1fead1cda tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:49 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-224975c8-51f0-4e39-a41e-dba1fead1cda tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Deleted allocations for instance fdcb81ad-9c87-408d-abed-9b7cd2a7a646
Nov 15 02:51:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-224975c8-51f0-4e39-a41e-dba1fead1cda tempest-VolumesActionsTest-712553389 tempest-VolumesActionsTest-712553389-project-member] Lock "fdcb81ad-9c87-408d-abed-9b7cd2a7a646" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.549s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:50 user nova-compute[75391]: DEBUG nova.compute.manager [req-44130baf-0d27-4aff-a8f7-d352a2cf7ca1 req-66640062-8947-43c4-ad62-024d6052b99f service nova] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Received event network-vif-plugged-7b9c6c03-700b-4dbe-944f-181f69045879 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:51:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-44130baf-0d27-4aff-a8f7-d352a2cf7ca1 req-66640062-8947-43c4-ad62-024d6052b99f service nova] Acquiring lock "fdcb81ad-9c87-408d-abed-9b7cd2a7a646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-44130baf-0d27-4aff-a8f7-d352a2cf7ca1 req-66640062-8947-43c4-ad62-024d6052b99f service nova] Lock "fdcb81ad-9c87-408d-abed-9b7cd2a7a646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-44130baf-0d27-4aff-a8f7-d352a2cf7ca1 req-66640062-8947-43c4-ad62-024d6052b99f service nova] Lock "fdcb81ad-9c87-408d-abed-9b7cd2a7a646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:50 user nova-compute[75391]: DEBUG nova.compute.manager [req-44130baf-0d27-4aff-a8f7-d352a2cf7ca1 req-66640062-8947-43c4-ad62-024d6052b99f service nova] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] No waiting events found dispatching network-vif-plugged-7b9c6c03-700b-4dbe-944f-181f69045879 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:51:50 user nova-compute[75391]: WARNING nova.compute.manager [req-44130baf-0d27-4aff-a8f7-d352a2cf7ca1 req-66640062-8947-43c4-ad62-024d6052b99f service nova] [instance: fdcb81ad-9c87-408d-abed-9b7cd2a7a646] Received unexpected event network-vif-plugged-7b9c6c03-700b-4dbe-944f-181f69045879 for instance with vm_state deleted and task_state None.
Nov 15 02:51:51 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f is timed out.
Nov 15 02:51:51 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Successfully detached device vdb from instance da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f from the live domain config.
Nov 15 02:51:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:51:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GxWsSnDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:51:51 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:51:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:51:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:51:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[30077185-7a43-433c-a7f8-be9e2a631a61]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:51:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:51:51 user nova-compute[75391]: No targets found.
Nov 15 02:51:51 user nova-compute[75391]: iSNS:
Nov 15 02:51:51 user nova-compute[75391]: No targets found.
Nov 15 02:51:51 user nova-compute[75391]: STATIC:
Nov 15 02:51:51 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8
Nov 15 02:51:51 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:51:51 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:51:51 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0
Nov 15 02:51:51 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:51:51 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:51:51 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:51:51 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:51:51 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:51:51 user nova-compute[75391]: FIRMWARE:
Nov 15 02:51:51 user nova-compute[75391]: No targets found.
Nov 15 02:51:51 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:51:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:51:51 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:51:51 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:51:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:51:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68380e0-e03a-4935-911d-577e7142d412]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:51:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59d0d32-3c5d-4403-b600-43ddbc458881]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:51:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:51:51 user nova-compute[75391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:51:51 user nova-compute[75391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 (non-flash)
Nov 15 02:51:51 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:51:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:51:51 user nova-compute[75391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 (non-flash)
Nov 15 02:51:51 user nova-compute[75391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 (non-flash)
Nov 15 02:51:51 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:51:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f623c13a950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8'): ({'sdb'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:51:51 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Removing single pathed devices sdb {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:51:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bada7a8a-a514-4475-af57-f19ee92f3cdb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7e8b1e-f0d5-4e6a-ab66-90f4ef4ba590]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Flushing IO for device /dev/sdb {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f8daa7-fc4d-479b-863e-34924fdc6f76]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.070s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1085e85a-9fe7-4357-be7f-32942219d646]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b00fc51-92a7-4b33-ba3c-dbc3a6a3fb20]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe1f2d1-ede6-4c67-9824-d84335b6d026]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8, portal: 172.16.0.220,3260]
Nov 15 02:51:52 user nova-compute[75391]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8, portal: 172.16.0.220,3260] successful.
Nov 15 02:51:52 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cae43a-b3bd-4e69-b14c-d2104d2065c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d173fbf6-0829-43c9-8bfd-72cb1ea4faf2]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] <== disconnect_volume: return (325ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:51:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:51:53 user nova-compute[75391]: DEBUG nova.objects.instance [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'flavor' on Instance uuid da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:51:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2f0eeb35-4c2e-426e-93a2-c014d0938418 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.746s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d6a363fb-3b8f-4784-8b22-2cf5b7becaf1 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d6a363fb-3b8f-4784-8b22-2cf5b7becaf1 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:53 user nova-compute[75391]: DEBUG nova.compute.manager [None req-d6a363fb-3b8f-4784-8b22-2cf5b7becaf1 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:51:53 user nova-compute[75391]: DEBUG nova.compute.manager [None req-d6a363fb-3b8f-4784-8b22-2cf5b7becaf1 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75391) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 15 02:51:53 user nova-compute[75391]: DEBUG nova.objects.instance [None req-d6a363fb-3b8f-4784-8b22-2cf5b7becaf1 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'flavor' on Instance uuid da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:51:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:54 user nova-compute[75391]: DEBUG nova.compute.manager [req-904d1a0a-e87b-48f9-98b2-e7940f4d03da req-b02dc318-1e55-47f5-9e48-03e282dec05a service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received event network-vif-unplugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:51:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-904d1a0a-e87b-48f9-98b2-e7940f4d03da req-b02dc318-1e55-47f5-9e48-03e282dec05a service nova] Acquiring lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-904d1a0a-e87b-48f9-98b2-e7940f4d03da req-b02dc318-1e55-47f5-9e48-03e282dec05a service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-904d1a0a-e87b-48f9-98b2-e7940f4d03da req-b02dc318-1e55-47f5-9e48-03e282dec05a service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:54 user nova-compute[75391]: DEBUG nova.compute.manager [req-904d1a0a-e87b-48f9-98b2-e7940f4d03da req-b02dc318-1e55-47f5-9e48-03e282dec05a service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] No waiting events found dispatching network-vif-unplugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:51:54 user nova-compute[75391]: WARNING nova.compute.manager [req-904d1a0a-e87b-48f9-98b2-e7940f4d03da req-b02dc318-1e55-47f5-9e48-03e282dec05a service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received unexpected event network-vif-unplugged-f3eff2a5-1256-4a92-969a-62aca65b7452 for instance with vm_state active and task_state powering-off.
Nov 15 02:51:54 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Instance destroyed successfully.
Nov 15 02:51:54 user nova-compute[75391]: DEBUG nova.compute.manager [None req-d6a363fb-3b8f-4784-8b22-2cf5b7becaf1 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:51:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d6a363fb-3b8f-4784-8b22-2cf5b7becaf1 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.860s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:56 user nova-compute[75391]: DEBUG nova.compute.manager [req-7598244a-e1a4-41ed-922b-724fb1df7fd6 req-95739c3a-819d-4da2-8347-e97fd8ccb4f8 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received event network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:51:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7598244a-e1a4-41ed-922b-724fb1df7fd6 req-95739c3a-819d-4da2-8347-e97fd8ccb4f8 service nova] Acquiring lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:51:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7598244a-e1a4-41ed-922b-724fb1df7fd6 req-95739c3a-819d-4da2-8347-e97fd8ccb4f8 service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:51:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7598244a-e1a4-41ed-922b-724fb1df7fd6 req-95739c3a-819d-4da2-8347-e97fd8ccb4f8 service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:51:56 user nova-compute[75391]: DEBUG nova.compute.manager [req-7598244a-e1a4-41ed-922b-724fb1df7fd6 req-95739c3a-819d-4da2-8347-e97fd8ccb4f8 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] No waiting events found dispatching network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:51:56 user nova-compute[75391]: WARNING nova.compute.manager [req-7598244a-e1a4-41ed-922b-724fb1df7fd6 req-95739c3a-819d-4da2-8347-e97fd8ccb4f8 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received unexpected event network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 for instance with vm_state stopped and task_state None.
Nov 15 02:51:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:51:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:01 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:52:01 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:52:01 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:52:01 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:52:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:52:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:52:01 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 02:52:01 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Updating instance_info_cache with network_info: [{"id": "f3eff2a5-1256-4a92-969a-62aca65b7452", "address": "fa:16:3e:1d:2d:fe", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eff2a5-12", "ovs_interfaceid": "f3eff2a5-1256-4a92-969a-62aca65b7452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:52:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:52:01 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 02:52:01 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:52:01 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:52:01 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:52:01 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:52:01 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:52:01 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:52:01 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:52:01 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:52:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:52:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:52:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:52:01 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:52:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dd99dea-60d3-4eed-86c7-8d9d0522ae84/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dd99dea-60d3-4eed-86c7-8d9d0522ae84/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dd99dea-60d3-4eed-86c7-8d9d0522ae84/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dd99dea-60d3-4eed-86c7-8d9d0522ae84/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:52:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:52:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:05 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:52:05 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:52:05 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=7546MB free_disk=25.02161407470703GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:52:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:52:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:52:05 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9744c8a1-046e-4a00-92e0-92ebb3275ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:52:05 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance fc9484c0-9083-4797-8ab1-2ad392822ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:52:05 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6400a5f3-0ec9-4484-930c-1f5061ae5374 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:52:05 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:52:05 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 4ab2dd85-9758-4ea9-8282-9396a2653393 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:52:05 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance d36e2f64-11cb-4b35-8471-9a4df7f4c227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:52:05 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9909ae6b-7900-4f71-8900-2bf25185e436 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:52:05 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 7bd332f2-0f74-4a43-96a2-2322b6cbf982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:52:05 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 4dd99dea-60d3-4eed-86c7-8d9d0522ae84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:52:05 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 341dfd0a-e264-4a6f-9537-35ba9ed980c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:52:05 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:52:05 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:52:06 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:52:06 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:52:06 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:52:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:52:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:12 user nova-compute[75391]: DEBUG nova.compute.manager [None req-56948026-9f40-4dfc-b0e8-a8e044e33b6d tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:52:12 user nova-compute[75391]: INFO nova.compute.manager [None req-56948026-9f40-4dfc-b0e8-a8e044e33b6d tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] instance snapshotting
Nov 15 02:52:12 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-56948026-9f40-4dfc-b0e8-a8e044e33b6d tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Beginning live snapshot process
Nov 15 02:52:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-56948026-9f40-4dfc-b0e8-a8e044e33b6d tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json -f qcow2 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-56948026-9f40-4dfc-b0e8-a8e044e33b6d tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-56948026-9f40-4dfc-b0e8-a8e044e33b6d tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json -f qcow2 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-56948026-9f40-4dfc-b0e8-a8e044e33b6d tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-56948026-9f40-4dfc-b0e8-a8e044e33b6d tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-56948026-9f40-4dfc-b0e8-a8e044e33b6d tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.173s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-56948026-9f40-4dfc-b0e8-a8e044e33b6d tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmputq75u13/51efb9fc63494dd0ae23d07601558768.delta 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-56948026-9f40-4dfc-b0e8-a8e044e33b6d tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmputq75u13/51efb9fc63494dd0ae23d07601558768.delta 1073741824" returned: 0 in 0.050s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:13 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-56948026-9f40-4dfc-b0e8-a8e044e33b6d tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 02:52:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-56948026-9f40-4dfc-b0e8-a8e044e33b6d tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 02:52:15 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-56948026-9f40-4dfc-b0e8-a8e044e33b6d tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 02:52:15 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-56948026-9f40-4dfc-b0e8-a8e044e33b6d tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 02:52:15 user nova-compute[75391]: DEBUG nova.privsep.utils [None req-56948026-9f40-4dfc-b0e8-a8e044e33b6d tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 02:52:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-56948026-9f40-4dfc-b0e8-a8e044e33b6d tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmputq75u13/51efb9fc63494dd0ae23d07601558768.delta /opt/stack/data/nova/instances/snapshots/tmputq75u13/51efb9fc63494dd0ae23d07601558768 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-56948026-9f40-4dfc-b0e8-a8e044e33b6d tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmputq75u13/51efb9fc63494dd0ae23d07601558768.delta /opt/stack/data/nova/instances/snapshots/tmputq75u13/51efb9fc63494dd0ae23d07601558768" returned: 0 in 0.363s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:15 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-56948026-9f40-4dfc-b0e8-a8e044e33b6d tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Snapshot extracted, beginning image upload
Nov 15 02:52:17 user nova-compute[75391]: INFO nova.compute.manager [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Rescuing
Nov 15 02:52:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "refresh_cache-7bd332f2-0f74-4a43-96a2-2322b6cbf982" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:52:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquired lock "refresh_cache-7bd332f2-0f74-4a43-96a2-2322b6cbf982" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:52:17 user nova-compute[75391]: DEBUG nova.network.neutron [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:52:17 user nova-compute[75391]: DEBUG nova.network.neutron [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Updating instance_info_cache with network_info: [{"id": "5ef68714-0fbe-470d-b208-7d482f023640", "address": "fa:16:3e:0f:8e:b7", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef68714-0f", "ovs_interfaceid": "5ef68714-0fbe-470d-b208-7d482f023640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:52:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Releasing lock "refresh_cache-7bd332f2-0f74-4a43-96a2-2322b6cbf982" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:52:17 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:17 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:18 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-56948026-9f40-4dfc-b0e8-a8e044e33b6d tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Snapshot image upload complete
Nov 15 02:52:18 user nova-compute[75391]: INFO nova.compute.manager [None req-56948026-9f40-4dfc-b0e8-a8e044e33b6d tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Took 5.40 seconds to snapshot the instance on the hypervisor.
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.compute.manager [req-1562d2fb-483e-4584-9ef2-bf963a03bc44 req-0485f70e-5d5a-4d67-9d22-bccb7bab2908 service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Received event network-vif-unplugged-5ef68714-0fbe-470d-b208-7d482f023640 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1562d2fb-483e-4584-9ef2-bf963a03bc44 req-0485f70e-5d5a-4d67-9d22-bccb7bab2908 service nova] Acquiring lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1562d2fb-483e-4584-9ef2-bf963a03bc44 req-0485f70e-5d5a-4d67-9d22-bccb7bab2908 service nova] Lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1562d2fb-483e-4584-9ef2-bf963a03bc44 req-0485f70e-5d5a-4d67-9d22-bccb7bab2908 service nova] Lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.compute.manager [req-1562d2fb-483e-4584-9ef2-bf963a03bc44 req-0485f70e-5d5a-4d67-9d22-bccb7bab2908 service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] No waiting events found dispatching network-vif-unplugged-5ef68714-0fbe-470d-b208-7d482f023640 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:52:18 user nova-compute[75391]: WARNING nova.compute.manager [req-1562d2fb-483e-4584-9ef2-bf963a03bc44 req-0485f70e-5d5a-4d67-9d22-bccb7bab2908 service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Received unexpected event network-vif-unplugged-5ef68714-0fbe-470d-b208-7d482f023640 for instance with vm_state active and task_state rescuing.
Nov 15 02:52:18 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Instance destroyed successfully.
Nov 15 02:52:18 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Attempting rescue
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75391) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Instance directory exists: not creating {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 02:52:18 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Creating image(s)
Nov 15 02:52:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "/opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "/opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "/opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.objects.instance [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7bd332f2-0f74-4a43-96a2-2322b6cbf982 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.175s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue" returned: 0 in 0.051s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.objects.instance [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'migration_context' on Instance uuid 7bd332f2-0f74-4a43-96a2-2322b6cbf982 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.objects.base [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Object Instance<7bd332f2-0f74-4a43-96a2-2322b6cbf982> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Start _get_guest_xml network_info=[{"id": "5ef68714-0fbe-470d-b208-7d482f023640", "address": "fa:16:3e:0f:8e:b7", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "vif_mac": "fa:16:3e:0f:8e:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef68714-0f", "ovs_interfaceid": "5ef68714-0fbe-470d-b208-7d482f023640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.objects.instance [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'resources' on Instance uuid 7bd332f2-0f74-4a43-96a2-2322b6cbf982 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.objects.base [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Object Instance<7bd332f2-0f74-4a43-96a2-2322b6cbf982> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.objects.instance [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'numa_topology' on Instance uuid 7bd332f2-0f74-4a43-96a2-2322b6cbf982 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.objects.base [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Object Instance<7bd332f2-0f74-4a43-96a2-2322b6cbf982> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:52:18 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:52:18 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.objects.instance [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7bd332f2-0f74-4a43-96a2-2322b6cbf982 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.objects.base [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Object Instance<7bd332f2-0f74-4a43-96a2-2322b6cbf982> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-411570943',display_name='tempest-ServerRescueNegativeTestJSON-server-411570943',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-411570943',id=27,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:50:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8bfe79a4e16f4fa89437bcc50fc4b356',ramdisk_id='',reservation_id='r-9ge07iwt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-388649299',owner_user_name='tempest-ServerRescueNegativeTestJSON-388649299-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:50:36Z,user_data=None,user_id='9b3fc7a83f6c4c5baa7621163e9f62aa',uuid=7bd332f2-0f74-4a43-96a2-2322b6cbf982,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ef68714-0fbe-470d-b208-7d482f023640", "address": "fa:16:3e:0f:8e:b7", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "vif_mac": "fa:16:3e:0f:8e:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef68714-0f", "ovs_interfaceid": "5ef68714-0fbe-470d-b208-7d482f023640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Converting VIF {"id": "5ef68714-0fbe-470d-b208-7d482f023640", "address": "fa:16:3e:0f:8e:b7", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "vif_mac": "fa:16:3e:0f:8e:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef68714-0f", "ovs_interfaceid": "5ef68714-0fbe-470d-b208-7d482f023640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:8e:b7,bridge_name='br-int',has_traffic_filtering=True,id=5ef68714-0fbe-470d-b208-7d482f023640,network=Network(079437cd-2e7d-40ea-98c0-24a1c9091aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef68714-0f') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.objects.instance [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'pci_devices' on Instance uuid 7bd332f2-0f74-4a43-96a2-2322b6cbf982 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.objects.base [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Object Instance<7bd332f2-0f74-4a43-96a2-2322b6cbf982> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:52:18 user nova-compute[75391]:   <uuid>7bd332f2-0f74-4a43-96a2-2322b6cbf982</uuid>
Nov 15 02:52:18 user nova-compute[75391]:   <name>instance-0000001b</name>
Nov 15 02:52:18 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:52:18 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:52:18 user nova-compute[75391]:   <metadata>
Nov 15 02:52:18 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:52:18 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:52:18 user nova-compute[75391]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-411570943</nova:name>
Nov 15 02:52:18 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:52:18</nova:creationTime>
Nov 15 02:52:18 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:52:18 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:52:18 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:52:18 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:52:18 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:52:18 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:52:18 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:52:18 user nova-compute[75391]:       <nova:owner>
Nov 15 02:52:18 user nova-compute[75391]:         <nova:user uuid="9b3fc7a83f6c4c5baa7621163e9f62aa">tempest-ServerRescueNegativeTestJSON-388649299-project-member</nova:user>
Nov 15 02:52:18 user nova-compute[75391]:         <nova:project uuid="8bfe79a4e16f4fa89437bcc50fc4b356">tempest-ServerRescueNegativeTestJSON-388649299</nova:project>
Nov 15 02:52:18 user nova-compute[75391]:       </nova:owner>
Nov 15 02:52:18 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:52:18 user nova-compute[75391]:       <nova:ports>
Nov 15 02:52:18 user nova-compute[75391]:         <nova:port uuid="5ef68714-0fbe-470d-b208-7d482f023640">
Nov 15 02:52:18 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 02:52:18 user nova-compute[75391]:         </nova:port>
Nov 15 02:52:18 user nova-compute[75391]:       </nova:ports>
Nov 15 02:52:18 user nova-compute[75391]:     </nova:instance>
Nov 15 02:52:18 user nova-compute[75391]:   </metadata>
Nov 15 02:52:18 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:52:18 user nova-compute[75391]:     <system>
Nov 15 02:52:18 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:52:18 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:52:18 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:52:18 user nova-compute[75391]:       <entry name="serial">7bd332f2-0f74-4a43-96a2-2322b6cbf982</entry>
Nov 15 02:52:18 user nova-compute[75391]:       <entry name="uuid">7bd332f2-0f74-4a43-96a2-2322b6cbf982</entry>
Nov 15 02:52:18 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:52:18 user nova-compute[75391]:     </system>
Nov 15 02:52:18 user nova-compute[75391]:   </sysinfo>
Nov 15 02:52:18 user nova-compute[75391]:   <os>
Nov 15 02:52:18 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:52:18 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:52:18 user nova-compute[75391]:   </os>
Nov 15 02:52:18 user nova-compute[75391]:   <features>
Nov 15 02:52:18 user nova-compute[75391]:     <acpi/>
Nov 15 02:52:18 user nova-compute[75391]:     <apic/>
Nov 15 02:52:18 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:52:18 user nova-compute[75391]:   </features>
Nov 15 02:52:18 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:52:18 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:52:18 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:52:18 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:52:18 user nova-compute[75391]:   </clock>
Nov 15 02:52:18 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:52:18 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:52:18 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:52:18 user nova-compute[75391]:   </cpu>
Nov 15 02:52:18 user nova-compute[75391]:   <devices>
Nov 15 02:52:18 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:52:18 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:52:18 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue"/>
Nov 15 02:52:18 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:52:18 user nova-compute[75391]:     </disk>
Nov 15 02:52:18 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:52:18 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:52:18 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk"/>
Nov 15 02:52:18 user nova-compute[75391]:       <target dev="vdb" bus="virtio"/>
Nov 15 02:52:18 user nova-compute[75391]:     </disk>
Nov 15 02:52:18 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:52:18 user nova-compute[75391]:       <mac address="fa:16:3e:0f:8e:b7"/>
Nov 15 02:52:18 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:52:18 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:52:18 user nova-compute[75391]:       <target dev="tap5ef68714-0f"/>
Nov 15 02:52:18 user nova-compute[75391]:     </interface>
Nov 15 02:52:18 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:52:18 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/console.log" append="off"/>
Nov 15 02:52:18 user nova-compute[75391]:     </serial>
Nov 15 02:52:18 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:52:18 user nova-compute[75391]:     <video>
Nov 15 02:52:18 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:52:18 user nova-compute[75391]:     </video>
Nov 15 02:52:18 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:52:18 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:52:18 user nova-compute[75391]:     </rng>
Nov 15 02:52:18 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:52:18 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:52:18 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:52:18 user nova-compute[75391]:     </memballoon>
Nov 15 02:52:18 user nova-compute[75391]:   </devices>
Nov 15 02:52:18 user nova-compute[75391]: </domain>
Nov 15 02:52:18 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:52:18 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Instance destroyed successfully.
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:52:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] No VIF found with MAC fa:16:3e:0f:8e:b7, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:52:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:20 user nova-compute[75391]: DEBUG nova.compute.manager [req-28e8b283-d665-439a-b873-50a57b5bc807 req-5074be65-cab4-4ade-9151-441c72440251 service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Received event network-vif-plugged-5ef68714-0fbe-470d-b208-7d482f023640 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:52:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-28e8b283-d665-439a-b873-50a57b5bc807 req-5074be65-cab4-4ade-9151-441c72440251 service nova] Acquiring lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:52:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-28e8b283-d665-439a-b873-50a57b5bc807 req-5074be65-cab4-4ade-9151-441c72440251 service nova] Lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:52:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-28e8b283-d665-439a-b873-50a57b5bc807 req-5074be65-cab4-4ade-9151-441c72440251 service nova] Lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:52:20 user nova-compute[75391]: DEBUG nova.compute.manager [req-28e8b283-d665-439a-b873-50a57b5bc807 req-5074be65-cab4-4ade-9151-441c72440251 service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] No waiting events found dispatching network-vif-plugged-5ef68714-0fbe-470d-b208-7d482f023640 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:52:20 user nova-compute[75391]: WARNING nova.compute.manager [req-28e8b283-d665-439a-b873-50a57b5bc807 req-5074be65-cab4-4ade-9151-441c72440251 service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Received unexpected event network-vif-plugged-5ef68714-0fbe-470d-b208-7d482f023640 for instance with vm_state active and task_state rescuing.
Nov 15 02:52:20 user nova-compute[75391]: DEBUG nova.compute.manager [req-28e8b283-d665-439a-b873-50a57b5bc807 req-5074be65-cab4-4ade-9151-441c72440251 service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Received event network-vif-plugged-5ef68714-0fbe-470d-b208-7d482f023640 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:52:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-28e8b283-d665-439a-b873-50a57b5bc807 req-5074be65-cab4-4ade-9151-441c72440251 service nova] Acquiring lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:52:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-28e8b283-d665-439a-b873-50a57b5bc807 req-5074be65-cab4-4ade-9151-441c72440251 service nova] Lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:52:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-28e8b283-d665-439a-b873-50a57b5bc807 req-5074be65-cab4-4ade-9151-441c72440251 service nova] Lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:52:20 user nova-compute[75391]: DEBUG nova.compute.manager [req-28e8b283-d665-439a-b873-50a57b5bc807 req-5074be65-cab4-4ade-9151-441c72440251 service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] No waiting events found dispatching network-vif-plugged-5ef68714-0fbe-470d-b208-7d482f023640 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:52:20 user nova-compute[75391]: WARNING nova.compute.manager [req-28e8b283-d665-439a-b873-50a57b5bc807 req-5074be65-cab4-4ade-9151-441c72440251 service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Received unexpected event network-vif-plugged-5ef68714-0fbe-470d-b208-7d482f023640 for instance with vm_state active and task_state rescuing.
Nov 15 02:52:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:22 user nova-compute[75391]: DEBUG nova.compute.manager [None req-efaa5e9b-6b6c-48ad-9784-3b4e9adf6e33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:52:22 user nova-compute[75391]: DEBUG nova.compute.manager [req-af19715b-10e6-4a76-bb93-19de6fe64af5 req-c5443e12-257d-4128-8e16-fbe34e0fbb1e service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Received event network-vif-plugged-5ef68714-0fbe-470d-b208-7d482f023640 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:52:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-af19715b-10e6-4a76-bb93-19de6fe64af5 req-c5443e12-257d-4128-8e16-fbe34e0fbb1e service nova] Acquiring lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:52:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-af19715b-10e6-4a76-bb93-19de6fe64af5 req-c5443e12-257d-4128-8e16-fbe34e0fbb1e service nova] Lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:52:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-af19715b-10e6-4a76-bb93-19de6fe64af5 req-c5443e12-257d-4128-8e16-fbe34e0fbb1e service nova] Lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:52:22 user nova-compute[75391]: DEBUG nova.compute.manager [req-af19715b-10e6-4a76-bb93-19de6fe64af5 req-c5443e12-257d-4128-8e16-fbe34e0fbb1e service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] No waiting events found dispatching network-vif-plugged-5ef68714-0fbe-470d-b208-7d482f023640 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:52:22 user nova-compute[75391]: WARNING nova.compute.manager [req-af19715b-10e6-4a76-bb93-19de6fe64af5 req-c5443e12-257d-4128-8e16-fbe34e0fbb1e service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Received unexpected event network-vif-plugged-5ef68714-0fbe-470d-b208-7d482f023640 for instance with vm_state rescued and task_state None.
Nov 15 02:52:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:52:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:52:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 02:52:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:52:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:52:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:52:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 02:52:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:52:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:52:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:37 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:52:37 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 02:52:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:40 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:47 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:52:47 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:52:47 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Didn't find any instances for network info cache update. {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 02:52:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:48 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:52:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:52:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:52:50 user nova-compute[75391]: DEBUG nova.compute.manager [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:52:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:52:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:52:50 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:52:50 user nova-compute[75391]: INFO nova.compute.claims [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Claim successful on node user
Nov 15 02:52:50 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:52:50 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:52:50 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:52:50 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:52:50 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:52:50 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Cleaning up deleted instances {{(pid=75391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 02:52:50 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] There are 0 instances to clean {{(pid=75391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 02:52:50 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:52:50 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:52:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:52:50 user nova-compute[75391]: DEBUG nova.compute.manager [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:52:50 user nova-compute[75391]: DEBUG nova.compute.manager [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:52:50 user nova-compute[75391]: DEBUG nova.network.neutron [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:52:51 user nova-compute[75391]: DEBUG nova.policy [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6e16cdc87db540ef820be3233d3e3595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342f25269fc44ec2bb9f07a38aa70cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:52:51 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:52:51 user nova-compute[75391]: DEBUG nova.compute.manager [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:52:51 user nova-compute[75391]: DEBUG nova.compute.manager [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:52:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:52:51 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Creating image(s)
Nov 15 02:52:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "/opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:52:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "/opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:52:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "/opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:52:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.182s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:52:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:52:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.209s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:51 user nova-compute[75391]: DEBUG nova.network.neutron [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Successfully created port: 84041b89-25ff-4498-87ba-c2ab0b5aa876 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:52:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk 1073741824" returned: 0 in 0.049s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:52:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.197s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:51 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:52:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Cannot resize image /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Ensure instance console log exists: /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.network.neutron [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Successfully updated port: 84041b89-25ff-4498-87ba-c2ab0b5aa876 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "refresh_cache-28a1ec10-2748-4d0c-9b73-9636fc1cc237" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquired lock "refresh_cache-28a1ec10-2748-4d0c-9b73-9636fc1cc237" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.network.neutron [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.network.neutron [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.compute.manager [req-a1ba1aa6-c0f9-467b-8f87-931601b13b2e req-b348160f-46a0-40b9-b91a-0f8b0ba45f1d service nova] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Received event network-changed-84041b89-25ff-4498-87ba-c2ab0b5aa876 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.compute.manager [req-a1ba1aa6-c0f9-467b-8f87-931601b13b2e req-b348160f-46a0-40b9-b91a-0f8b0ba45f1d service nova] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Refreshing instance network info cache due to event network-changed-84041b89-25ff-4498-87ba-c2ab0b5aa876. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a1ba1aa6-c0f9-467b-8f87-931601b13b2e req-b348160f-46a0-40b9-b91a-0f8b0ba45f1d service nova] Acquiring lock "refresh_cache-28a1ec10-2748-4d0c-9b73-9636fc1cc237" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.network.neutron [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Updating instance_info_cache with network_info: [{"id": "84041b89-25ff-4498-87ba-c2ab0b5aa876", "address": "fa:16:3e:ef:5f:d5", "network": {"id": "ad0220e2-671c-40cc-8b2f-bda8d6f6fca5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-319455103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "342f25269fc44ec2bb9f07a38aa70cd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84041b89-25", "ovs_interfaceid": "84041b89-25ff-4498-87ba-c2ab0b5aa876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Releasing lock "refresh_cache-28a1ec10-2748-4d0c-9b73-9636fc1cc237" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.compute.manager [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Instance network_info: |[{"id": "84041b89-25ff-4498-87ba-c2ab0b5aa876", "address": "fa:16:3e:ef:5f:d5", "network": {"id": "ad0220e2-671c-40cc-8b2f-bda8d6f6fca5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-319455103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "342f25269fc44ec2bb9f07a38aa70cd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84041b89-25", "ovs_interfaceid": "84041b89-25ff-4498-87ba-c2ab0b5aa876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a1ba1aa6-c0f9-467b-8f87-931601b13b2e req-b348160f-46a0-40b9-b91a-0f8b0ba45f1d service nova] Acquired lock "refresh_cache-28a1ec10-2748-4d0c-9b73-9636fc1cc237" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.network.neutron [req-a1ba1aa6-c0f9-467b-8f87-931601b13b2e req-b348160f-46a0-40b9-b91a-0f8b0ba45f1d service nova] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Refreshing network info cache for port 84041b89-25ff-4498-87ba-c2ab0b5aa876 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Start _get_guest_xml network_info=[{"id": "84041b89-25ff-4498-87ba-c2ab0b5aa876", "address": "fa:16:3e:ef:5f:d5", "network": {"id": "ad0220e2-671c-40cc-8b2f-bda8d6f6fca5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-319455103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "342f25269fc44ec2bb9f07a38aa70cd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84041b89-25", "ovs_interfaceid": "84041b89-25ff-4498-87ba-c2ab0b5aa876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:52:52 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:52:52 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:52:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1814824863',display_name='tempest-SnapshotDataIntegrityTests-server-1814824863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1814824863',id=30,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGxfNId9FgLzesVJTVh5N4e63Gop0293MujlvTdShQk9T5aVtuAVYLP6jBa/sLNrcnCiBLzgcMJcYAwtNraeoI9385lirSvS1Rjud61AlPQ7H/aq20IvIB1Eq0n0U4+vA==',key_name='tempest-keypair-1667336127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='342f25269fc44ec2bb9f07a38aa70cd8',ramdisk_id='',reservation_id='r-ysdmpt9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-361766298',owner_user_name='tempest-SnapshotDataIntegrityTests-361766298-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:52:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e16cdc87db540ef820be3233d3e3595',uuid=28a1ec10-2748-4d0c-9b73-9636fc1cc237,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84041b89-25ff-4498-87ba-c2ab0b5aa876", "address": "fa:16:3e:ef:5f:d5", "network": {"id": "ad0220e2-671c-40cc-8b2f-bda8d6f6fca5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-319455103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "342f25269fc44ec2bb9f07a38aa70cd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84041b89-25", "ovs_interfaceid": "84041b89-25ff-4498-87ba-c2ab0b5aa876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Converting VIF {"id": "84041b89-25ff-4498-87ba-c2ab0b5aa876", "address": "fa:16:3e:ef:5f:d5", "network": {"id": "ad0220e2-671c-40cc-8b2f-bda8d6f6fca5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-319455103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "342f25269fc44ec2bb9f07a38aa70cd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84041b89-25", "ovs_interfaceid": "84041b89-25ff-4498-87ba-c2ab0b5aa876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:5f:d5,bridge_name='br-int',has_traffic_filtering=True,id=84041b89-25ff-4498-87ba-c2ab0b5aa876,network=Network(ad0220e2-671c-40cc-8b2f-bda8d6f6fca5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84041b89-25') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.objects.instance [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lazy-loading 'pci_devices' on Instance uuid 28a1ec10-2748-4d0c-9b73-9636fc1cc237 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:52:52 user nova-compute[75391]:   <uuid>28a1ec10-2748-4d0c-9b73-9636fc1cc237</uuid>
Nov 15 02:52:52 user nova-compute[75391]:   <name>instance-0000001e</name>
Nov 15 02:52:52 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:52:52 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:52:52 user nova-compute[75391]:   <metadata>
Nov 15 02:52:52 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:52:52 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:52:52 user nova-compute[75391]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1814824863</nova:name>
Nov 15 02:52:52 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:52:52</nova:creationTime>
Nov 15 02:52:52 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:52:52 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:52:52 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:52:52 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:52:52 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:52:52 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:52:52 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:52:52 user nova-compute[75391]:       <nova:owner>
Nov 15 02:52:52 user nova-compute[75391]:         <nova:user uuid="6e16cdc87db540ef820be3233d3e3595">tempest-SnapshotDataIntegrityTests-361766298-project-member</nova:user>
Nov 15 02:52:52 user nova-compute[75391]:         <nova:project uuid="342f25269fc44ec2bb9f07a38aa70cd8">tempest-SnapshotDataIntegrityTests-361766298</nova:project>
Nov 15 02:52:52 user nova-compute[75391]:       </nova:owner>
Nov 15 02:52:52 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:52:52 user nova-compute[75391]:       <nova:ports>
Nov 15 02:52:52 user nova-compute[75391]:         <nova:port uuid="84041b89-25ff-4498-87ba-c2ab0b5aa876">
Nov 15 02:52:52 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 02:52:52 user nova-compute[75391]:         </nova:port>
Nov 15 02:52:52 user nova-compute[75391]:       </nova:ports>
Nov 15 02:52:52 user nova-compute[75391]:     </nova:instance>
Nov 15 02:52:52 user nova-compute[75391]:   </metadata>
Nov 15 02:52:52 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:52:52 user nova-compute[75391]:     <system>
Nov 15 02:52:52 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:52:52 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:52:52 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:52:52 user nova-compute[75391]:       <entry name="serial">28a1ec10-2748-4d0c-9b73-9636fc1cc237</entry>
Nov 15 02:52:52 user nova-compute[75391]:       <entry name="uuid">28a1ec10-2748-4d0c-9b73-9636fc1cc237</entry>
Nov 15 02:52:52 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:52:52 user nova-compute[75391]:     </system>
Nov 15 02:52:52 user nova-compute[75391]:   </sysinfo>
Nov 15 02:52:52 user nova-compute[75391]:   <os>
Nov 15 02:52:52 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:52:52 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:52:52 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:52:52 user nova-compute[75391]:   </os>
Nov 15 02:52:52 user nova-compute[75391]:   <features>
Nov 15 02:52:52 user nova-compute[75391]:     <acpi/>
Nov 15 02:52:52 user nova-compute[75391]:     <apic/>
Nov 15 02:52:52 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:52:52 user nova-compute[75391]:   </features>
Nov 15 02:52:52 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:52:52 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:52:52 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:52:52 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:52:52 user nova-compute[75391]:   </clock>
Nov 15 02:52:52 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:52:52 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:52:52 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:52:52 user nova-compute[75391]:   </cpu>
Nov 15 02:52:52 user nova-compute[75391]:   <devices>
Nov 15 02:52:52 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:52:52 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:52:52 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk"/>
Nov 15 02:52:52 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:52:52 user nova-compute[75391]:     </disk>
Nov 15 02:52:52 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:52:52 user nova-compute[75391]:       <mac address="fa:16:3e:ef:5f:d5"/>
Nov 15 02:52:52 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:52:52 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:52:52 user nova-compute[75391]:       <target dev="tap84041b89-25"/>
Nov 15 02:52:52 user nova-compute[75391]:     </interface>
Nov 15 02:52:52 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:52:52 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/console.log" append="off"/>
Nov 15 02:52:52 user nova-compute[75391]:     </serial>
Nov 15 02:52:52 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:52:52 user nova-compute[75391]:     <video>
Nov 15 02:52:52 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:52:52 user nova-compute[75391]:     </video>
Nov 15 02:52:52 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:52:52 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:52:52 user nova-compute[75391]:     </rng>
Nov 15 02:52:52 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:52:52 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:52:52 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:52:52 user nova-compute[75391]:     </memballoon>
Nov 15 02:52:52 user nova-compute[75391]:   </devices>
Nov 15 02:52:52 user nova-compute[75391]: </domain>
Nov 15 02:52:52 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:52:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1814824863',display_name='tempest-SnapshotDataIntegrityTests-server-1814824863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1814824863',id=30,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGxfNId9FgLzesVJTVh5N4e63Gop0293MujlvTdShQk9T5aVtuAVYLP6jBa/sLNrcnCiBLzgcMJcYAwtNraeoI9385lirSvS1Rjud61AlPQ7H/aq20IvIB1Eq0n0U4+vA==',key_name='tempest-keypair-1667336127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='342f25269fc44ec2bb9f07a38aa70cd8',ramdisk_id='',reservation_id='r-ysdmpt9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-361766298',owner_user_name='tempest-SnapshotDataIntegrityTests-361766298-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:52:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e16cdc87db540ef820be3233d3e3595',uuid=28a1ec10-2748-4d0c-9b73-9636fc1cc237,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84041b89-25ff-4498-87ba-c2ab0b5aa876", "address": "fa:16:3e:ef:5f:d5", "network": {"id": "ad0220e2-671c-40cc-8b2f-bda8d6f6fca5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-319455103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "342f25269fc44ec2bb9f07a38aa70cd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84041b89-25", "ovs_interfaceid": "84041b89-25ff-4498-87ba-c2ab0b5aa876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Converting VIF {"id": "84041b89-25ff-4498-87ba-c2ab0b5aa876", "address": "fa:16:3e:ef:5f:d5", "network": {"id": "ad0220e2-671c-40cc-8b2f-bda8d6f6fca5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-319455103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "342f25269fc44ec2bb9f07a38aa70cd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84041b89-25", "ovs_interfaceid": "84041b89-25ff-4498-87ba-c2ab0b5aa876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:5f:d5,bridge_name='br-int',has_traffic_filtering=True,id=84041b89-25ff-4498-87ba-c2ab0b5aa876,network=Network(ad0220e2-671c-40cc-8b2f-bda8d6f6fca5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84041b89-25') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG os_vif [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:5f:d5,bridge_name='br-int',has_traffic_filtering=True,id=84041b89-25ff-4498-87ba-c2ab0b5aa876,network=Network(ad0220e2-671c-40cc-8b2f-bda8d6f6fca5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84041b89-25') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '533577fb-a5fd-5a65-8563-6352188e7657', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84041b89-25, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84041b89-25, col_values=(('qos', UUID('d8167e56-c2db-478f-9c01-06eea8455279')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84041b89-25, col_values=(('external_ids', {'iface-id': '84041b89-25ff-4498-87ba-c2ab0b5aa876', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:5f:d5', 'vm-uuid': '28a1ec10-2748-4d0c-9b73-9636fc1cc237'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:52 user nova-compute[75391]: INFO os_vif [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:5f:d5,bridge_name='br-int',has_traffic_filtering=True,id=84041b89-25ff-4498-87ba-c2ab0b5aa876,network=Network(ad0220e2-671c-40cc-8b2f-bda8d6f6fca5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84041b89-25')
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:52:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] No VIF found with MAC fa:16:3e:ef:5f:d5, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:52:53 user nova-compute[75391]: DEBUG nova.network.neutron [req-a1ba1aa6-c0f9-467b-8f87-931601b13b2e req-b348160f-46a0-40b9-b91a-0f8b0ba45f1d service nova] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Updated VIF entry in instance network info cache for port 84041b89-25ff-4498-87ba-c2ab0b5aa876. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:52:53 user nova-compute[75391]: DEBUG nova.network.neutron [req-a1ba1aa6-c0f9-467b-8f87-931601b13b2e req-b348160f-46a0-40b9-b91a-0f8b0ba45f1d service nova] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Updating instance_info_cache with network_info: [{"id": "84041b89-25ff-4498-87ba-c2ab0b5aa876", "address": "fa:16:3e:ef:5f:d5", "network": {"id": "ad0220e2-671c-40cc-8b2f-bda8d6f6fca5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-319455103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "342f25269fc44ec2bb9f07a38aa70cd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84041b89-25", "ovs_interfaceid": "84041b89-25ff-4498-87ba-c2ab0b5aa876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:52:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a1ba1aa6-c0f9-467b-8f87-931601b13b2e req-b348160f-46a0-40b9-b91a-0f8b0ba45f1d service nova] Releasing lock "refresh_cache-28a1ec10-2748-4d0c-9b73-9636fc1cc237" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:52:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:54 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:52:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:52:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:52:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:52:54 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:52:55 user nova-compute[75391]: DEBUG nova.compute.manager [req-2ae74d50-e61d-44c1-8d9a-af6f33a6737d req-d504b685-83f7-40c9-a236-871460b77c26 service nova] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Received event network-vif-plugged-84041b89-25ff-4498-87ba-c2ab0b5aa876 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:52:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2ae74d50-e61d-44c1-8d9a-af6f33a6737d req-d504b685-83f7-40c9-a236-871460b77c26 service nova] Acquiring lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:52:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2ae74d50-e61d-44c1-8d9a-af6f33a6737d req-d504b685-83f7-40c9-a236-871460b77c26 service nova] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:52:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2ae74d50-e61d-44c1-8d9a-af6f33a6737d req-d504b685-83f7-40c9-a236-871460b77c26 service nova] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:52:55 user nova-compute[75391]: DEBUG nova.compute.manager [req-2ae74d50-e61d-44c1-8d9a-af6f33a6737d req-d504b685-83f7-40c9-a236-871460b77c26 service nova] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] No waiting events found dispatching network-vif-plugged-84041b89-25ff-4498-87ba-c2ab0b5aa876 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:52:55 user nova-compute[75391]: WARNING nova.compute.manager [req-2ae74d50-e61d-44c1-8d9a-af6f33a6737d req-d504b685-83f7-40c9-a236-871460b77c26 service nova] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Received unexpected event network-vif-plugged-84041b89-25ff-4498-87ba-c2ab0b5aa876 for instance with vm_state building and task_state spawning.
Nov 15 02:52:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:57 user nova-compute[75391]: DEBUG nova.compute.manager [req-bb45e29e-c2cb-4491-9be6-b3d3cac07314 req-27c1579a-93d3-450e-9e2a-fd4caf233539 service nova] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Received event network-vif-plugged-84041b89-25ff-4498-87ba-c2ab0b5aa876 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:52:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bb45e29e-c2cb-4491-9be6-b3d3cac07314 req-27c1579a-93d3-450e-9e2a-fd4caf233539 service nova] Acquiring lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:52:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bb45e29e-c2cb-4491-9be6-b3d3cac07314 req-27c1579a-93d3-450e-9e2a-fd4caf233539 service nova] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:52:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bb45e29e-c2cb-4491-9be6-b3d3cac07314 req-27c1579a-93d3-450e-9e2a-fd4caf233539 service nova] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:52:57 user nova-compute[75391]: DEBUG nova.compute.manager [req-bb45e29e-c2cb-4491-9be6-b3d3cac07314 req-27c1579a-93d3-450e-9e2a-fd4caf233539 service nova] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] No waiting events found dispatching network-vif-plugged-84041b89-25ff-4498-87ba-c2ab0b5aa876 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:52:57 user nova-compute[75391]: WARNING nova.compute.manager [req-bb45e29e-c2cb-4491-9be6-b3d3cac07314 req-27c1579a-93d3-450e-9e2a-fd4caf233539 service nova] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Received unexpected event network-vif-plugged-84041b89-25ff-4498-87ba-c2ab0b5aa876 for instance with vm_state building and task_state spawning.
Nov 15 02:52:57 user nova-compute[75391]: DEBUG nova.compute.manager [req-bb45e29e-c2cb-4491-9be6-b3d3cac07314 req-27c1579a-93d3-450e-9e2a-fd4caf233539 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Received event network-changed-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:52:57 user nova-compute[75391]: DEBUG nova.compute.manager [req-bb45e29e-c2cb-4491-9be6-b3d3cac07314 req-27c1579a-93d3-450e-9e2a-fd4caf233539 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Refreshing instance network info cache due to event network-changed-70574492-ddbc-47cd-b32c-cd5cb88b8ff7. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:52:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bb45e29e-c2cb-4491-9be6-b3d3cac07314 req-27c1579a-93d3-450e-9e2a-fd4caf233539 service nova] Acquiring lock "refresh_cache-4ab2dd85-9758-4ea9-8282-9396a2653393" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:52:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bb45e29e-c2cb-4491-9be6-b3d3cac07314 req-27c1579a-93d3-450e-9e2a-fd4caf233539 service nova] Acquired lock "refresh_cache-4ab2dd85-9758-4ea9-8282-9396a2653393" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:52:57 user nova-compute[75391]: DEBUG nova.network.neutron [req-bb45e29e-c2cb-4491-9be6-b3d3cac07314 req-27c1579a-93d3-450e-9e2a-fd4caf233539 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Refreshing network info cache for port 70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:52:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:58 user nova-compute[75391]: DEBUG nova.network.neutron [req-bb45e29e-c2cb-4491-9be6-b3d3cac07314 req-27c1579a-93d3-450e-9e2a-fd4caf233539 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Updated VIF entry in instance network info cache for port 70574492-ddbc-47cd-b32c-cd5cb88b8ff7. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:52:58 user nova-compute[75391]: DEBUG nova.network.neutron [req-bb45e29e-c2cb-4491-9be6-b3d3cac07314 req-27c1579a-93d3-450e-9e2a-fd4caf233539 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Updating instance_info_cache with network_info: [{"id": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "address": "fa:16:3e:f2:fd:21", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70574492-dd", "ovs_interfaceid": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:52:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bb45e29e-c2cb-4491-9be6-b3d3cac07314 req-27c1579a-93d3-450e-9e2a-fd4caf233539 service nova] Releasing lock "refresh_cache-4ab2dd85-9758-4ea9-8282-9396a2653393" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:52:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:52:58 user nova-compute[75391]: DEBUG nova.compute.manager [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:52:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:52:58 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Instance spawned successfully.
Nov 15 02:52:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:52:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "4ab2dd85-9758-4ea9-8282-9396a2653393" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:52:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:52:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:52:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:52:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:52:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:52:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:52:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:52:58 user nova-compute[75391]: INFO nova.compute.manager [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Detaching volume f9acc09b-a762-4d5c-a96e-693ae14062c0
Nov 15 02:52:58 user nova-compute[75391]: INFO nova.virt.block_device [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Attempting to driver detach volume f9acc09b-a762-4d5c-a96e-693ae14062c0 from mountpoint /dev/vdb
Nov 15 02:52:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Attempting to detach device vdb from instance 4ab2dd85-9758-4ea9-8282-9396a2653393 from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:52:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:52:58 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:52:58 user nova-compute[75391]:   <source dev="/dev/sdc"/>
Nov 15 02:52:58 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:52:58 user nova-compute[75391]:   <serial>f9acc09b-a762-4d5c-a96e-693ae14062c0</serial>
Nov 15 02:52:58 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:52:58 user nova-compute[75391]: </disk>
Nov 15 02:52:58 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:52:58 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Successfully detached device vdb from instance 4ab2dd85-9758-4ea9-8282-9396a2653393 from the persistent domain config.
Nov 15 02:52:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4ab2dd85-9758-4ea9-8282-9396a2653393 from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 02:52:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:52:58 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:52:58 user nova-compute[75391]:   <source dev="/dev/sdc"/>
Nov 15 02:52:58 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:52:58 user nova-compute[75391]:   <serial>f9acc09b-a762-4d5c-a96e-693ae14062c0</serial>
Nov 15 02:52:58 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:52:58 user nova-compute[75391]: </disk>
Nov 15 02:52:58 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:52:58 user nova-compute[75391]: INFO nova.compute.manager [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Took 7.70 seconds to spawn the instance on the hypervisor.
Nov 15 02:52:58 user nova-compute[75391]: DEBUG nova.compute.manager [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:52:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.342s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:59 user nova-compute[75391]: INFO nova.compute.manager [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Took 9.07 seconds to build instance.
Nov 15 02:52:59 user nova-compute[75391]: DEBUG nova.compute.manager [req-19c62072-2001-4ddf-9ff1-49444cc7d6ac req-bba5013d-6be8-4ea3-8200-377326ee2e45 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Received event network-changed-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:52:59 user nova-compute[75391]: DEBUG nova.compute.manager [req-19c62072-2001-4ddf-9ff1-49444cc7d6ac req-bba5013d-6be8-4ea3-8200-377326ee2e45 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Refreshing instance network info cache due to event network-changed-70574492-ddbc-47cd-b32c-cd5cb88b8ff7. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:52:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-19c62072-2001-4ddf-9ff1-49444cc7d6ac req-bba5013d-6be8-4ea3-8200-377326ee2e45 service nova] Acquiring lock "refresh_cache-4ab2dd85-9758-4ea9-8282-9396a2653393" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:52:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-19c62072-2001-4ddf-9ff1-49444cc7d6ac req-bba5013d-6be8-4ea3-8200-377326ee2e45 service nova] Acquired lock "refresh_cache-4ab2dd85-9758-4ea9-8282-9396a2653393" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:52:59 user nova-compute[75391]: DEBUG nova.network.neutron [req-19c62072-2001-4ddf-9ff1-49444cc7d6ac req-bba5013d-6be8-4ea3-8200-377326ee2e45 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Refreshing network info cache for port 70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:52:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-127ff002-279a-4107-8ddf-246afa05a0c3 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.428s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:52:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4ab2dd85-9758-4ea9-8282-9396a2653393 {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 02:52:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.316s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dd99dea-60d3-4eed-86c7-8d9d0522ae84/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:52:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dd99dea-60d3-4eed-86c7-8d9d0522ae84/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:52:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dd99dea-60d3-4eed-86c7-8d9d0522ae84/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dd99dea-60d3-4eed-86c7-8d9d0522ae84/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:00 user nova-compute[75391]: DEBUG nova.network.neutron [req-19c62072-2001-4ddf-9ff1-49444cc7d6ac req-bba5013d-6be8-4ea3-8200-377326ee2e45 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Updated VIF entry in instance network info cache for port 70574492-ddbc-47cd-b32c-cd5cb88b8ff7. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:53:00 user nova-compute[75391]: DEBUG nova.network.neutron [req-19c62072-2001-4ddf-9ff1-49444cc7d6ac req-bba5013d-6be8-4ea3-8200-377326ee2e45 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Updating instance_info_cache with network_info: [{"id": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "address": "fa:16:3e:f2:fd:21", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70574492-dd", "ovs_interfaceid": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:53:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-19c62072-2001-4ddf-9ff1-49444cc7d6ac req-bba5013d-6be8-4ea3-8200-377326ee2e45 service nova] Releasing lock "refresh_cache-4ab2dd85-9758-4ea9-8282-9396a2653393" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:53:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG nova.compute.manager [req-ab17d5d3-db00-41bf-9a8f-2894c0bac64e req-87c3d02a-c021-4d74-8fc3-78fb7b7836c7 service nova] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Received event network-changed-d76118a0-ca86-4748-a834-00ed12aa1b23 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG nova.compute.manager [req-ab17d5d3-db00-41bf-9a8f-2894c0bac64e req-87c3d02a-c021-4d74-8fc3-78fb7b7836c7 service nova] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Refreshing instance network info cache due to event network-changed-d76118a0-ca86-4748-a834-00ed12aa1b23. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ab17d5d3-db00-41bf-9a8f-2894c0bac64e req-87c3d02a-c021-4d74-8fc3-78fb7b7836c7 service nova] Acquiring lock "refresh_cache-4dd99dea-60d3-4eed-86c7-8d9d0522ae84" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ab17d5d3-db00-41bf-9a8f-2894c0bac64e req-87c3d02a-c021-4d74-8fc3-78fb7b7836c7 service nova] Acquired lock "refresh_cache-4dd99dea-60d3-4eed-86c7-8d9d0522ae84" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG nova.network.neutron [req-ab17d5d3-db00-41bf-9a8f-2894c0bac64e req-87c3d02a-c021-4d74-8fc3-78fb7b7836c7 service nova] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Refreshing network info cache for port d76118a0-ca86-4748-a834-00ed12aa1b23 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.004s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG nova.objects.instance [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lazy-loading 'flavor' on Instance uuid 4dd99dea-60d3-4eed-86c7-8d9d0522ae84 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:53:01 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Ignoring supplied device name: /dev/vdb
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:01 user nova-compute[75391]: INFO nova.compute.manager [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Attaching volume 0a2d4d96-2413-41d9-ab05-678e5a606fad to /dev/vdb
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG os_brick.utils [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e11ede3-6c98-4e67-a0ba-e12a5513f64c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61c1c98-6055-4889-875d-4b644ccdbb9b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5610deb3-c006-4c64-a2bb-1aefbb0d4295]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d69a75-7cdb-4bb7-91b9-181bd5b91f5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:53:01 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b4ab85-4897-4890-b3a4-c38a14d1e559]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG os_brick.utils [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Updating existing volume attachment record: 3d29f01b-011b-4b17-8a3c-911f9c8154c0 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:53:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:02 user nova-compute[75391]: DEBUG nova.network.neutron [req-ab17d5d3-db00-41bf-9a8f-2894c0bac64e req-87c3d02a-c021-4d74-8fc3-78fb7b7836c7 service nova] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Updated VIF entry in instance network info cache for port d76118a0-ca86-4748-a834-00ed12aa1b23. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:53:02 user nova-compute[75391]: DEBUG nova.network.neutron [req-ab17d5d3-db00-41bf-9a8f-2894c0bac64e req-87c3d02a-c021-4d74-8fc3-78fb7b7836c7 service nova] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Updating instance_info_cache with network_info: [{"id": "d76118a0-ca86-4748-a834-00ed12aa1b23", "address": "fa:16:3e:7b:22:f3", "network": {"id": "07cd9e35-dfd4-4a08-ac37-52c7bfefa42e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1490748469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96a31c2c4cb4586857b6179adf48ec0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd76118a0-ca", "ovs_interfaceid": "d76118a0-ca86-4748-a834-00ed12aa1b23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:53:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ab17d5d3-db00-41bf-9a8f-2894c0bac64e req-87c3d02a-c021-4d74-8fc3-78fb7b7836c7 service nova] Releasing lock "refresh_cache-4dd99dea-60d3-4eed-86c7-8d9d0522ae84" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:53:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:04 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:53:04 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:53:04 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=7623MB free_disk=24.445011138916016GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:53:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:04 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9744c8a1-046e-4a00-92e0-92ebb3275ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:53:04 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance fc9484c0-9083-4797-8ab1-2ad392822ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:53:04 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6400a5f3-0ec9-4484-930c-1f5061ae5374 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:53:04 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:53:04 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 4ab2dd85-9758-4ea9-8282-9396a2653393 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:53:04 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance d36e2f64-11cb-4b35-8471-9a4df7f4c227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:53:04 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9909ae6b-7900-4f71-8900-2bf25185e436 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:53:04 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 7bd332f2-0f74-4a43-96a2-2322b6cbf982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:53:04 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 4dd99dea-60d3-4eed-86c7-8d9d0522ae84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:53:04 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 341dfd0a-e264-4a6f-9537-35ba9ed980c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:53:04 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:53:04 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:53:04 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:53:04 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Refreshing inventories for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 02:53:04 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Updating ProviderTree inventory for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 02:53:04 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Updating inventory in ProviderTree for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 02:53:04 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Refreshing aggregate associations for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e, aggregates: None {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 02:53:04 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Refreshing trait associations for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 02:53:05 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:53:05 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:53:05 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:53:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.808s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:05 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:53:06 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:53:06 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcBbvuPR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:53:07 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:53:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:53:07 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:53:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:53:07 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3715e50-1d26-49c1-b617-45983e104b38]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:53:07 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9520ff06-9aa2-40bc-8894-31ada60fe090]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad] added
Nov 15 02:53:07 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dd7a03-2d07-4a18-9ec8-f3e70bc8af03]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c761480-1f30-4f30-8717-f1e029a9f92f]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qcBbvuPR {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qcBbvuPR" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cea920-9051-492c-a0f3-955222f50a43]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qcBbvuPR'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f15b599-f0be-42e0-8b98-0fabe63dd4c9]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[deae3bb4-b0c2-4d11-b221-bcdb6a72a13f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:53:07 user nova-compute[75391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 (non-flash)
Nov 15 02:53:07 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:53:07 user nova-compute[75391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 (non-flash)
Nov 15 02:53:07 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9faa05b5-73a9-4703-b8c6-73ee18eeafa5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad, portal: 172.16.0.220,3260]
Nov 15 02:53:07 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad, portal: 172.16.0.220,3260] successful.
Nov 15 02:53:07 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2382c53-e79b-4ae9-a627-eccc12f89675]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8736d26d-b145-4413-880f-af86e547251b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:53:07 user nova-compute[75391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 (non-flash)
Nov 15 02:53:07 user nova-compute[75391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad (non-flash)
Nov 15 02:53:07 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:53:07 user nova-compute[75391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 (non-flash)
Nov 15 02:53:07 user nova-compute[75391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad (non-flash)
Nov 15 02:53:07 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7a38ac-e8a9-43e8-9e68-9de93a86b871]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcBbvuPR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:53:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:08 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:53:08 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26530333163633865', 'path': '/dev/sdb'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:53:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530333163633865', 'path': '/dev/sdb'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:53:08 user nova-compute[75391]: DEBUG nova.objects.instance [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lazy-loading 'flavor' on Instance uuid 4dd99dea-60d3-4eed-86c7-8d9d0522ae84 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:53:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 02:53:08 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:53:08 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 02:53:08 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:53:08 user nova-compute[75391]:   <serial>0a2d4d96-2413-41d9-ab05-678e5a606fad</serial>
Nov 15 02:53:08 user nova-compute[75391]: </disk>
Nov 15 02:53:08 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:53:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:53:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:53:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] No VIF found with MAC fa:16:3e:7b:22:f3, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:53:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a4ce2d60-af69-4e97-84dc-c3fddefc3649 tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.411s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:16 user nova-compute[75391]: INFO nova.compute.manager [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Detaching volume 0a2d4d96-2413-41d9-ab05-678e5a606fad
Nov 15 02:53:16 user nova-compute[75391]: INFO nova.virt.block_device [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Attempting to driver detach volume 0a2d4d96-2413-41d9-ab05-678e5a606fad from mountpoint /dev/vdb
Nov 15 02:53:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Attempting to detach device vdb from instance 4dd99dea-60d3-4eed-86c7-8d9d0522ae84 from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:53:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:53:16 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:53:16 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 02:53:16 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:53:16 user nova-compute[75391]:   <serial>0a2d4d96-2413-41d9-ab05-678e5a606fad</serial>
Nov 15 02:53:16 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:53:16 user nova-compute[75391]: </disk>
Nov 15 02:53:16 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:53:16 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Successfully detached device vdb from instance 4dd99dea-60d3-4eed-86c7-8d9d0522ae84 from the persistent domain config.
Nov 15 02:53:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4dd99dea-60d3-4eed-86c7-8d9d0522ae84 from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 02:53:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:53:16 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:53:16 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 02:53:16 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:53:16 user nova-compute[75391]:   <serial>0a2d4d96-2413-41d9-ab05-678e5a606fad</serial>
Nov 15 02:53:16 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:53:16 user nova-compute[75391]: </disk>
Nov 15 02:53:16 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:53:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4dd99dea-60d3-4eed-86c7-8d9d0522ae84 {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 02:53:17 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:19 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4ab2dd85-9758-4ea9-8282-9396a2653393 is timed out.
Nov 15 02:53:19 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Successfully detached device vdb from instance 4ab2dd85-9758-4ea9-8282-9396a2653393 from the live domain config.
Nov 15 02:53:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ylWIruoF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:53:19 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:53:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d003ad5e-6683-4b24-bb1f-47c852c0b775]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:53:19 user nova-compute[75391]: No targets found.
Nov 15 02:53:19 user nova-compute[75391]: iSNS:
Nov 15 02:53:19 user nova-compute[75391]: No targets found.
Nov 15 02:53:19 user nova-compute[75391]: STATIC:
Nov 15 02:53:19 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad
Nov 15 02:53:19 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:53:19 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:53:19 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0
Nov 15 02:53:19 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:53:19 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:53:19 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:53:19 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:53:19 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:53:19 user nova-compute[75391]: FIRMWARE:
Nov 15 02:53:19 user nova-compute[75391]: No targets found.
Nov 15 02:53:19 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:53:19 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:53:19 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d1d54b-9791-4a31-9cb2-7c55e2287827]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f84218-eced-4e8d-bbf2-c7c61e3ed463]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:53:19 user nova-compute[75391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 (non-flash)
Nov 15 02:53:19 user nova-compute[75391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad (non-flash)
Nov 15 02:53:19 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:53:19 user nova-compute[75391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 (non-flash)
Nov 15 02:53:19 user nova-compute[75391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad (non-flash)
Nov 15 02:53:19 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62443f0550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0'): ({'sdc'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Removing single pathed devices sdc {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d964f4b4-06fc-4a6e-9bf4-b85f09a84451]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2dba6b-845f-4eea-b5e7-73bfdd63101c]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Flushing IO for device /dev/sdc {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d01ed6b-79be-40ff-9910-c512829c8781]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[df79433b-7493-4f1d-8c9c-3dc0153d1585]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] SCSI volumes sdc have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[403b11ce-cc16-4158-8f54-c130d6cedd21]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:20 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa8aef8-f251-4adb-84c6-455b4f2d05fe]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:20 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0, portal: 172.16.0.220,3260]
Nov 15 02:53:20 user nova-compute[75391]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0, portal: 172.16.0.220,3260] successful.
Nov 15 02:53:20 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9acc09b-a762-4d5c-a96e-693ae14062c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:20 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[776610b4-537d-4ffc-a966-8798e19bd119]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:20 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:20 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:53:20 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] <== disconnect_volume: return (337ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:53:20 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:53:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:20 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:53:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:20 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:53:20 user nova-compute[75391]: INFO nova.compute.claims [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Claim successful on node user
Nov 15 02:53:21 user nova-compute[75391]: DEBUG nova.objects.instance [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lazy-loading 'flavor' on Instance uuid 4ab2dd85-9758-4ea9-8282-9396a2653393 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:53:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c25a8ff1-f95c-492c-a694-9b82bad72bb2 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.585s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:21 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:53:21 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:53:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.509s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:21 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:53:21 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:53:21 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:53:21 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:53:21 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:53:21 user nova-compute[75391]: DEBUG nova.policy [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0aa106a59c374dde99b7697f94407339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63a88a9fe824c3e9c0807a50b569d54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:53:21 user nova-compute[75391]: INFO nova.virt.block_device [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Booting with volume-backed-image f31cb507-389e-424c-b4dc-02c610b0b558 at /dev/vda
Nov 15 02:53:22 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Successfully created port: 5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:53:22 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:22 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Successfully updated port: 5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:53:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "refresh_cache-c767fb74-e57f-4ea0-bf4e-4034cf656a78" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:53:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquired lock "refresh_cache-c767fb74-e57f-4ea0-bf4e-4034cf656a78" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:53:23 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:53:23 user nova-compute[75391]: DEBUG nova.compute.manager [req-e319ea08-6340-4ef0-b4f2-672279333c67 req-ec436e9b-7a3c-4770-85f7-af23330635e7 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received event network-changed-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:53:23 user nova-compute[75391]: DEBUG nova.compute.manager [req-e319ea08-6340-4ef0-b4f2-672279333c67 req-ec436e9b-7a3c-4770-85f7-af23330635e7 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Refreshing instance network info cache due to event network-changed-5a80868d-8a1f-4a83-8c22-d3f504963bbc. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:53:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e319ea08-6340-4ef0-b4f2-672279333c67 req-ec436e9b-7a3c-4770-85f7-af23330635e7 service nova] Acquiring lock "refresh_cache-c767fb74-e57f-4ea0-bf4e-4034cf656a78" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:53:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:23 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:53:23 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Updating instance_info_cache with network_info: [{"id": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "address": "fa:16:3e:9e:b6:f5", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a80868d-8a", "ovs_interfaceid": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:53:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Releasing lock "refresh_cache-c767fb74-e57f-4ea0-bf4e-4034cf656a78" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:53:23 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Instance network_info: |[{"id": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "address": "fa:16:3e:9e:b6:f5", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a80868d-8a", "ovs_interfaceid": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:53:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e319ea08-6340-4ef0-b4f2-672279333c67 req-ec436e9b-7a3c-4770-85f7-af23330635e7 service nova] Acquired lock "refresh_cache-c767fb74-e57f-4ea0-bf4e-4034cf656a78" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:53:23 user nova-compute[75391]: DEBUG nova.network.neutron [req-e319ea08-6340-4ef0-b4f2-672279333c67 req-ec436e9b-7a3c-4770-85f7-af23330635e7 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Refreshing network info cache for port 5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:53:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "a0382af0-0509-4473-832f-1e5e6588be2e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "a0382af0-0509-4473-832f-1e5e6588be2e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:23 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:53:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:23 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:53:23 user nova-compute[75391]: INFO nova.compute.claims [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Claim successful on node user
Nov 15 02:53:23 user nova-compute[75391]: DEBUG nova.network.neutron [req-e319ea08-6340-4ef0-b4f2-672279333c67 req-ec436e9b-7a3c-4770-85f7-af23330635e7 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Updated VIF entry in instance network info cache for port 5a80868d-8a1f-4a83-8c22-d3f504963bbc. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:53:23 user nova-compute[75391]: DEBUG nova.network.neutron [req-e319ea08-6340-4ef0-b4f2-672279333c67 req-ec436e9b-7a3c-4770-85f7-af23330635e7 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Updating instance_info_cache with network_info: [{"id": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "address": "fa:16:3e:9e:b6:f5", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a80868d-8a", "ovs_interfaceid": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:53:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e319ea08-6340-4ef0-b4f2-672279333c67 req-ec436e9b-7a3c-4770-85f7-af23330635e7 service nova] Releasing lock "refresh_cache-c767fb74-e57f-4ea0-bf4e-4034cf656a78" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:53:24 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:53:24 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:53:24 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:24 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:53:24 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:53:24 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:53:24 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:53:24 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:53:24 user nova-compute[75391]: INFO nova.virt.block_device [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Booting with volume 77e17fe9-4e90-4cf8-a98a-1a887987165b at /dev/vda
Nov 15 02:53:24 user nova-compute[75391]: DEBUG nova.policy [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f6ea5480ad1e49afa394e636c37e3b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81798f0465704c4d9c09d8c3d3175ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:53:24 user nova-compute[75391]: DEBUG os_brick.utils [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:53:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:24 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c17fdb-90f6-4bc3-a8f3-2aeab7275ecb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:24 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2798e58b-f575-4303-a911-30200a1fe2b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:24 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5571b67d-d6f3-4b67-8419-5c5daf193cc0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:24 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[12788a7e-c9b6-48cb-b831-1b9f6c7e7a39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:53:24 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:53:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:53:24 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:53:24 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[587e3ca9-f5c9-4c62-9bd6-06197eaf777b]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:24 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:53:24 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:53:24 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:53:24 user nova-compute[75391]: DEBUG os_brick.utils [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:53:24 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Updating existing volume attachment record: 78024626-9a7b-4fbc-a787-fb78df254f5b {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:53:25 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Successfully created port: f4cd02a6-d62a-435e-93fd-e5216134f788 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:53:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:26 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Successfully updated port: f4cd02a6-d62a-435e-93fd-e5216134f788 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:53:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "refresh_cache-a0382af0-0509-4473-832f-1e5e6588be2e" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:53:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquired lock "refresh_cache-a0382af0-0509-4473-832f-1e5e6588be2e" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:53:26 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:53:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-10743ffe-6bea-447a-96f8-f61aec6fa70f req-428e391a-8f5a-4800-bdf6-1de475492ca3 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Received event network-changed-f4cd02a6-d62a-435e-93fd-e5216134f788 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:53:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-10743ffe-6bea-447a-96f8-f61aec6fa70f req-428e391a-8f5a-4800-bdf6-1de475492ca3 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Refreshing instance network info cache due to event network-changed-f4cd02a6-d62a-435e-93fd-e5216134f788. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:53:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-10743ffe-6bea-447a-96f8-f61aec6fa70f req-428e391a-8f5a-4800-bdf6-1de475492ca3 service nova] Acquiring lock "refresh_cache-a0382af0-0509-4473-832f-1e5e6588be2e" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Updating instance_info_cache with network_info: [{"id": "f4cd02a6-d62a-435e-93fd-e5216134f788", "address": "fa:16:3e:af:ba:88", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd02a6-d6", "ovs_interfaceid": "f4cd02a6-d62a-435e-93fd-e5216134f788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Releasing lock "refresh_cache-a0382af0-0509-4473-832f-1e5e6588be2e" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Instance network_info: |[{"id": "f4cd02a6-d62a-435e-93fd-e5216134f788", "address": "fa:16:3e:af:ba:88", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd02a6-d6", "ovs_interfaceid": "f4cd02a6-d62a-435e-93fd-e5216134f788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-10743ffe-6bea-447a-96f8-f61aec6fa70f req-428e391a-8f5a-4800-bdf6-1de475492ca3 service nova] Acquired lock "refresh_cache-a0382af0-0509-4473-832f-1e5e6588be2e" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG nova.network.neutron [req-10743ffe-6bea-447a-96f8-f61aec6fa70f req-428e391a-8f5a-4800-bdf6-1de475492ca3 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Refreshing network info cache for port f4cd02a6-d62a-435e-93fd-e5216134f788 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG os_brick.utils [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3938fa-76fa-494a-913a-04fa67f17778]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfdff82-d636-42ce-991a-cd42dd5ac088]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80d72d2-7486-47ce-9ede-46446eb692dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4507b3b6-7f5c-43c3-8f5d-7ca816603846]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:53:27 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:53:27 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[848dec0b-792f-410a-bf97-1c2fcd6c7f0a]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG os_brick.utils [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Updating existing volume attachment record: aa87f1ce-7e09-47b3-a418-4e48d29f12c3 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG nova.network.neutron [req-10743ffe-6bea-447a-96f8-f61aec6fa70f req-428e391a-8f5a-4800-bdf6-1de475492ca3 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Updated VIF entry in instance network info cache for port f4cd02a6-d62a-435e-93fd-e5216134f788. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG nova.network.neutron [req-10743ffe-6bea-447a-96f8-f61aec6fa70f req-428e391a-8f5a-4800-bdf6-1de475492ca3 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Updating instance_info_cache with network_info: [{"id": "f4cd02a6-d62a-435e-93fd-e5216134f788", "address": "fa:16:3e:af:ba:88", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd02a6-d6", "ovs_interfaceid": "f4cd02a6-d62a-435e-93fd-e5216134f788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-10743ffe-6bea-447a-96f8-f61aec6fa70f req-428e391a-8f5a-4800-bdf6-1de475492ca3 service nova] Releasing lock "refresh_cache-a0382af0-0509-4473-832f-1e5e6588be2e" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:53:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:28 user nova-compute[75391]: DEBUG nova.compute.manager [req-867c2e77-e6d2-4b02-bd35-091ca3b8c294 req-e5faa578-a5d8-4fd3-9d7c-10855d3dbd8b service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Received event network-changed-f81de438-c24a-4cc9-93ab-508fea76d915 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:53:28 user nova-compute[75391]: DEBUG nova.compute.manager [req-867c2e77-e6d2-4b02-bd35-091ca3b8c294 req-e5faa578-a5d8-4fd3-9d7c-10855d3dbd8b service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Refreshing instance network info cache due to event network-changed-f81de438-c24a-4cc9-93ab-508fea76d915. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:53:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-867c2e77-e6d2-4b02-bd35-091ca3b8c294 req-e5faa578-a5d8-4fd3-9d7c-10855d3dbd8b service nova] Acquiring lock "refresh_cache-341dfd0a-e264-4a6f-9537-35ba9ed980c4" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:53:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-867c2e77-e6d2-4b02-bd35-091ca3b8c294 req-e5faa578-a5d8-4fd3-9d7c-10855d3dbd8b service nova] Acquired lock "refresh_cache-341dfd0a-e264-4a6f-9537-35ba9ed980c4" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:53:28 user nova-compute[75391]: DEBUG nova.network.neutron [req-867c2e77-e6d2-4b02-bd35-091ca3b8c294 req-e5faa578-a5d8-4fd3-9d7c-10855d3dbd8b service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Refreshing network info cache for port f81de438-c24a-4cc9-93ab-508fea76d915 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:53:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:28 user nova-compute[75391]: DEBUG nova.network.neutron [req-867c2e77-e6d2-4b02-bd35-091ca3b8c294 req-e5faa578-a5d8-4fd3-9d7c-10855d3dbd8b service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Updated VIF entry in instance network info cache for port f81de438-c24a-4cc9-93ab-508fea76d915. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:53:28 user nova-compute[75391]: DEBUG nova.network.neutron [req-867c2e77-e6d2-4b02-bd35-091ca3b8c294 req-e5faa578-a5d8-4fd3-9d7c-10855d3dbd8b service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Updating instance_info_cache with network_info: [{"id": "f81de438-c24a-4cc9-93ab-508fea76d915", "address": "fa:16:3e:47:1f:19", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81de438-c2", "ovs_interfaceid": "f81de438-c24a-4cc9-93ab-508fea76d915", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:53:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-867c2e77-e6d2-4b02-bd35-091ca3b8c294 req-e5faa578-a5d8-4fd3-9d7c-10855d3dbd8b service nova] Releasing lock "refresh_cache-341dfd0a-e264-4a6f-9537-35ba9ed980c4" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:53:29 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:53:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:53:29 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Creating image(s)
Nov 15 02:53:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Did not create local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 02:53:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Ensure instance console log exists: /opt/stack/data/nova/instances/a0382af0-0509-4473-832f-1e5e6588be2e/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:53:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Start _get_guest_xml network_info=[{"id": "f4cd02a6-d62a-435e-93fd-e5216134f788", "address": "fa:16:3e:af:ba:88", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd02a6-d6", "ovs_interfaceid": "f4cd02a6-d62a-435e-93fd-e5216134f788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '78024626-9a7b-4fbc-a787-fb78df254f5b', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KOsrcXFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a0382af0-0509-4473-832f-1e5e6588be2e', 'attached_at': '', 'detached_at': '', 'volume_id': '77e17fe9-4e90-4cf8-a98a-1a887987165b', 'serial': '77e17fe9-4e90-4cf8-a98a-1a887987165b'}, 'volume_type': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:53:29 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:53:29 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:53:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:53:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:53:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:53:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:53:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:53:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:53:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:53:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:53:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:53:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:53:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:53:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:53:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:53:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:53:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:53:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:53:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:53:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KOsrcXFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:53:29 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:53:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:53:30 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:53:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:53:30 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[08127748-57a1-43f2-9bb5-1216e20ee702]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:53:30 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4c2cd6-4b73-4df7-9b03-1623fad78929]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b] added
Nov 15 02:53:30 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cb4f06-69a6-40ea-9895-63590891d1a3]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[35926ae5-421b-48d2-9bab-04b5054f2935]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KOsrcXFp {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KOsrcXFp" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2fa583-4f7c-4ef1-bdc7-244d076af2be]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KOsrcXFp'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9d5a1b-b052-4da3-98cc-c878227fcd25]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[550b836d-b493-46a9-bc6e-f68ece29f415]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:53:30 user nova-compute[75391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad (non-flash)
Nov 15 02:53:30 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:53:30 user nova-compute[75391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad (non-flash)
Nov 15 02:53:30 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3900d9-4693-4c90-8c0a-32470efc0834]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b, portal: 172.16.0.220,3260]
Nov 15 02:53:30 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b, portal: 172.16.0.220,3260] successful.
Nov 15 02:53:30 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[533c6589-d1f7-4096-894a-b4a1a8c8eb76]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc5f536-ca48-4d10-9f36-7af7d1527b6f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:53:30 user nova-compute[75391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad (non-flash)
Nov 15 02:53:30 user nova-compute[75391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:53:30 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:53:30 user nova-compute[75391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad (non-flash)
Nov 15 02:53:30 user nova-compute[75391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:53:30 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e6cd71-d59e-4d35-8feb-e948e4d05682]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KOsrcXFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Acquiring lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG nova.compute.manager [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:30 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:53:30 user nova-compute[75391]: INFO nova.compute.claims [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Claim successful on node user
Nov 15 02:53:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:31 user nova-compute[75391]: INFO nova.compute.manager [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Shelving
Nov 15 02:53:31 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26634306530326461', 'path': '/dev/sdc'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634306530326461', 'path': '/dev/sdc'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.727s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG nova.compute.manager [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:53:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-15524939',display_name='tempest-ServerActionsTestOtherA-server-15524939',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-15524939',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItI9ByRPHa+npkHzUM7/DmFQcMmvmf/UTbrL8IIRz+RgnE4/GT/cT4MtYBSEthl3H1QqF7/CYKc5G1nHfxc2lqIIfQchUdl2quGrdDYzv011COZxukmBFCsP+0gJadT/A==',key_name='tempest-keypair-1167614249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81798f0465704c4d9c09d8c3d3175ac5',ramdisk_id='',reservation_id='r-cpqh006p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1177660790',owner_user_name='tempest-ServerActionsTestOtherA-1177660790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ea5480ad1e49afa394e636c37e3b70',uuid=a0382af0-0509-4473-832f-1e5e6588be2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4cd02a6-d62a-435e-93fd-e5216134f788", "address": "fa:16:3e:af:ba:88", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd02a6-d6", "ovs_interfaceid": "f4cd02a6-d62a-435e-93fd-e5216134f788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converting VIF {"id": "f4cd02a6-d62a-435e-93fd-e5216134f788", "address": "fa:16:3e:af:ba:88", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd02a6-d6", "ovs_interfaceid": "f4cd02a6-d62a-435e-93fd-e5216134f788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:ba:88,bridge_name='br-int',has_traffic_filtering=True,id=f4cd02a6-d62a-435e-93fd-e5216134f788,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4cd02a6-d6') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG nova.objects.instance [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lazy-loading 'pci_devices' on Instance uuid a0382af0-0509-4473-832f-1e5e6588be2e {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG nova.compute.manager [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG nova.network.neutron [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:53:31 user nova-compute[75391]:   <uuid>a0382af0-0509-4473-832f-1e5e6588be2e</uuid>
Nov 15 02:53:31 user nova-compute[75391]:   <name>instance-00000020</name>
Nov 15 02:53:31 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:53:31 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:53:31 user nova-compute[75391]:   <metadata>
Nov 15 02:53:31 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:53:31 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:53:31 user nova-compute[75391]:       <nova:name>tempest-ServerActionsTestOtherA-server-15524939</nova:name>
Nov 15 02:53:31 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:53:29</nova:creationTime>
Nov 15 02:53:31 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:53:31 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:53:31 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:53:31 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:53:31 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:53:31 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:53:31 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:53:31 user nova-compute[75391]:       <nova:owner>
Nov 15 02:53:31 user nova-compute[75391]:         <nova:user uuid="f6ea5480ad1e49afa394e636c37e3b70">tempest-ServerActionsTestOtherA-1177660790-project-member</nova:user>
Nov 15 02:53:31 user nova-compute[75391]:         <nova:project uuid="81798f0465704c4d9c09d8c3d3175ac5">tempest-ServerActionsTestOtherA-1177660790</nova:project>
Nov 15 02:53:31 user nova-compute[75391]:       </nova:owner>
Nov 15 02:53:31 user nova-compute[75391]:       <nova:ports>
Nov 15 02:53:31 user nova-compute[75391]:         <nova:port uuid="f4cd02a6-d62a-435e-93fd-e5216134f788">
Nov 15 02:53:31 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 02:53:31 user nova-compute[75391]:         </nova:port>
Nov 15 02:53:31 user nova-compute[75391]:       </nova:ports>
Nov 15 02:53:31 user nova-compute[75391]:     </nova:instance>
Nov 15 02:53:31 user nova-compute[75391]:   </metadata>
Nov 15 02:53:31 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:53:31 user nova-compute[75391]:     <system>
Nov 15 02:53:31 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:53:31 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:53:31 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:53:31 user nova-compute[75391]:       <entry name="serial">a0382af0-0509-4473-832f-1e5e6588be2e</entry>
Nov 15 02:53:31 user nova-compute[75391]:       <entry name="uuid">a0382af0-0509-4473-832f-1e5e6588be2e</entry>
Nov 15 02:53:31 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:53:31 user nova-compute[75391]:     </system>
Nov 15 02:53:31 user nova-compute[75391]:   </sysinfo>
Nov 15 02:53:31 user nova-compute[75391]:   <os>
Nov 15 02:53:31 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:53:31 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:53:31 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:53:31 user nova-compute[75391]:   </os>
Nov 15 02:53:31 user nova-compute[75391]:   <features>
Nov 15 02:53:31 user nova-compute[75391]:     <acpi/>
Nov 15 02:53:31 user nova-compute[75391]:     <apic/>
Nov 15 02:53:31 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:53:31 user nova-compute[75391]:   </features>
Nov 15 02:53:31 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:53:31 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:53:31 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:53:31 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:53:31 user nova-compute[75391]:   </clock>
Nov 15 02:53:31 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:53:31 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:53:31 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:53:31 user nova-compute[75391]:   </cpu>
Nov 15 02:53:31 user nova-compute[75391]:   <devices>
Nov 15 02:53:31 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 02:53:31 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:53:31 user nova-compute[75391]:       <source dev="/dev/sdc"/>
Nov 15 02:53:31 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:53:31 user nova-compute[75391]:       <serial>77e17fe9-4e90-4cf8-a98a-1a887987165b</serial>
Nov 15 02:53:31 user nova-compute[75391]:     </disk>
Nov 15 02:53:31 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:53:31 user nova-compute[75391]:       <mac address="fa:16:3e:af:ba:88"/>
Nov 15 02:53:31 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:53:31 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:53:31 user nova-compute[75391]:       <target dev="tapf4cd02a6-d6"/>
Nov 15 02:53:31 user nova-compute[75391]:     </interface>
Nov 15 02:53:31 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:53:31 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/a0382af0-0509-4473-832f-1e5e6588be2e/console.log" append="off"/>
Nov 15 02:53:31 user nova-compute[75391]:     </serial>
Nov 15 02:53:31 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:53:31 user nova-compute[75391]:     <video>
Nov 15 02:53:31 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:53:31 user nova-compute[75391]:     </video>
Nov 15 02:53:31 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:53:31 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:53:31 user nova-compute[75391]:     </rng>
Nov 15 02:53:31 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:53:31 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:53:31 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:53:31 user nova-compute[75391]:     </memballoon>
Nov 15 02:53:31 user nova-compute[75391]:   </devices>
Nov 15 02:53:31 user nova-compute[75391]: </domain>
Nov 15 02:53:31 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:53:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-15524939',display_name='tempest-ServerActionsTestOtherA-server-15524939',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-15524939',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItI9ByRPHa+npkHzUM7/DmFQcMmvmf/UTbrL8IIRz+RgnE4/GT/cT4MtYBSEthl3H1QqF7/CYKc5G1nHfxc2lqIIfQchUdl2quGrdDYzv011COZxukmBFCsP+0gJadT/A==',key_name='tempest-keypair-1167614249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81798f0465704c4d9c09d8c3d3175ac5',ramdisk_id='',reservation_id='r-cpqh006p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1177660790',owner_user_name='tempest-ServerActionsTestOtherA-1177660790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ea5480ad1e49afa394e636c37e3b70',uuid=a0382af0-0509-4473-832f-1e5e6588be2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4cd02a6-d62a-435e-93fd-e5216134f788", "address": "fa:16:3e:af:ba:88", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd02a6-d6", "ovs_interfaceid": "f4cd02a6-d62a-435e-93fd-e5216134f788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converting VIF {"id": "f4cd02a6-d62a-435e-93fd-e5216134f788", "address": "fa:16:3e:af:ba:88", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd02a6-d6", "ovs_interfaceid": "f4cd02a6-d62a-435e-93fd-e5216134f788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:ba:88,bridge_name='br-int',has_traffic_filtering=True,id=f4cd02a6-d62a-435e-93fd-e5216134f788,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4cd02a6-d6') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG os_vif [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:ba:88,bridge_name='br-int',has_traffic_filtering=True,id=f4cd02a6-d62a-435e-93fd-e5216134f788,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4cd02a6-d6') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6dcc8bed-837f-5a1e-a9a7-955f3fc43c85', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:53:31 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:53:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG nova.compute.manager [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4cd02a6-d6, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4cd02a6-d6, col_values=(('qos', UUID('7e6ed1e2-faaf-4247-9e3b-08e9c29166f2')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4cd02a6-d6, col_values=(('external_ids', {'iface-id': 'f4cd02a6-d62a-435e-93fd-e5216134f788', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:ba:88', 'vm-uuid': 'a0382af0-0509-4473-832f-1e5e6588be2e'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG nova.policy [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f51f562108e4e0a9c2e61d0a0198bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592f722752cf4cc48a70b3227d2ff3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:31 user nova-compute[75391]: INFO os_vif [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:ba:88,bridge_name='br-int',has_traffic_filtering=True,id=f4cd02a6-d62a-435e-93fd-e5216134f788,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4cd02a6-d6')
Nov 15 02:53:31 user nova-compute[75391]: DEBUG nova.compute.manager [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:53:31 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Creating image(s)
Nov 15 02:53:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Acquiring lock "/opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "/opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "/opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] No VIF found with MAC fa:16:3e:af:ba:88, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG nova.compute.manager [req-bb17abec-7b13-4cc3-8753-17664e34a236 req-e176c13f-c933-4dac-8adf-4b5679f02049 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Received event network-vif-unplugged-f81de438-c24a-4cc9-93ab-508fea76d915 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bb17abec-7b13-4cc3-8753-17664e34a236 req-e176c13f-c933-4dac-8adf-4b5679f02049 service nova] Acquiring lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bb17abec-7b13-4cc3-8753-17664e34a236 req-e176c13f-c933-4dac-8adf-4b5679f02049 service nova] Lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bb17abec-7b13-4cc3-8753-17664e34a236 req-e176c13f-c933-4dac-8adf-4b5679f02049 service nova] Lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG nova.compute.manager [req-bb17abec-7b13-4cc3-8753-17664e34a236 req-e176c13f-c933-4dac-8adf-4b5679f02049 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] No waiting events found dispatching network-vif-unplugged-f81de438-c24a-4cc9-93ab-508fea76d915 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:53:31 user nova-compute[75391]: WARNING nova.compute.manager [req-bb17abec-7b13-4cc3-8753-17664e34a236 req-e176c13f-c933-4dac-8adf-4b5679f02049 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Received unexpected event network-vif-unplugged-f81de438-c24a-4cc9-93ab-508fea76d915 for instance with vm_state active and task_state shelving.
Nov 15 02:53:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.187s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.176s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d/disk 1073741824" returned: 0 in 0.052s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.195s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG nova.network.neutron [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Successfully created port: 285df593-2636-40a8-a8e8-1e01e84d0c0b {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Cannot resize image /opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Ensure instance console log exists: /opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:32 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Instance destroyed successfully.
Nov 15 02:53:32 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:53:32 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Creating image(s)
Nov 15 02:53:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Did not create local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Ensure instance console log exists: /opt/stack/data/nova/instances/c767fb74-e57f-4ea0-bf4e-4034cf656a78/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Start _get_guest_xml network_info=[{"id": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "address": "fa:16:3e:9e:b6:f5", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a80868d-8a", "ovs_interfaceid": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'aa87f1ce-7e09-47b3-a418-4e48d29f12c3', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AlBTRFWf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c767fb74-e57f-4ea0-bf4e-4034cf656a78', 'attached_at': '', 'detached_at': '', 'volume_id': '4aadee61-9526-4ff0-9a9b-16861d006d39', 'serial': '4aadee61-9526-4ff0-9a9b-16861d006d39'}, 'volume_type': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:53:32 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:53:32 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:53:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AlBTRFWf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:53:32 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:53:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:53:32 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:53:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:53:32 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:32 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Beginning cold snapshot process
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a1b3be-72b5-4811-8357-52eb5a06136b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:53:32 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3819ed3-c12f-41a3-9f4b-87953e953072]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39] added
Nov 15 02:53:32 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9949f6-d45f-4d0c-8130-f667251807ac]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85f95c2-6eb5-4952-ae8e-62c45b217697]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AlBTRFWf {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AlBTRFWf" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[32322304-0b91-43e1-adfe-7ef5a67eb162]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AlBTRFWf'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[304a345c-b1f6-4f12-bbb7-2bcab9684718]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a521b51e-40a5-49a1-a71b-c4b26626e909]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:53:32 user nova-compute[75391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad (non-flash)
Nov 15 02:53:32 user nova-compute[75391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:53:32 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:53:32 user nova-compute[75391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad (non-flash)
Nov 15 02:53:32 user nova-compute[75391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:53:32 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG nova.privsep.utils [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk /opt/stack/data/nova/instances/snapshots/tmpm6u8imav/bf097780c5e74354a97613d701d65ae9 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:32 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e092b78-eaee-4486-9b09-33514d705faf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.network.neutron [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Successfully updated port: 285df593-2636-40a8-a8e8-1e01e84d0c0b {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39, portal: 172.16.0.220,3260]
Nov 15 02:53:33 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39, portal: 172.16.0.220,3260] successful.
Nov 15 02:53:33 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Acquiring lock "refresh_cache-04dcd079-e89f-401c-a7ae-8af96beb3d6d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Acquired lock "refresh_cache-04dcd079-e89f-401c-a7ae-8af96beb3d6d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.network.neutron [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[610a60ad-37fa-484a-a78b-cddfc3f51d55]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5815f4a8-6311-4fdb-ab3a-a7aa045cf934]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:53:33 user nova-compute[75391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad (non-flash)
Nov 15 02:53:33 user nova-compute[75391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:53:33 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:53:33 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:53:33 user nova-compute[75391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad (non-flash)
Nov 15 02:53:33 user nova-compute[75391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:53:33 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:53:33 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e62aeee-9fef-403a-8ffc-fcfe2c7d2666]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.network.neutron [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AlBTRFWf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.network.neutron [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Updating instance_info_cache with network_info: [{"id": "285df593-2636-40a8-a8e8-1e01e84d0c0b", "address": "fa:16:3e:a9:37:1c", "network": {"id": "b93bc3bd-6927-4924-a435-7d5199e553ad", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-840530940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "592f722752cf4cc48a70b3227d2ff3ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap285df593-26", "ovs_interfaceid": "285df593-2636-40a8-a8e8-1e01e84d0c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Releasing lock "refresh_cache-04dcd079-e89f-401c-a7ae-8af96beb3d6d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.compute.manager [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Instance network_info: |[{"id": "285df593-2636-40a8-a8e8-1e01e84d0c0b", "address": "fa:16:3e:a9:37:1c", "network": {"id": "b93bc3bd-6927-4924-a435-7d5199e553ad", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-840530940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "592f722752cf4cc48a70b3227d2ff3ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap285df593-26", "ovs_interfaceid": "285df593-2636-40a8-a8e8-1e01e84d0c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Start _get_guest_xml network_info=[{"id": "285df593-2636-40a8-a8e8-1e01e84d0c0b", "address": "fa:16:3e:a9:37:1c", "network": {"id": "b93bc3bd-6927-4924-a435-7d5199e553ad", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-840530940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "592f722752cf4cc48a70b3227d2ff3ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap285df593-26", "ovs_interfaceid": "285df593-2636-40a8-a8e8-1e01e84d0c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:53:33 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:53:33 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:53:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1365258568',display_name='tempest-TestServerVolumeAttachmentScenario-server-1365258568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1365258568',id=33,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6A5pg0RsKEV6XMaGP6LOF1vsDU3VFzTD0LtR24Aa7sLrPs6xC12QkuElfCTEnInkaWfn2SElhRDMc1/0hujZhVM9FVQi8D0b/lRin9PVq0nx6Lctczyq2BTThrDeKa7g==',key_name='tempest-keypair-1854765738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='592f722752cf4cc48a70b3227d2ff3ea',ramdisk_id='',reservation_id='r-qtndhl3h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-976815340',owner_user_name='tempest-TestServerVolumeAttachmentScenario-976815340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:53:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f51f562108e4e0a9c2e61d0a0198bd3',uuid=04dcd079-e89f-401c-a7ae-8af96beb3d6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "285df593-2636-40a8-a8e8-1e01e84d0c0b", "address": "fa:16:3e:a9:37:1c", "network": {"id": "b93bc3bd-6927-4924-a435-7d5199e553ad", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-840530940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "592f722752cf4cc48a70b3227d2ff3ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap285df593-26", "ovs_interfaceid": "285df593-2636-40a8-a8e8-1e01e84d0c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Converting VIF {"id": "285df593-2636-40a8-a8e8-1e01e84d0c0b", "address": "fa:16:3e:a9:37:1c", "network": {"id": "b93bc3bd-6927-4924-a435-7d5199e553ad", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-840530940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "592f722752cf4cc48a70b3227d2ff3ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap285df593-26", "ovs_interfaceid": "285df593-2636-40a8-a8e8-1e01e84d0c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:37:1c,bridge_name='br-int',has_traffic_filtering=True,id=285df593-2636-40a8-a8e8-1e01e84d0c0b,network=Network(b93bc3bd-6927-4924-a435-7d5199e553ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap285df593-26') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.objects.instance [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lazy-loading 'pci_devices' on Instance uuid 04dcd079-e89f-401c-a7ae-8af96beb3d6d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:53:33 user nova-compute[75391]:   <uuid>04dcd079-e89f-401c-a7ae-8af96beb3d6d</uuid>
Nov 15 02:53:33 user nova-compute[75391]:   <name>instance-00000021</name>
Nov 15 02:53:33 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:53:33 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:53:33 user nova-compute[75391]:   <metadata>
Nov 15 02:53:33 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:53:33 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:53:33 user nova-compute[75391]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1365258568</nova:name>
Nov 15 02:53:33 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:53:33</nova:creationTime>
Nov 15 02:53:33 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:53:33 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:53:33 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:53:33 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:53:33 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:53:33 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:53:33 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:53:33 user nova-compute[75391]:       <nova:owner>
Nov 15 02:53:33 user nova-compute[75391]:         <nova:user uuid="9f51f562108e4e0a9c2e61d0a0198bd3">tempest-TestServerVolumeAttachmentScenario-976815340-project-member</nova:user>
Nov 15 02:53:33 user nova-compute[75391]:         <nova:project uuid="592f722752cf4cc48a70b3227d2ff3ea">tempest-TestServerVolumeAttachmentScenario-976815340</nova:project>
Nov 15 02:53:33 user nova-compute[75391]:       </nova:owner>
Nov 15 02:53:33 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:53:33 user nova-compute[75391]:       <nova:ports>
Nov 15 02:53:33 user nova-compute[75391]:         <nova:port uuid="285df593-2636-40a8-a8e8-1e01e84d0c0b">
Nov 15 02:53:33 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 02:53:33 user nova-compute[75391]:         </nova:port>
Nov 15 02:53:33 user nova-compute[75391]:       </nova:ports>
Nov 15 02:53:33 user nova-compute[75391]:     </nova:instance>
Nov 15 02:53:33 user nova-compute[75391]:   </metadata>
Nov 15 02:53:33 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:53:33 user nova-compute[75391]:     <system>
Nov 15 02:53:33 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:53:33 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:53:33 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:53:33 user nova-compute[75391]:       <entry name="serial">04dcd079-e89f-401c-a7ae-8af96beb3d6d</entry>
Nov 15 02:53:33 user nova-compute[75391]:       <entry name="uuid">04dcd079-e89f-401c-a7ae-8af96beb3d6d</entry>
Nov 15 02:53:33 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:53:33 user nova-compute[75391]:     </system>
Nov 15 02:53:33 user nova-compute[75391]:   </sysinfo>
Nov 15 02:53:33 user nova-compute[75391]:   <os>
Nov 15 02:53:33 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:53:33 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:53:33 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:53:33 user nova-compute[75391]:   </os>
Nov 15 02:53:33 user nova-compute[75391]:   <features>
Nov 15 02:53:33 user nova-compute[75391]:     <acpi/>
Nov 15 02:53:33 user nova-compute[75391]:     <apic/>
Nov 15 02:53:33 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:53:33 user nova-compute[75391]:   </features>
Nov 15 02:53:33 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:53:33 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:53:33 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:53:33 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:53:33 user nova-compute[75391]:   </clock>
Nov 15 02:53:33 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:53:33 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:53:33 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:53:33 user nova-compute[75391]:   </cpu>
Nov 15 02:53:33 user nova-compute[75391]:   <devices>
Nov 15 02:53:33 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:53:33 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:53:33 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d/disk"/>
Nov 15 02:53:33 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:53:33 user nova-compute[75391]:     </disk>
Nov 15 02:53:33 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:53:33 user nova-compute[75391]:       <mac address="fa:16:3e:a9:37:1c"/>
Nov 15 02:53:33 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:53:33 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:53:33 user nova-compute[75391]:       <target dev="tap285df593-26"/>
Nov 15 02:53:33 user nova-compute[75391]:     </interface>
Nov 15 02:53:33 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:53:33 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d/console.log" append="off"/>
Nov 15 02:53:33 user nova-compute[75391]:     </serial>
Nov 15 02:53:33 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:53:33 user nova-compute[75391]:     <video>
Nov 15 02:53:33 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:53:33 user nova-compute[75391]:     </video>
Nov 15 02:53:33 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:53:33 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:53:33 user nova-compute[75391]:     </rng>
Nov 15 02:53:33 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:53:33 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:53:33 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:53:33 user nova-compute[75391]:     </memballoon>
Nov 15 02:53:33 user nova-compute[75391]:   </devices>
Nov 15 02:53:33 user nova-compute[75391]: </domain>
Nov 15 02:53:33 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:53:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1365258568',display_name='tempest-TestServerVolumeAttachmentScenario-server-1365258568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1365258568',id=33,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6A5pg0RsKEV6XMaGP6LOF1vsDU3VFzTD0LtR24Aa7sLrPs6xC12QkuElfCTEnInkaWfn2SElhRDMc1/0hujZhVM9FVQi8D0b/lRin9PVq0nx6Lctczyq2BTThrDeKa7g==',key_name='tempest-keypair-1854765738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='592f722752cf4cc48a70b3227d2ff3ea',ramdisk_id='',reservation_id='r-qtndhl3h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-976815340',owner_user_name='tempest-TestServerVolumeAttachmentScenario-976815340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:53:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f51f562108e4e0a9c2e61d0a0198bd3',uuid=04dcd079-e89f-401c-a7ae-8af96beb3d6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "285df593-2636-40a8-a8e8-1e01e84d0c0b", "address": "fa:16:3e:a9:37:1c", "network": {"id": "b93bc3bd-6927-4924-a435-7d5199e553ad", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-840530940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "592f722752cf4cc48a70b3227d2ff3ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap285df593-26", "ovs_interfaceid": "285df593-2636-40a8-a8e8-1e01e84d0c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Converting VIF {"id": "285df593-2636-40a8-a8e8-1e01e84d0c0b", "address": "fa:16:3e:a9:37:1c", "network": {"id": "b93bc3bd-6927-4924-a435-7d5199e553ad", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-840530940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "592f722752cf4cc48a70b3227d2ff3ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap285df593-26", "ovs_interfaceid": "285df593-2636-40a8-a8e8-1e01e84d0c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:37:1c,bridge_name='br-int',has_traffic_filtering=True,id=285df593-2636-40a8-a8e8-1e01e84d0c0b,network=Network(b93bc3bd-6927-4924-a435-7d5199e553ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap285df593-26') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG os_vif [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:37:1c,bridge_name='br-int',has_traffic_filtering=True,id=285df593-2636-40a8-a8e8-1e01e84d0c0b,network=Network(b93bc3bd-6927-4924-a435-7d5199e553ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap285df593-26') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d63c34c-9652-5044-900b-29b6940cf7fb', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap285df593-26, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap285df593-26, col_values=(('qos', UUID('7a2d4f79-3367-43a1-831f-a27177314ace')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap285df593-26, col_values=(('external_ids', {'iface-id': '285df593-2636-40a8-a8e8-1e01e84d0c0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:37:1c', 'vm-uuid': '04dcd079-e89f-401c-a7ae-8af96beb3d6d'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:33 user nova-compute[75391]: INFO os_vif [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:37:1c,bridge_name='br-int',has_traffic_filtering=True,id=285df593-2636-40a8-a8e8-1e01e84d0c0b,network=Network(b93bc3bd-6927-4924-a435-7d5199e553ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap285df593-26')
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-b803f612-c8c5-4716-99c9-fa74f58ed947 req-7aa559b9-1b7f-407e-8703-ff369df08e2b service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Received event network-vif-plugged-f81de438-c24a-4cc9-93ab-508fea76d915 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b803f612-c8c5-4716-99c9-fa74f58ed947 req-7aa559b9-1b7f-407e-8703-ff369df08e2b service nova] Acquiring lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b803f612-c8c5-4716-99c9-fa74f58ed947 req-7aa559b9-1b7f-407e-8703-ff369df08e2b service nova] Lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b803f612-c8c5-4716-99c9-fa74f58ed947 req-7aa559b9-1b7f-407e-8703-ff369df08e2b service nova] Lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-b803f612-c8c5-4716-99c9-fa74f58ed947 req-7aa559b9-1b7f-407e-8703-ff369df08e2b service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] No waiting events found dispatching network-vif-plugged-f81de438-c24a-4cc9-93ab-508fea76d915 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:53:33 user nova-compute[75391]: WARNING nova.compute.manager [req-b803f612-c8c5-4716-99c9-fa74f58ed947 req-7aa559b9-1b7f-407e-8703-ff369df08e2b service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Received unexpected event network-vif-plugged-f81de438-c24a-4cc9-93ab-508fea76d915 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-b803f612-c8c5-4716-99c9-fa74f58ed947 req-7aa559b9-1b7f-407e-8703-ff369df08e2b service nova] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Received event network-changed-285df593-2636-40a8-a8e8-1e01e84d0c0b {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-b803f612-c8c5-4716-99c9-fa74f58ed947 req-7aa559b9-1b7f-407e-8703-ff369df08e2b service nova] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Refreshing instance network info cache due to event network-changed-285df593-2636-40a8-a8e8-1e01e84d0c0b. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b803f612-c8c5-4716-99c9-fa74f58ed947 req-7aa559b9-1b7f-407e-8703-ff369df08e2b service nova] Acquiring lock "refresh_cache-04dcd079-e89f-401c-a7ae-8af96beb3d6d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b803f612-c8c5-4716-99c9-fa74f58ed947 req-7aa559b9-1b7f-407e-8703-ff369df08e2b service nova] Acquired lock "refresh_cache-04dcd079-e89f-401c-a7ae-8af96beb3d6d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.network.neutron [req-b803f612-c8c5-4716-99c9-fa74f58ed947 req-7aa559b9-1b7f-407e-8703-ff369df08e2b service nova] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Refreshing network info cache for port 285df593-2636-40a8-a8e8-1e01e84d0c0b {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] No VIF found with MAC fa:16:3e:a9:37:1c, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:53:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk /opt/stack/data/nova/instances/snapshots/tmpm6u8imav/bf097780c5e74354a97613d701d65ae9" returned: 0 in 1.031s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:33 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Snapshot extracted, beginning image upload
Nov 15 02:53:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26166303839326134', 'path': '/dev/sdd'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166303839326134', 'path': '/dev/sdd'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:53:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1960364305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1960364305',id=31,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e63a88a9fe824c3e9c0807a50b569d54',ramdisk_id='',reservation_id='r-zgxz855s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-141063167',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:53:22Z,user_data=None,user_id='0aa106a59c374dde99b7697f94407339',uuid=c767fb74-e57f-4ea0-bf4e-4034cf656a78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "address": "fa:16:3e:9e:b6:f5", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a80868d-8a", "ovs_interfaceid": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Converting VIF {"id": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "address": "fa:16:3e:9e:b6:f5", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a80868d-8a", "ovs_interfaceid": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b6:f5,bridge_name='br-int',has_traffic_filtering=True,id=5a80868d-8a1f-4a83-8c22-d3f504963bbc,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a80868d-8a') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG nova.objects.instance [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lazy-loading 'pci_devices' on Instance uuid c767fb74-e57f-4ea0-bf4e-4034cf656a78 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:53:34 user nova-compute[75391]:   <uuid>c767fb74-e57f-4ea0-bf4e-4034cf656a78</uuid>
Nov 15 02:53:34 user nova-compute[75391]:   <name>instance-0000001f</name>
Nov 15 02:53:34 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:53:34 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:53:34 user nova-compute[75391]:   <metadata>
Nov 15 02:53:34 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:53:34 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:53:34 user nova-compute[75391]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1960364305</nova:name>
Nov 15 02:53:34 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:53:32</nova:creationTime>
Nov 15 02:53:34 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:53:34 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:53:34 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:53:34 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:53:34 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:53:34 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:53:34 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:53:34 user nova-compute[75391]:       <nova:owner>
Nov 15 02:53:34 user nova-compute[75391]:         <nova:user uuid="0aa106a59c374dde99b7697f94407339">tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member</nova:user>
Nov 15 02:53:34 user nova-compute[75391]:         <nova:project uuid="e63a88a9fe824c3e9c0807a50b569d54">tempest-ServerBootFromVolumeStableRescueTest-141063167</nova:project>
Nov 15 02:53:34 user nova-compute[75391]:       </nova:owner>
Nov 15 02:53:34 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:53:34 user nova-compute[75391]:       <nova:ports>
Nov 15 02:53:34 user nova-compute[75391]:         <nova:port uuid="5a80868d-8a1f-4a83-8c22-d3f504963bbc">
Nov 15 02:53:34 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 02:53:34 user nova-compute[75391]:         </nova:port>
Nov 15 02:53:34 user nova-compute[75391]:       </nova:ports>
Nov 15 02:53:34 user nova-compute[75391]:     </nova:instance>
Nov 15 02:53:34 user nova-compute[75391]:   </metadata>
Nov 15 02:53:34 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:53:34 user nova-compute[75391]:     <system>
Nov 15 02:53:34 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:53:34 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:53:34 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:53:34 user nova-compute[75391]:       <entry name="serial">c767fb74-e57f-4ea0-bf4e-4034cf656a78</entry>
Nov 15 02:53:34 user nova-compute[75391]:       <entry name="uuid">c767fb74-e57f-4ea0-bf4e-4034cf656a78</entry>
Nov 15 02:53:34 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:53:34 user nova-compute[75391]:     </system>
Nov 15 02:53:34 user nova-compute[75391]:   </sysinfo>
Nov 15 02:53:34 user nova-compute[75391]:   <os>
Nov 15 02:53:34 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:53:34 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:53:34 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:53:34 user nova-compute[75391]:   </os>
Nov 15 02:53:34 user nova-compute[75391]:   <features>
Nov 15 02:53:34 user nova-compute[75391]:     <acpi/>
Nov 15 02:53:34 user nova-compute[75391]:     <apic/>
Nov 15 02:53:34 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:53:34 user nova-compute[75391]:   </features>
Nov 15 02:53:34 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:53:34 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:53:34 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:53:34 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:53:34 user nova-compute[75391]:   </clock>
Nov 15 02:53:34 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:53:34 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:53:34 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:53:34 user nova-compute[75391]:   </cpu>
Nov 15 02:53:34 user nova-compute[75391]:   <devices>
Nov 15 02:53:34 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 02:53:34 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:53:34 user nova-compute[75391]:       <source dev="/dev/sdd"/>
Nov 15 02:53:34 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:53:34 user nova-compute[75391]:       <serial>4aadee61-9526-4ff0-9a9b-16861d006d39</serial>
Nov 15 02:53:34 user nova-compute[75391]:     </disk>
Nov 15 02:53:34 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:53:34 user nova-compute[75391]:       <mac address="fa:16:3e:9e:b6:f5"/>
Nov 15 02:53:34 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:53:34 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:53:34 user nova-compute[75391]:       <target dev="tap5a80868d-8a"/>
Nov 15 02:53:34 user nova-compute[75391]:     </interface>
Nov 15 02:53:34 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:53:34 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/c767fb74-e57f-4ea0-bf4e-4034cf656a78/console.log" append="off"/>
Nov 15 02:53:34 user nova-compute[75391]:     </serial>
Nov 15 02:53:34 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:53:34 user nova-compute[75391]:     <video>
Nov 15 02:53:34 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:53:34 user nova-compute[75391]:     </video>
Nov 15 02:53:34 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:53:34 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:53:34 user nova-compute[75391]:     </rng>
Nov 15 02:53:34 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:53:34 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:53:34 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:53:34 user nova-compute[75391]:     </memballoon>
Nov 15 02:53:34 user nova-compute[75391]:   </devices>
Nov 15 02:53:34 user nova-compute[75391]: </domain>
Nov 15 02:53:34 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:53:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1960364305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1960364305',id=31,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e63a88a9fe824c3e9c0807a50b569d54',ramdisk_id='',reservation_id='r-zgxz855s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-141063167',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:53:22Z,user_data=None,user_id='0aa106a59c374dde99b7697f94407339',uuid=c767fb74-e57f-4ea0-bf4e-4034cf656a78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "address": "fa:16:3e:9e:b6:f5", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a80868d-8a", "ovs_interfaceid": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Converting VIF {"id": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "address": "fa:16:3e:9e:b6:f5", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a80868d-8a", "ovs_interfaceid": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b6:f5,bridge_name='br-int',has_traffic_filtering=True,id=5a80868d-8a1f-4a83-8c22-d3f504963bbc,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a80868d-8a') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG os_vif [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b6:f5,bridge_name='br-int',has_traffic_filtering=True,id=5a80868d-8a1f-4a83-8c22-d3f504963bbc,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a80868d-8a') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1c67f15-fe3e-5402-9c3e-0bede6c38ff2', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a80868d-8a, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a80868d-8a, col_values=(('qos', UUID('3841c2d6-184f-4efb-abfc-431d30f50fc2')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a80868d-8a, col_values=(('external_ids', {'iface-id': '5a80868d-8a1f-4a83-8c22-d3f504963bbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:b6:f5', 'vm-uuid': 'c767fb74-e57f-4ea0-bf4e-4034cf656a78'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:34 user nova-compute[75391]: INFO os_vif [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b6:f5,bridge_name='br-int',has_traffic_filtering=True,id=5a80868d-8a1f-4a83-8c22-d3f504963bbc,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a80868d-8a')
Nov 15 02:53:34 user nova-compute[75391]: DEBUG nova.network.neutron [req-b803f612-c8c5-4716-99c9-fa74f58ed947 req-7aa559b9-1b7f-407e-8703-ff369df08e2b service nova] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Updated VIF entry in instance network info cache for port 285df593-2636-40a8-a8e8-1e01e84d0c0b. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG nova.network.neutron [req-b803f612-c8c5-4716-99c9-fa74f58ed947 req-7aa559b9-1b7f-407e-8703-ff369df08e2b service nova] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Updating instance_info_cache with network_info: [{"id": "285df593-2636-40a8-a8e8-1e01e84d0c0b", "address": "fa:16:3e:a9:37:1c", "network": {"id": "b93bc3bd-6927-4924-a435-7d5199e553ad", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-840530940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "592f722752cf4cc48a70b3227d2ff3ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap285df593-26", "ovs_interfaceid": "285df593-2636-40a8-a8e8-1e01e84d0c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b803f612-c8c5-4716-99c9-fa74f58ed947 req-7aa559b9-1b7f-407e-8703-ff369df08e2b service nova] Releasing lock "refresh_cache-04dcd079-e89f-401c-a7ae-8af96beb3d6d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG nova.compute.manager [req-b803f612-c8c5-4716-99c9-fa74f58ed947 req-7aa559b9-1b7f-407e-8703-ff369df08e2b service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Received event network-vif-plugged-f4cd02a6-d62a-435e-93fd-e5216134f788 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b803f612-c8c5-4716-99c9-fa74f58ed947 req-7aa559b9-1b7f-407e-8703-ff369df08e2b service nova] Acquiring lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b803f612-c8c5-4716-99c9-fa74f58ed947 req-7aa559b9-1b7f-407e-8703-ff369df08e2b service nova] Lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b803f612-c8c5-4716-99c9-fa74f58ed947 req-7aa559b9-1b7f-407e-8703-ff369df08e2b service nova] Lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG nova.compute.manager [req-b803f612-c8c5-4716-99c9-fa74f58ed947 req-7aa559b9-1b7f-407e-8703-ff369df08e2b service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] No waiting events found dispatching network-vif-plugged-f4cd02a6-d62a-435e-93fd-e5216134f788 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:53:34 user nova-compute[75391]: WARNING nova.compute.manager [req-b803f612-c8c5-4716-99c9-fa74f58ed947 req-7aa559b9-1b7f-407e-8703-ff369df08e2b service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Received unexpected event network-vif-plugged-f4cd02a6-d62a-435e-93fd-e5216134f788 for instance with vm_state building and task_state spawning.
Nov 15 02:53:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:53:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] No VIF found with MAC fa:16:3e:9e:b6:f5, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:53:35 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:53:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:53:35 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Instance spawned successfully.
Nov 15 02:53:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:53:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:53:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:53:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:53:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:53:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:53:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:53:35 user nova-compute[75391]: INFO nova.compute.manager [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Took 5.92 seconds to spawn the instance on the hypervisor.
Nov 15 02:53:35 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:53:35 user nova-compute[75391]: INFO nova.compute.manager [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Took 12.27 seconds to build instance.
Nov 15 02:53:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f17286a8-0ff5-4af0-b336-89b6ca05eaac tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "a0382af0-0509-4473-832f-1e5e6588be2e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.410s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-bab96655-0b14-467e-b2ce-14d14716eaa8 req-0126391f-75ad-4332-ab1c-f9898fc8ad41 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Received event network-vif-plugged-f4cd02a6-d62a-435e-93fd-e5216134f788 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:53:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bab96655-0b14-467e-b2ce-14d14716eaa8 req-0126391f-75ad-4332-ab1c-f9898fc8ad41 service nova] Acquiring lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bab96655-0b14-467e-b2ce-14d14716eaa8 req-0126391f-75ad-4332-ab1c-f9898fc8ad41 service nova] Lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bab96655-0b14-467e-b2ce-14d14716eaa8 req-0126391f-75ad-4332-ab1c-f9898fc8ad41 service nova] Lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-bab96655-0b14-467e-b2ce-14d14716eaa8 req-0126391f-75ad-4332-ab1c-f9898fc8ad41 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] No waiting events found dispatching network-vif-plugged-f4cd02a6-d62a-435e-93fd-e5216134f788 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:53:35 user nova-compute[75391]: WARNING nova.compute.manager [req-bab96655-0b14-467e-b2ce-14d14716eaa8 req-0126391f-75ad-4332-ab1c-f9898fc8ad41 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Received unexpected event network-vif-plugged-f4cd02a6-d62a-435e-93fd-e5216134f788 for instance with vm_state active and task_state None.
Nov 15 02:53:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:36 user nova-compute[75391]: DEBUG nova.compute.manager [req-0063b71e-0d5a-4483-9e95-b4cbabfb2477 req-c4601b5b-c4c5-42b5-9603-4a39f66dd32c service nova] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Received event network-vif-plugged-285df593-2636-40a8-a8e8-1e01e84d0c0b {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:53:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0063b71e-0d5a-4483-9e95-b4cbabfb2477 req-c4601b5b-c4c5-42b5-9603-4a39f66dd32c service nova] Acquiring lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0063b71e-0d5a-4483-9e95-b4cbabfb2477 req-c4601b5b-c4c5-42b5-9603-4a39f66dd32c service nova] Lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0063b71e-0d5a-4483-9e95-b4cbabfb2477 req-c4601b5b-c4c5-42b5-9603-4a39f66dd32c service nova] Lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:36 user nova-compute[75391]: DEBUG nova.compute.manager [req-0063b71e-0d5a-4483-9e95-b4cbabfb2477 req-c4601b5b-c4c5-42b5-9603-4a39f66dd32c service nova] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] No waiting events found dispatching network-vif-plugged-285df593-2636-40a8-a8e8-1e01e84d0c0b {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:53:36 user nova-compute[75391]: WARNING nova.compute.manager [req-0063b71e-0d5a-4483-9e95-b4cbabfb2477 req-c4601b5b-c4c5-42b5-9603-4a39f66dd32c service nova] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Received unexpected event network-vif-plugged-285df593-2636-40a8-a8e8-1e01e84d0c0b for instance with vm_state building and task_state spawning.
Nov 15 02:53:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:36 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Snapshot image upload complete
Nov 15 02:53:36 user nova-compute[75391]: DEBUG nova.compute.manager [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:53:36 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4dd99dea-60d3-4eed-86c7-8d9d0522ae84 is timed out.
Nov 15 02:53:36 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Successfully detached device vdb from instance 4dd99dea-60d3-4eed-86c7-8d9d0522ae84 from the live domain config.
Nov 15 02:53:36 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:53:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcBbvuPR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:53:36 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:53:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:53:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:53:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e469d2b3-5bc3-4e9e-b1d4-6ddb9129309d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:53:36 user nova-compute[75391]: No targets found.
Nov 15 02:53:36 user nova-compute[75391]: iSNS:
Nov 15 02:53:36 user nova-compute[75391]: No targets found.
Nov 15 02:53:36 user nova-compute[75391]: STATIC:
Nov 15 02:53:36 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad
Nov 15 02:53:36 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:53:36 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:53:36 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b
Nov 15 02:53:36 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:53:36 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:53:36 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:53:36 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:53:36 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:53:36 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39
Nov 15 02:53:36 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:53:36 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:53:36 user nova-compute[75391]: FIRMWARE:
Nov 15 02:53:36 user nova-compute[75391]: No targets found.
Nov 15 02:53:36 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:53:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:53:36 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:53:36 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:53:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:53:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c6848c-129a-4b53-9224-600aa23febc4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:36 user nova-compute[75391]: INFO nova.compute.manager [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Shelve offloading
Nov 15 02:53:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a5cfb2-b38d-450f-a5af-7481f237296d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:53:37 user nova-compute[75391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad (non-flash)
Nov 15 02:53:37 user nova-compute[75391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:53:37 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:53:37 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:53:37 user nova-compute[75391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad (non-flash)
Nov 15 02:53:37 user nova-compute[75391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:53:37 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:53:37 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f623c0fd3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad'): ({'sdb'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Removing single pathed devices sdb {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:37 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Instance destroyed successfully.
Nov 15 02:53:37 user nova-compute[75391]: DEBUG nova.compute.manager [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "refresh_cache-341dfd0a-e264-4a6f-9537-35ba9ed980c4" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquired lock "refresh_cache-341dfd0a-e264-4a6f-9537-35ba9ed980c4" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG nova.network.neutron [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.038s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[147dcd90-bfb8-4650-adb5-90430d4c4df4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2070c4d7-8610-40cc-b16b-8bd45fa07201]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Flushing IO for device /dev/sdb {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3112d7e8-d597-4e79-93ca-3321151a6658]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b596fe9-d72b-4ef3-b28a-5a3fb9b8059c]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc54491-55bf-4cc4-aa68-e2e1504e30dc]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87b9c03-d4dc-4dc4-9838-cf6b83165c8c]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad, portal: 172.16.0.220,3260]
Nov 15 02:53:37 user nova-compute[75391]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad, portal: 172.16.0.220,3260] successful.
Nov 15 02:53:37 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0130a6b3-f1be-409a-8c31-2f96036cee3c]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] <== disconnect_volume: return (410ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG nova.network.neutron [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Updating instance_info_cache with network_info: [{"id": "f81de438-c24a-4cc9-93ab-508fea76d915", "address": "fa:16:3e:47:1f:19", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81de438-c2", "ovs_interfaceid": "f81de438-c24a-4cc9-93ab-508fea76d915", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:53:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Releasing lock "refresh_cache-341dfd0a-e264-4a6f-9537-35ba9ed980c4" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:53:38 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Instance destroyed successfully.
Nov 15 02:53:38 user nova-compute[75391]: DEBUG nova.objects.instance [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lazy-loading 'resources' on Instance uuid 341dfd0a-e264-4a6f-9537-35ba9ed980c4 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:51:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1537643616',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1537643616',id=29,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCu4IfiOZPm3KyuOaYSN4M4+7uOjK/OnaZ7mhQIa6lz/tRN9r5cdTcBKJ4tzvISaaZiS/s0sLlyzlSseEUIXJd+JaUm/xpbxsb+yeAKpEvDCq1oFjmVIJOgsVJAbcyB/w==',key_name='tempest-keypair-1968484645',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:51:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f1ec3021653b4209a509852c7a28bf46',ramdisk_id='',reservation_id='r-mwaawx6j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1315675398',owner_user_name='tempest-AttachVolumeShelveTestJSON-1315675398-project-member',shelved_at='2023-11-15T02:53:36.895430',shelved_host='user',shelved_image_id='fd572c92-9fde-4b28-b495-3b0e446a9d3a'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:53:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e55cae841f994756843bc97a063ebe86',uuid=341dfd0a-e264-4a6f-9537-35ba9ed980c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "f81de438-c24a-4cc9-93ab-508fea76d915", "address": "fa:16:3e:47:1f:19", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81de438-c2", "ovs_interfaceid": "f81de438-c24a-4cc9-93ab-508fea76d915", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Converting VIF {"id": "f81de438-c24a-4cc9-93ab-508fea76d915", "address": "fa:16:3e:47:1f:19", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81de438-c2", "ovs_interfaceid": "f81de438-c24a-4cc9-93ab-508fea76d915", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:1f:19,bridge_name='br-int',has_traffic_filtering=True,id=f81de438-c24a-4cc9-93ab-508fea76d915,network=Network(64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf81de438-c2') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG os_vif [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:1f:19,bridge_name='br-int',has_traffic_filtering=True,id=f81de438-c24a-4cc9-93ab-508fea76d915,network=Network(64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf81de438-c2') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf81de438-c2, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG nova.compute.manager [req-705e0987-6372-4512-93eb-84ce32e31836 req-1220d007-5bdd-4887-9446-7898755d04e1 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Received event network-changed-f81de438-c24a-4cc9-93ab-508fea76d915 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG nova.compute.manager [req-705e0987-6372-4512-93eb-84ce32e31836 req-1220d007-5bdd-4887-9446-7898755d04e1 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Refreshing instance network info cache due to event network-changed-f81de438-c24a-4cc9-93ab-508fea76d915. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-705e0987-6372-4512-93eb-84ce32e31836 req-1220d007-5bdd-4887-9446-7898755d04e1 service nova] Acquiring lock "refresh_cache-341dfd0a-e264-4a6f-9537-35ba9ed980c4" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-705e0987-6372-4512-93eb-84ce32e31836 req-1220d007-5bdd-4887-9446-7898755d04e1 service nova] Acquired lock "refresh_cache-341dfd0a-e264-4a6f-9537-35ba9ed980c4" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG nova.network.neutron [req-705e0987-6372-4512-93eb-84ce32e31836 req-1220d007-5bdd-4887-9446-7898755d04e1 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Refreshing network info cache for port f81de438-c24a-4cc9-93ab-508fea76d915 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b063b279-3239-4566-909b-3799e46005d7) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:38 user nova-compute[75391]: INFO os_vif [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:1f:19,bridge_name='br-int',has_traffic_filtering=True,id=f81de438-c24a-4cc9-93ab-508fea76d915,network=Network(64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf81de438-c2')
Nov 15 02:53:38 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Deleting instance files /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4_del
Nov 15 02:53:38 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Deletion of /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4_del complete
Nov 15 02:53:38 user nova-compute[75391]: DEBUG nova.objects.instance [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lazy-loading 'flavor' on Instance uuid 4dd99dea-60d3-4eed-86c7-8d9d0522ae84 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-db6a45a1-73f6-4190-aa6f-189df31a2b9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.968s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:38 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Deleted allocations for instance 341dfd0a-e264-4a6f-9537-35ba9ed980c4
Nov 15 02:53:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.860s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:38 user nova-compute[75391]: INFO nova.compute.manager [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Terminating instance
Nov 15 02:53:38 user nova-compute[75391]: DEBUG nova.compute.manager [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG nova.objects.instance [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lazy-loading 'numa_topology' on Instance uuid 341dfd0a-e264-4a6f-9537-35ba9ed980c4 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG nova.objects.base [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Object Instance<341dfd0a-e264-4a6f-9537-35ba9ed980c4> lazy-loaded attributes: resources,numa_topology {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG nova.compute.manager [req-7f271f53-a6a2-4ae4-863a-34c78c3f1d2d req-435b2811-0751-4746-8b13-9ef0c48c0f50 service nova] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Received event network-vif-plugged-285df593-2636-40a8-a8e8-1e01e84d0c0b {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7f271f53-a6a2-4ae4-863a-34c78c3f1d2d req-435b2811-0751-4746-8b13-9ef0c48c0f50 service nova] Acquiring lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7f271f53-a6a2-4ae4-863a-34c78c3f1d2d req-435b2811-0751-4746-8b13-9ef0c48c0f50 service nova] Lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7f271f53-a6a2-4ae4-863a-34c78c3f1d2d req-435b2811-0751-4746-8b13-9ef0c48c0f50 service nova] Lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG nova.compute.manager [req-7f271f53-a6a2-4ae4-863a-34c78c3f1d2d req-435b2811-0751-4746-8b13-9ef0c48c0f50 service nova] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] No waiting events found dispatching network-vif-plugged-285df593-2636-40a8-a8e8-1e01e84d0c0b {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:53:38 user nova-compute[75391]: WARNING nova.compute.manager [req-7f271f53-a6a2-4ae4-863a-34c78c3f1d2d req-435b2811-0751-4746-8b13-9ef0c48c0f50 service nova] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Received unexpected event network-vif-plugged-285df593-2636-40a8-a8e8-1e01e84d0c0b for instance with vm_state building and task_state spawning.
Nov 15 02:53:38 user nova-compute[75391]: DEBUG nova.compute.manager [req-7f271f53-a6a2-4ae4-863a-34c78c3f1d2d req-435b2811-0751-4746-8b13-9ef0c48c0f50 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7f271f53-a6a2-4ae4-863a-34c78c3f1d2d req-435b2811-0751-4746-8b13-9ef0c48c0f50 service nova] Acquiring lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7f271f53-a6a2-4ae4-863a-34c78c3f1d2d req-435b2811-0751-4746-8b13-9ef0c48c0f50 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7f271f53-a6a2-4ae4-863a-34c78c3f1d2d req-435b2811-0751-4746-8b13-9ef0c48c0f50 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG nova.compute.manager [req-7f271f53-a6a2-4ae4-863a-34c78c3f1d2d req-435b2811-0751-4746-8b13-9ef0c48c0f50 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] No waiting events found dispatching network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:53:38 user nova-compute[75391]: WARNING nova.compute.manager [req-7f271f53-a6a2-4ae4-863a-34c78c3f1d2d req-435b2811-0751-4746-8b13-9ef0c48c0f50 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received unexpected event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc for instance with vm_state building and task_state spawning.
Nov 15 02:53:38 user nova-compute[75391]: DEBUG nova.compute.manager [req-7f271f53-a6a2-4ae4-863a-34c78c3f1d2d req-435b2811-0751-4746-8b13-9ef0c48c0f50 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7f271f53-a6a2-4ae4-863a-34c78c3f1d2d req-435b2811-0751-4746-8b13-9ef0c48c0f50 service nova] Acquiring lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7f271f53-a6a2-4ae4-863a-34c78c3f1d2d req-435b2811-0751-4746-8b13-9ef0c48c0f50 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7f271f53-a6a2-4ae4-863a-34c78c3f1d2d req-435b2811-0751-4746-8b13-9ef0c48c0f50 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG nova.compute.manager [req-7f271f53-a6a2-4ae4-863a-34c78c3f1d2d req-435b2811-0751-4746-8b13-9ef0c48c0f50 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] No waiting events found dispatching network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:53:38 user nova-compute[75391]: WARNING nova.compute.manager [req-7f271f53-a6a2-4ae4-863a-34c78c3f1d2d req-435b2811-0751-4746-8b13-9ef0c48c0f50 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received unexpected event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc for instance with vm_state building and task_state spawning.
Nov 15 02:53:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:53:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.598s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-46abd5dd-1305-482e-bee8-ff45663491aa tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.961s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.network.neutron [req-705e0987-6372-4512-93eb-84ce32e31836 req-1220d007-5bdd-4887-9446-7898755d04e1 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Updated VIF entry in instance network info cache for port f81de438-c24a-4cc9-93ab-508fea76d915. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.network.neutron [req-705e0987-6372-4512-93eb-84ce32e31836 req-1220d007-5bdd-4887-9446-7898755d04e1 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Updating instance_info_cache with network_info: [{"id": "f81de438-c24a-4cc9-93ab-508fea76d915", "address": "fa:16:3e:47:1f:19", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf81de438-c2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-705e0987-6372-4512-93eb-84ce32e31836 req-1220d007-5bdd-4887-9446-7898755d04e1 service nova] Releasing lock "refresh_cache-341dfd0a-e264-4a6f-9537-35ba9ed980c4" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:39 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Instance destroyed successfully.
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.objects.instance [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lazy-loading 'resources' on Instance uuid 4dd99dea-60d3-4eed-86c7-8d9d0522ae84 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:51:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1741925017',display_name='tempest-VolumesSnapshotTestJSON-instance-1741925017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1741925017',id=28,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJxxT62jsmc4HPH0QPlQT1pK3htbJm5DTQWqHcv/oDWrnX29fnZVpaNW1iN0egjL4NNFFkvciNNoHPgLqUIm9Tek6Wq0OfcnQmsQsHLhGyi9+n0Yzay9Ix3mgT3z9GO+Q==',key_name='tempest-keypair-1887836886',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:51:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c96a31c2c4cb4586857b6179adf48ec0',ramdisk_id='',reservation_id='r-k1yv8mxa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1270812690',owner_user_name='tempest-VolumesSnapshotTestJSON-1270812690-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:51:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a5832ec3e834e4c8e11d671f7891cdf',uuid=4dd99dea-60d3-4eed-86c7-8d9d0522ae84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d76118a0-ca86-4748-a834-00ed12aa1b23", "address": "fa:16:3e:7b:22:f3", "network": {"id": "07cd9e35-dfd4-4a08-ac37-52c7bfefa42e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1490748469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96a31c2c4cb4586857b6179adf48ec0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd76118a0-ca", "ovs_interfaceid": "d76118a0-ca86-4748-a834-00ed12aa1b23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Converting VIF {"id": "d76118a0-ca86-4748-a834-00ed12aa1b23", "address": "fa:16:3e:7b:22:f3", "network": {"id": "07cd9e35-dfd4-4a08-ac37-52c7bfefa42e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1490748469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c96a31c2c4cb4586857b6179adf48ec0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd76118a0-ca", "ovs_interfaceid": "d76118a0-ca86-4748-a834-00ed12aa1b23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:22:f3,bridge_name='br-int',has_traffic_filtering=True,id=d76118a0-ca86-4748-a834-00ed12aa1b23,network=Network(07cd9e35-dfd4-4a08-ac37-52c7bfefa42e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd76118a0-ca') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG os_vif [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:22:f3,bridge_name='br-int',has_traffic_filtering=True,id=d76118a0-ca86-4748-a834-00ed12aa1b23,network=Network(07cd9e35-dfd4-4a08-ac37-52c7bfefa42e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd76118a0-ca') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd76118a0-ca, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e17141e9-f92d-4cd6-81c3-672dd051bb26) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:39 user nova-compute[75391]: INFO os_vif [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:22:f3,bridge_name='br-int',has_traffic_filtering=True,id=d76118a0-ca86-4748-a834-00ed12aa1b23,network=Network(07cd9e35-dfd4-4a08-ac37-52c7bfefa42e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd76118a0-ca')
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcBbvuPR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:53:39 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:53:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8682c5a-6924-41cf-9516-80af43f3c4d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:53:39 user nova-compute[75391]: No targets found.
Nov 15 02:53:39 user nova-compute[75391]: iSNS:
Nov 15 02:53:39 user nova-compute[75391]: No targets found.
Nov 15 02:53:39 user nova-compute[75391]: STATIC:
Nov 15 02:53:39 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b
Nov 15 02:53:39 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:53:39 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:53:39 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:53:39 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:53:39 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:53:39 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39
Nov 15 02:53:39 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:53:39 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:53:39 user nova-compute[75391]: FIRMWARE:
Nov 15 02:53:39 user nova-compute[75391]: No targets found.
Nov 15 02:53:39 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:53:39 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:53:39 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a2d4d96-2413-41d9-ab05-678e5a606fad', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[523a84eb-95b1-4efb-b3d8-43772a209050]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b13572e-9756-42ec-bd61-eedd8d1d5477]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:53:39 user nova-compute[75391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:53:39 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:53:39 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:53:39 user nova-compute[75391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:53:39 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:53:39 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6224632200>, {}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Disconnecting from: [] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.108s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] <== disconnect_volume: return (109ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:53:39 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Deleting instance files /opt/stack/data/nova/instances/4dd99dea-60d3-4eed-86c7-8d9d0522ae84_del
Nov 15 02:53:39 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Deletion of /opt/stack/data/nova/instances/4dd99dea-60d3-4eed-86c7-8d9d0522ae84_del complete
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:53:39 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Instance spawned successfully.
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.compute.manager [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:53:39 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Instance spawned successfully.
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:53:39 user nova-compute[75391]: INFO nova.compute.manager [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 15 02:53:39 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:53:39 user nova-compute[75391]: INFO nova.compute.manager [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Took 6.82 seconds to spawn the instance on the hypervisor.
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:53:39 user nova-compute[75391]: INFO nova.compute.manager [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Took 7.87 seconds to spawn the instance on the hypervisor.
Nov 15 02:53:39 user nova-compute[75391]: DEBUG nova.compute.manager [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:53:39 user nova-compute[75391]: INFO nova.compute.manager [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Took 18.70 seconds to build instance.
Nov 15 02:53:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba973eb6-a7f2-4e57-a37a-3095c1fb3048 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.818s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:39 user nova-compute[75391]: INFO nova.compute.manager [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Took 9.02 seconds to build instance.
Nov 15 02:53:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6c1288df-f1d0-40ed-b51b-92ed99837031 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.116s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:40 user nova-compute[75391]: DEBUG nova.compute.manager [req-4447ff0f-9d85-4d07-9faa-f53b107da3b4 req-1f8e8cfc-ab57-44a4-b60c-167fe04d2f71 service nova] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Received event network-vif-unplugged-d76118a0-ca86-4748-a834-00ed12aa1b23 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:53:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4447ff0f-9d85-4d07-9faa-f53b107da3b4 req-1f8e8cfc-ab57-44a4-b60c-167fe04d2f71 service nova] Acquiring lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4447ff0f-9d85-4d07-9faa-f53b107da3b4 req-1f8e8cfc-ab57-44a4-b60c-167fe04d2f71 service nova] Lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4447ff0f-9d85-4d07-9faa-f53b107da3b4 req-1f8e8cfc-ab57-44a4-b60c-167fe04d2f71 service nova] Lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:40 user nova-compute[75391]: DEBUG nova.compute.manager [req-4447ff0f-9d85-4d07-9faa-f53b107da3b4 req-1f8e8cfc-ab57-44a4-b60c-167fe04d2f71 service nova] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] No waiting events found dispatching network-vif-unplugged-d76118a0-ca86-4748-a834-00ed12aa1b23 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:53:40 user nova-compute[75391]: DEBUG nova.compute.manager [req-4447ff0f-9d85-4d07-9faa-f53b107da3b4 req-1f8e8cfc-ab57-44a4-b60c-167fe04d2f71 service nova] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Received event network-vif-unplugged-d76118a0-ca86-4748-a834-00ed12aa1b23 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:53:40 user nova-compute[75391]: DEBUG nova.compute.manager [req-4447ff0f-9d85-4d07-9faa-f53b107da3b4 req-1f8e8cfc-ab57-44a4-b60c-167fe04d2f71 service nova] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Received event network-vif-plugged-d76118a0-ca86-4748-a834-00ed12aa1b23 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:53:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4447ff0f-9d85-4d07-9faa-f53b107da3b4 req-1f8e8cfc-ab57-44a4-b60c-167fe04d2f71 service nova] Acquiring lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4447ff0f-9d85-4d07-9faa-f53b107da3b4 req-1f8e8cfc-ab57-44a4-b60c-167fe04d2f71 service nova] Lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4447ff0f-9d85-4d07-9faa-f53b107da3b4 req-1f8e8cfc-ab57-44a4-b60c-167fe04d2f71 service nova] Lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:40 user nova-compute[75391]: DEBUG nova.compute.manager [req-4447ff0f-9d85-4d07-9faa-f53b107da3b4 req-1f8e8cfc-ab57-44a4-b60c-167fe04d2f71 service nova] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] No waiting events found dispatching network-vif-plugged-d76118a0-ca86-4748-a834-00ed12aa1b23 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:53:40 user nova-compute[75391]: WARNING nova.compute.manager [req-4447ff0f-9d85-4d07-9faa-f53b107da3b4 req-1f8e8cfc-ab57-44a4-b60c-167fe04d2f71 service nova] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Received unexpected event network-vif-plugged-d76118a0-ca86-4748-a834-00ed12aa1b23 for instance with vm_state active and task_state deleting.
Nov 15 02:53:40 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:53:40 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Took 1.08 seconds to deallocate network for instance.
Nov 15 02:53:40 user nova-compute[75391]: WARNING nova.volume.cinder [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Attachment 3d29f01b-011b-4b17-8a3c-911f9c8154c0 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3d29f01b-011b-4b17-8a3c-911f9c8154c0. (HTTP 404) (Request-ID: req-8702fe26-ddcc-409f-9bf5-734149e4c15e)
Nov 15 02:53:40 user nova-compute[75391]: INFO nova.compute.manager [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Took 0.06 seconds to detach 1 volumes for instance.
Nov 15 02:53:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:41 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:53:41 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:53:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.490s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:41 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Deleted allocations for instance 4dd99dea-60d3-4eed-86c7-8d9d0522ae84
Nov 15 02:53:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-08453156-733a-469a-a3a1-c836d6264e9c tempest-VolumesSnapshotTestJSON-1270812690 tempest-VolumesSnapshotTestJSON-1270812690-project-member] Lock "4dd99dea-60d3-4eed-86c7-8d9d0522ae84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.996s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:42 user nova-compute[75391]: DEBUG nova.compute.manager [req-f2fbba53-5204-4670-b821-869733f9aeb3 req-925f39f2-eab3-4318-9cf7-cf6b12578d27 service nova] [instance: 4dd99dea-60d3-4eed-86c7-8d9d0522ae84] Received event network-vif-deleted-d76118a0-ca86-4748-a834-00ed12aa1b23 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:53:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:44 user nova-compute[75391]: DEBUG nova.objects.instance [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'flavor' on Instance uuid da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:53:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "refresh_cache-da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:53:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquired lock "refresh_cache-da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:53:44 user nova-compute[75391]: DEBUG nova.network.neutron [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:53:44 user nova-compute[75391]: DEBUG nova.objects.instance [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'info_cache' on Instance uuid da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:53:44 user nova-compute[75391]: DEBUG nova.objects.base [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Object Instance<da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f> lazy-loaded attributes: flavor,info_cache {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.network.neutron [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Updating instance_info_cache with network_info: [{"id": "f3eff2a5-1256-4a92-969a-62aca65b7452", "address": "fa:16:3e:1d:2d:fe", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eff2a5-12", "ovs_interfaceid": "f3eff2a5-1256-4a92-969a-62aca65b7452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Releasing lock "refresh_cache-da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:53:45 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Instance destroyed successfully.
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.objects.instance [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'resources' on Instance uuid da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.objects.base [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Object Instance<da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:45:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2059106196',display_name='tempest-AttachVolumeTestJSON-server-2059106196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2059106196',id=16,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCD3L1SyX/DHVmOgefUSKxNSWOZ+sTPqXiHUSBukECcD3u5gRzMMwQl2EIJXu8cBcituCl5oxuFwWyqmLGHfNTrWeVvrAhqAma6otXiHGESdUtG7YKOLDquTjdHFcZgT9g==',key_name='tempest-keypair-354891702',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:45:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3ae33412d3944fbcb20520ae0b5d5d17',ramdisk_id='',reservation_id='r-rjbq8t39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-452422979',owner_user_name='tempest-AttachVolumeTestJSON-452422979-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:51:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa67273822f247b2ae2d34ec9cd8c8b4',uuid=da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f3eff2a5-1256-4a92-969a-62aca65b7452", "address": "fa:16:3e:1d:2d:fe", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eff2a5-12", "ovs_interfaceid": "f3eff2a5-1256-4a92-969a-62aca65b7452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Converting VIF {"id": "f3eff2a5-1256-4a92-969a-62aca65b7452", "address": "fa:16:3e:1d:2d:fe", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eff2a5-12", "ovs_interfaceid": "f3eff2a5-1256-4a92-969a-62aca65b7452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:2d:fe,bridge_name='br-int',has_traffic_filtering=True,id=f3eff2a5-1256-4a92-969a-62aca65b7452,network=Network(4866e9c3-d16f-4496-b56a-1f100ea5622a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3eff2a5-12') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG os_vif [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:2d:fe,bridge_name='br-int',has_traffic_filtering=True,id=f3eff2a5-1256-4a92-969a-62aca65b7452,network=Network(4866e9c3-d16f-4496-b56a-1f100ea5622a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3eff2a5-12') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3eff2a5-12, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1875b391-bd43-498a-8f4c-d905715438b4) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:45 user nova-compute[75391]: INFO os_vif [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:2d:fe,bridge_name='br-int',has_traffic_filtering=True,id=f3eff2a5-1256-4a92-969a-62aca65b7452,network=Network(4866e9c3-d16f-4496-b56a-1f100ea5622a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3eff2a5-12')
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Start _get_guest_xml network_info=[{"id": "f3eff2a5-1256-4a92-969a-62aca65b7452", "address": "fa:16:3e:1d:2d:fe", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eff2a5-12", "ovs_interfaceid": "f3eff2a5-1256-4a92-969a-62aca65b7452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.objects.instance [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'numa_topology' on Instance uuid da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.objects.base [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Object Instance<da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:53:45 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:53:45 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.objects.instance [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'vcpu_model' on Instance uuid da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.objects.base [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Object Instance<da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:45:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2059106196',display_name='tempest-AttachVolumeTestJSON-server-2059106196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2059106196',id=16,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCD3L1SyX/DHVmOgefUSKxNSWOZ+sTPqXiHUSBukECcD3u5gRzMMwQl2EIJXu8cBcituCl5oxuFwWyqmLGHfNTrWeVvrAhqAma6otXiHGESdUtG7YKOLDquTjdHFcZgT9g==',key_name='tempest-keypair-354891702',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:45:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3ae33412d3944fbcb20520ae0b5d5d17',ramdisk_id='',reservation_id='r-rjbq8t39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-452422979',owner_user_name='tempest-AttachVolumeTestJSON-452422979-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:51:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa67273822f247b2ae2d34ec9cd8c8b4',uuid=da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f3eff2a5-1256-4a92-969a-62aca65b7452", "address": "fa:16:3e:1d:2d:fe", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eff2a5-12", "ovs_interfaceid": "f3eff2a5-1256-4a92-969a-62aca65b7452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Converting VIF {"id": "f3eff2a5-1256-4a92-969a-62aca65b7452", "address": "fa:16:3e:1d:2d:fe", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eff2a5-12", "ovs_interfaceid": "f3eff2a5-1256-4a92-969a-62aca65b7452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:2d:fe,bridge_name='br-int',has_traffic_filtering=True,id=f3eff2a5-1256-4a92-969a-62aca65b7452,network=Network(4866e9c3-d16f-4496-b56a-1f100ea5622a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3eff2a5-12') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.objects.instance [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'pci_devices' on Instance uuid da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.objects.base [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Object Instance<da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:53:45 user nova-compute[75391]:   <uuid>da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f</uuid>
Nov 15 02:53:45 user nova-compute[75391]:   <name>instance-00000010</name>
Nov 15 02:53:45 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:53:45 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:53:45 user nova-compute[75391]:   <metadata>
Nov 15 02:53:45 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:53:45 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:53:45 user nova-compute[75391]:       <nova:name>tempest-AttachVolumeTestJSON-server-2059106196</nova:name>
Nov 15 02:53:45 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:53:45</nova:creationTime>
Nov 15 02:53:45 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:53:45 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:53:45 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:53:45 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:53:45 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:53:45 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:53:45 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:53:45 user nova-compute[75391]:       <nova:owner>
Nov 15 02:53:45 user nova-compute[75391]:         <nova:user uuid="aa67273822f247b2ae2d34ec9cd8c8b4">tempest-AttachVolumeTestJSON-452422979-project-member</nova:user>
Nov 15 02:53:45 user nova-compute[75391]:         <nova:project uuid="3ae33412d3944fbcb20520ae0b5d5d17">tempest-AttachVolumeTestJSON-452422979</nova:project>
Nov 15 02:53:45 user nova-compute[75391]:       </nova:owner>
Nov 15 02:53:45 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:53:45 user nova-compute[75391]:       <nova:ports>
Nov 15 02:53:45 user nova-compute[75391]:         <nova:port uuid="f3eff2a5-1256-4a92-969a-62aca65b7452">
Nov 15 02:53:45 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 02:53:45 user nova-compute[75391]:         </nova:port>
Nov 15 02:53:45 user nova-compute[75391]:       </nova:ports>
Nov 15 02:53:45 user nova-compute[75391]:     </nova:instance>
Nov 15 02:53:45 user nova-compute[75391]:   </metadata>
Nov 15 02:53:45 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:53:45 user nova-compute[75391]:     <system>
Nov 15 02:53:45 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:53:45 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:53:45 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:53:45 user nova-compute[75391]:       <entry name="serial">da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f</entry>
Nov 15 02:53:45 user nova-compute[75391]:       <entry name="uuid">da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f</entry>
Nov 15 02:53:45 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:53:45 user nova-compute[75391]:     </system>
Nov 15 02:53:45 user nova-compute[75391]:   </sysinfo>
Nov 15 02:53:45 user nova-compute[75391]:   <os>
Nov 15 02:53:45 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:53:45 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:53:45 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:53:45 user nova-compute[75391]:   </os>
Nov 15 02:53:45 user nova-compute[75391]:   <features>
Nov 15 02:53:45 user nova-compute[75391]:     <acpi/>
Nov 15 02:53:45 user nova-compute[75391]:     <apic/>
Nov 15 02:53:45 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:53:45 user nova-compute[75391]:   </features>
Nov 15 02:53:45 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:53:45 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:53:45 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:53:45 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:53:45 user nova-compute[75391]:   </clock>
Nov 15 02:53:45 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:53:45 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:53:45 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:53:45 user nova-compute[75391]:   </cpu>
Nov 15 02:53:45 user nova-compute[75391]:   <devices>
Nov 15 02:53:45 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:53:45 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:53:45 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk"/>
Nov 15 02:53:45 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:53:45 user nova-compute[75391]:     </disk>
Nov 15 02:53:45 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:53:45 user nova-compute[75391]:       <mac address="fa:16:3e:1d:2d:fe"/>
Nov 15 02:53:45 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:53:45 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:53:45 user nova-compute[75391]:       <target dev="tapf3eff2a5-12"/>
Nov 15 02:53:45 user nova-compute[75391]:     </interface>
Nov 15 02:53:45 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:53:45 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/console.log" append="off"/>
Nov 15 02:53:45 user nova-compute[75391]:     </serial>
Nov 15 02:53:45 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:53:45 user nova-compute[75391]:     <video>
Nov 15 02:53:45 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:53:45 user nova-compute[75391]:     </video>
Nov 15 02:53:45 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:53:45 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:53:45 user nova-compute[75391]:     </rng>
Nov 15 02:53:45 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:53:45 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:53:45 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:53:45 user nova-compute[75391]:     </memballoon>
Nov 15 02:53:45 user nova-compute[75391]:   </devices>
Nov 15 02:53:45 user nova-compute[75391]: </domain>
Nov 15 02:53:45 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG nova.objects.instance [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'trusted_certs' on Instance uuid da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG nova.objects.base [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Object Instance<da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.168s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Cannot resize image /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG nova.objects.instance [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'migration_context' on Instance uuid da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG nova.objects.base [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Object Instance<da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:45:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2059106196',display_name='tempest-AttachVolumeTestJSON-server-2059106196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2059106196',id=16,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCD3L1SyX/DHVmOgefUSKxNSWOZ+sTPqXiHUSBukECcD3u5gRzMMwQl2EIJXu8cBcituCl5oxuFwWyqmLGHfNTrWeVvrAhqAma6otXiHGESdUtG7YKOLDquTjdHFcZgT9g==',key_name='tempest-keypair-354891702',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:45:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='3ae33412d3944fbcb20520ae0b5d5d17',ramdisk_id='',reservation_id='r-rjbq8t39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-452422979',owner_user_name='tempest-AttachVolumeTestJSON-452422979-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:51:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa67273822f247b2ae2d34ec9cd8c8b4',uuid=da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f3eff2a5-1256-4a92-969a-62aca65b7452", "address": "fa:16:3e:1d:2d:fe", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eff2a5-12", "ovs_interfaceid": "f3eff2a5-1256-4a92-969a-62aca65b7452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Converting VIF {"id": "f3eff2a5-1256-4a92-969a-62aca65b7452", "address": "fa:16:3e:1d:2d:fe", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eff2a5-12", "ovs_interfaceid": "f3eff2a5-1256-4a92-969a-62aca65b7452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:2d:fe,bridge_name='br-int',has_traffic_filtering=True,id=f3eff2a5-1256-4a92-969a-62aca65b7452,network=Network(4866e9c3-d16f-4496-b56a-1f100ea5622a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3eff2a5-12') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG os_vif [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:2d:fe,bridge_name='br-int',has_traffic_filtering=True,id=f3eff2a5-1256-4a92-969a-62aca65b7452,network=Network(4866e9c3-d16f-4496-b56a-1f100ea5622a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3eff2a5-12') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76e9e620-2a76-55e1-b8e2-20a9d401efbe', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3eff2a5-12, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf3eff2a5-12, col_values=(('qos', UUID('d7e3fecf-025c-4503-9164-b6f61f21738e')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf3eff2a5-12, col_values=(('external_ids', {'iface-id': 'f3eff2a5-1256-4a92-969a-62aca65b7452', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:2d:fe', 'vm-uuid': 'da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:53:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:46 user nova-compute[75391]: INFO os_vif [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:2d:fe,bridge_name='br-int',has_traffic_filtering=True,id=f3eff2a5-1256-4a92-969a-62aca65b7452,network=Network(4866e9c3-d16f-4496-b56a-1f100ea5622a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3eff2a5-12')
Nov 15 02:53:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:48 user nova-compute[75391]: DEBUG nova.compute.manager [req-dacc113f-3019-4a90-9cd0-f2da1b4af5db req-d0eb4b3b-d497-45a4-b3de-ed5fac2a8044 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received event network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:53:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-dacc113f-3019-4a90-9cd0-f2da1b4af5db req-d0eb4b3b-d497-45a4-b3de-ed5fac2a8044 service nova] Acquiring lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-dacc113f-3019-4a90-9cd0-f2da1b4af5db req-d0eb4b3b-d497-45a4-b3de-ed5fac2a8044 service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-dacc113f-3019-4a90-9cd0-f2da1b4af5db req-d0eb4b3b-d497-45a4-b3de-ed5fac2a8044 service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:48 user nova-compute[75391]: DEBUG nova.compute.manager [req-dacc113f-3019-4a90-9cd0-f2da1b4af5db req-d0eb4b3b-d497-45a4-b3de-ed5fac2a8044 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] No waiting events found dispatching network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:53:48 user nova-compute[75391]: WARNING nova.compute.manager [req-dacc113f-3019-4a90-9cd0-f2da1b4af5db req-d0eb4b3b-d497-45a4-b3de-ed5fac2a8044 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received unexpected event network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 for instance with vm_state stopped and task_state powering-on.
Nov 15 02:53:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:49 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:53:49 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:53:49 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:53:49 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 02:53:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-9744c8a1-046e-4a00-92e0-92ebb3275ea9" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:53:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-9744c8a1-046e-4a00-92e0-92ebb3275ea9" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:53:49 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 02:53:49 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lazy-loading 'info_cache' on Instance uuid 9744c8a1-046e-4a00-92e0-92ebb3275ea9 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:53:50 user nova-compute[75391]: DEBUG nova.compute.manager [req-93ee5b46-b5dd-4b84-a8a3-38f2aad1f669 req-58ab877e-8a85-4667-ad86-9a8e3458f051 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received event network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:53:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-93ee5b46-b5dd-4b84-a8a3-38f2aad1f669 req-58ab877e-8a85-4667-ad86-9a8e3458f051 service nova] Acquiring lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-93ee5b46-b5dd-4b84-a8a3-38f2aad1f669 req-58ab877e-8a85-4667-ad86-9a8e3458f051 service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-93ee5b46-b5dd-4b84-a8a3-38f2aad1f669 req-58ab877e-8a85-4667-ad86-9a8e3458f051 service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:50 user nova-compute[75391]: DEBUG nova.compute.manager [req-93ee5b46-b5dd-4b84-a8a3-38f2aad1f669 req-58ab877e-8a85-4667-ad86-9a8e3458f051 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] No waiting events found dispatching network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:53:50 user nova-compute[75391]: WARNING nova.compute.manager [req-93ee5b46-b5dd-4b84-a8a3-38f2aad1f669 req-58ab877e-8a85-4667-ad86-9a8e3458f051 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received unexpected event network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 for instance with vm_state stopped and task_state powering-on.
Nov 15 02:53:50 user nova-compute[75391]: DEBUG nova.compute.manager [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:53:50 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Instance rebooted successfully.
Nov 15 02:53:50 user nova-compute[75391]: DEBUG nova.compute.manager [None req-c717f8f6-8537-47e7-a159-caaf8b5c48f2 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:53:50 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Updating instance_info_cache with network_info: [{"id": "dc4f904f-dd76-4f25-b9e6-41cc42493911", "address": "fa:16:3e:e6:ec:c3", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4f904f-dd", "ovs_interfaceid": "dc4f904f-dd76-4f25-b9e6-41cc42493911", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:53:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-9744c8a1-046e-4a00-92e0-92ebb3275ea9" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:53:50 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 02:53:50 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:53:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:51 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:53:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bfbbb506-2f89-49cc-ac8d-6cb87f7bfab0 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "4ab2dd85-9758-4ea9-8282-9396a2653393" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bfbbb506-2f89-49cc-ac8d-6cb87f7bfab0 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bfbbb506-2f89-49cc-ac8d-6cb87f7bfab0 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "4ab2dd85-9758-4ea9-8282-9396a2653393-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bfbbb506-2f89-49cc-ac8d-6cb87f7bfab0 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bfbbb506-2f89-49cc-ac8d-6cb87f7bfab0 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:52 user nova-compute[75391]: INFO nova.compute.manager [None req-bfbbb506-2f89-49cc-ac8d-6cb87f7bfab0 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Terminating instance
Nov 15 02:53:52 user nova-compute[75391]: DEBUG nova.compute.manager [None req-bfbbb506-2f89-49cc-ac8d-6cb87f7bfab0 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:53:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:52 user nova-compute[75391]: DEBUG nova.compute.manager [req-99324f46-cfde-4c4f-bc9e-2b9a6ae539c8 req-6ff5759c-ae5f-42d2-929b-076af2af5394 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Received event network-vif-unplugged-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:53:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-99324f46-cfde-4c4f-bc9e-2b9a6ae539c8 req-6ff5759c-ae5f-42d2-929b-076af2af5394 service nova] Acquiring lock "4ab2dd85-9758-4ea9-8282-9396a2653393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-99324f46-cfde-4c4f-bc9e-2b9a6ae539c8 req-6ff5759c-ae5f-42d2-929b-076af2af5394 service nova] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-99324f46-cfde-4c4f-bc9e-2b9a6ae539c8 req-6ff5759c-ae5f-42d2-929b-076af2af5394 service nova] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:52 user nova-compute[75391]: DEBUG nova.compute.manager [req-99324f46-cfde-4c4f-bc9e-2b9a6ae539c8 req-6ff5759c-ae5f-42d2-929b-076af2af5394 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] No waiting events found dispatching network-vif-unplugged-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:53:52 user nova-compute[75391]: DEBUG nova.compute.manager [req-99324f46-cfde-4c4f-bc9e-2b9a6ae539c8 req-6ff5759c-ae5f-42d2-929b-076af2af5394 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Received event network-vif-unplugged-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:53:52 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:53:52 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:53:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:53 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Instance destroyed successfully.
Nov 15 02:53:53 user nova-compute[75391]: DEBUG nova.objects.instance [None req-bfbbb506-2f89-49cc-ac8d-6cb87f7bfab0 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lazy-loading 'resources' on Instance uuid 4ab2dd85-9758-4ea9-8282-9396a2653393 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:53:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-bfbbb506-2f89-49cc-ac8d-6cb87f7bfab0 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-394727341',display_name='tempest-TestMinimumBasicScenario-server-394727341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-394727341',id=22,image_ref='81210a1c-ce92-4866-971a-db9d10db76fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZ6EZGLN+EfGp8fJzRNzetOOVWEcuY7sCt4aTMJodPjsJ4aU1LFlPaFJdI5KK4bUycNMY3Xt3trSwZiPJXcT1DuBf6OazrURjmNbp8MnXJppH2o7Lhni/4VA5UukcUi9w==',key_name='tempest-TestMinimumBasicScenario-860918913',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:48:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41caf593c4994c5c86570e1216c01337',ramdisk_id='',reservation_id='r-g0cgyuhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='81210a1c-ce92-4866-971a-db9d10db76fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1859352909',owner_user_name='tempest-TestMinimumBasicScenario-1859352909-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:51:12Z,user_data=None,user_id='409532d98aae4e5b962d3b142981c79a',uuid=4ab2dd85-9758-4ea9-8282-9396a2653393,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "address": "fa:16:3e:f2:fd:21", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70574492-dd", "ovs_interfaceid": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:53:53 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-bfbbb506-2f89-49cc-ac8d-6cb87f7bfab0 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Converting VIF {"id": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "address": "fa:16:3e:f2:fd:21", "network": {"id": "ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-330798707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41caf593c4994c5c86570e1216c01337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70574492-dd", "ovs_interfaceid": "70574492-ddbc-47cd-b32c-cd5cb88b8ff7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:53:53 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-bfbbb506-2f89-49cc-ac8d-6cb87f7bfab0 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:fd:21,bridge_name='br-int',has_traffic_filtering=True,id=70574492-ddbc-47cd-b32c-cd5cb88b8ff7,network=Network(ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70574492-dd') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:53:53 user nova-compute[75391]: DEBUG os_vif [None req-bfbbb506-2f89-49cc-ac8d-6cb87f7bfab0 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:fd:21,bridge_name='br-int',has_traffic_filtering=True,id=70574492-ddbc-47cd-b32c-cd5cb88b8ff7,network=Network(ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70574492-dd') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:53:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70574492-dd, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:53:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:53:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e76d5da0-4f6a-4718-b31e-3d5eccbf9c9f) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:53:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:53 user nova-compute[75391]: INFO os_vif [None req-bfbbb506-2f89-49cc-ac8d-6cb87f7bfab0 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:fd:21,bridge_name='br-int',has_traffic_filtering=True,id=70574492-ddbc-47cd-b32c-cd5cb88b8ff7,network=Network(ff9a2c3a-9e8a-4f92-8fb9-c0b29ec2cb22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70574492-dd')
Nov 15 02:53:53 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-bfbbb506-2f89-49cc-ac8d-6cb87f7bfab0 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Deleting instance files /opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393_del
Nov 15 02:53:53 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-bfbbb506-2f89-49cc-ac8d-6cb87f7bfab0 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Deletion of /opt/stack/data/nova/instances/4ab2dd85-9758-4ea9-8282-9396a2653393_del complete
Nov 15 02:53:53 user nova-compute[75391]: INFO nova.compute.manager [None req-bfbbb506-2f89-49cc-ac8d-6cb87f7bfab0 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Took 1.09 seconds to destroy the instance on the hypervisor.
Nov 15 02:53:53 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-bfbbb506-2f89-49cc-ac8d-6cb87f7bfab0 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:53:53 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:53:53 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:53:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:53 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:53:53 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Took 0.42 seconds to deallocate network for instance.
Nov 15 02:53:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bfbbb506-2f89-49cc-ac8d-6cb87f7bfab0 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bfbbb506-2f89-49cc-ac8d-6cb87f7bfab0 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:54 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-bfbbb506-2f89-49cc-ac8d-6cb87f7bfab0 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:53:54 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-bfbbb506-2f89-49cc-ac8d-6cb87f7bfab0 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:53:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bfbbb506-2f89-49cc-ac8d-6cb87f7bfab0 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:54 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-bfbbb506-2f89-49cc-ac8d-6cb87f7bfab0 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Deleted allocations for instance 4ab2dd85-9758-4ea9-8282-9396a2653393
Nov 15 02:53:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bfbbb506-2f89-49cc-ac8d-6cb87f7bfab0 tempest-TestMinimumBasicScenario-1859352909 tempest-TestMinimumBasicScenario-1859352909-project-member] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.101s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:54 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:53:54 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:53:54 user nova-compute[75391]: DEBUG nova.compute.manager [req-d460fdc5-0c42-40cf-a60f-7aeae4b719a4 req-0b1b1fe0-fabc-4852-a6e1-74285221d306 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Received event network-vif-plugged-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:53:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d460fdc5-0c42-40cf-a60f-7aeae4b719a4 req-0b1b1fe0-fabc-4852-a6e1-74285221d306 service nova] Acquiring lock "4ab2dd85-9758-4ea9-8282-9396a2653393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d460fdc5-0c42-40cf-a60f-7aeae4b719a4 req-0b1b1fe0-fabc-4852-a6e1-74285221d306 service nova] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d460fdc5-0c42-40cf-a60f-7aeae4b719a4 req-0b1b1fe0-fabc-4852-a6e1-74285221d306 service nova] Lock "4ab2dd85-9758-4ea9-8282-9396a2653393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:54 user nova-compute[75391]: DEBUG nova.compute.manager [req-d460fdc5-0c42-40cf-a60f-7aeae4b719a4 req-0b1b1fe0-fabc-4852-a6e1-74285221d306 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] No waiting events found dispatching network-vif-plugged-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:53:54 user nova-compute[75391]: WARNING nova.compute.manager [req-d460fdc5-0c42-40cf-a60f-7aeae4b719a4 req-0b1b1fe0-fabc-4852-a6e1-74285221d306 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Received unexpected event network-vif-plugged-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 for instance with vm_state deleted and task_state None.
Nov 15 02:53:54 user nova-compute[75391]: DEBUG nova.compute.manager [req-d460fdc5-0c42-40cf-a60f-7aeae4b719a4 req-0b1b1fe0-fabc-4852-a6e1-74285221d306 service nova] [instance: 4ab2dd85-9758-4ea9-8282-9396a2653393] Received event network-vif-deleted-70574492-ddbc-47cd-b32c-cd5cb88b8ff7 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:53:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:53:54 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:53:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:53:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:53:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:53:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:53:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:53:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:53:58 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:53:58 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:53:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=7401MB free_disk=24.923267364501953GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:53:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:53:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:53:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9744c8a1-046e-4a00-92e0-92ebb3275ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:53:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance fc9484c0-9083-4797-8ab1-2ad392822ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:53:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6400a5f3-0ec9-4484-930c-1f5061ae5374 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:53:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:53:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance d36e2f64-11cb-4b35-8471-9a4df7f4c227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:53:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9909ae6b-7900-4f71-8900-2bf25185e436 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:53:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 7bd332f2-0f74-4a43-96a2-2322b6cbf982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:53:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:53:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance c767fb74-e57f-4ea0-bf4e-4034cf656a78 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:53:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance a0382af0-0509-4473-832f-1e5e6588be2e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:53:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 04dcd079-e89f-401c-a7ae-8af96beb3d6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:53:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:53:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:53:59 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:53:59 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:53:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:53:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.499s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:54:00 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:54:00 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:54:00 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:54:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:41 user nova-compute[75391]: DEBUG nova.compute.manager [req-28abeae2-a255-4530-b5ec-735a599d182c req-d350df95-0ba6-4529-aaba-e178068623c2 service nova] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Received event network-changed-84041b89-25ff-4498-87ba-c2ab0b5aa876 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:54:41 user nova-compute[75391]: DEBUG nova.compute.manager [req-28abeae2-a255-4530-b5ec-735a599d182c req-d350df95-0ba6-4529-aaba-e178068623c2 service nova] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Refreshing instance network info cache due to event network-changed-84041b89-25ff-4498-87ba-c2ab0b5aa876. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:54:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-28abeae2-a255-4530-b5ec-735a599d182c req-d350df95-0ba6-4529-aaba-e178068623c2 service nova] Acquiring lock "refresh_cache-28a1ec10-2748-4d0c-9b73-9636fc1cc237" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:54:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-28abeae2-a255-4530-b5ec-735a599d182c req-d350df95-0ba6-4529-aaba-e178068623c2 service nova] Acquired lock "refresh_cache-28a1ec10-2748-4d0c-9b73-9636fc1cc237" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:54:41 user nova-compute[75391]: DEBUG nova.network.neutron [req-28abeae2-a255-4530-b5ec-735a599d182c req-d350df95-0ba6-4529-aaba-e178068623c2 service nova] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Refreshing network info cache for port 84041b89-25ff-4498-87ba-c2ab0b5aa876 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:54:42 user nova-compute[75391]: DEBUG nova.network.neutron [req-28abeae2-a255-4530-b5ec-735a599d182c req-d350df95-0ba6-4529-aaba-e178068623c2 service nova] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Updated VIF entry in instance network info cache for port 84041b89-25ff-4498-87ba-c2ab0b5aa876. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:54:42 user nova-compute[75391]: DEBUG nova.network.neutron [req-28abeae2-a255-4530-b5ec-735a599d182c req-d350df95-0ba6-4529-aaba-e178068623c2 service nova] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Updating instance_info_cache with network_info: [{"id": "84041b89-25ff-4498-87ba-c2ab0b5aa876", "address": "fa:16:3e:ef:5f:d5", "network": {"id": "ad0220e2-671c-40cc-8b2f-bda8d6f6fca5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-319455103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "342f25269fc44ec2bb9f07a38aa70cd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84041b89-25", "ovs_interfaceid": "84041b89-25ff-4498-87ba-c2ab0b5aa876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:54:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-28abeae2-a255-4530-b5ec-735a599d182c req-d350df95-0ba6-4529-aaba-e178068623c2 service nova] Releasing lock "refresh_cache-28a1ec10-2748-4d0c-9b73-9636fc1cc237" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:54:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:54:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:54:45 user nova-compute[75391]: DEBUG nova.objects.instance [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lazy-loading 'flavor' on Instance uuid 28a1ec10-2748-4d0c-9b73-9636fc1cc237 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:54:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:54:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:54:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:54:45 user nova-compute[75391]: INFO nova.compute.manager [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Attaching volume a1fa6781-14f2-4bdc-b8f0-200d171d8b6e to /dev/vdb
Nov 15 02:54:45 user nova-compute[75391]: DEBUG os_brick.utils [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:54:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb068a1-534a-4135-8560-2b236952abce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:54:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c89153-cd91-4a24-9936-e0963bdb4c7b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:54:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc53e3c0-bc52-4a06-b631-a9d4e70d0803]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:54:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d168da6-04cc-4e2a-a0fa-fd4f0c7d17a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:54:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:54:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:54:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:54:45 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:54:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[860e071a-d030-41a2-95da-69fd11f7177b]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:54:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:54:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:54:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:54:45 user nova-compute[75391]: DEBUG os_brick.utils [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:54:45 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Updating existing volume attachment record: c94781df-51dc-438f-8e84-af8450ce7cdb {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:54:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:49 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:54:49 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:54:49 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:54:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-fc9484c0-9083-4797-8ab1-2ad392822ce8" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:54:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-fc9484c0-9083-4797-8ab1-2ad392822ce8" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:54:49 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 02:54:50 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Updating instance_info_cache with network_info: [{"id": "d8f34e4c-5c99-45eb-a282-a721a2019209", "address": "fa:16:3e:ca:58:46", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f34e4c-5c", "ovs_interfaceid": "d8f34e4c-5c99-45eb-a282-a721a2019209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:54:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-fc9484c0-9083-4797-8ab1-2ad392822ce8" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:54:50 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 02:54:50 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:54:50 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:54:50 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uWbmwrCt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:54:50 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:54:50 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:54:50 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:54:50 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:54:50 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:54:50 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:54:50 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:54:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:50 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[23608bd2-b4cc-4b64-b070-9bfc704650c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:54:50 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:54:50 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:54:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:50 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0af930f-7b72-4c18-bf5d-29b2cb5c5d04]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:54:50 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e] added
Nov 15 02:54:50 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:54:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:50 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad08e28-5394-4902-b221-514d564d2372]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:54:50 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:54:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5091179b-66d2-483f-bcec-3b7a57093cac]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uWbmwrCt {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uWbmwrCt" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d041daba-67a9-4852-a6f0-6c491a03578a]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uWbmwrCt'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[347511d6-a5c2-4a02-b7f1-875d6a6c65c9]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f564026d-7a12-4552-9bfe-8bcb4ee6c979]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:54:51 user nova-compute[75391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:54:51 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:54:51 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:54:51 user nova-compute[75391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:54:51 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:54:51 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[07409bb8-3894-4ef2-88af-1be9970bbd88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e, portal: 172.16.0.220,3260]
Nov 15 02:54:51 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e, portal: 172.16.0.220,3260] successful.
Nov 15 02:54:51 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c173bb7-0785-4ba6-a080-1ba4a73dd07a]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a692e782-d86a-4372-b029-f58da6d58b64]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:54:51 user nova-compute[75391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:54:51 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:54:51 user nova-compute[75391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e (non-flash)
Nov 15 02:54:51 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:54:51 user nova-compute[75391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:54:51 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:54:51 user nova-compute[75391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e (non-flash)
Nov 15 02:54:51 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d740b96f-6738-4303-9bc6-c22d744f9f49]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:54:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uWbmwrCt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:54:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:54:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23932343163346136', 'path': '/dev/sdb'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:54:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932343163346136', 'path': '/dev/sdb'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:54:52 user nova-compute[75391]: DEBUG nova.objects.instance [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lazy-loading 'flavor' on Instance uuid 28a1ec10-2748-4d0c-9b73-9636fc1cc237 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:54:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 02:54:52 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:54:52 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 02:54:52 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:54:52 user nova-compute[75391]:   <serial>a1fa6781-14f2-4bdc-b8f0-200d171d8b6e</serial>
Nov 15 02:54:52 user nova-compute[75391]: </disk>
Nov 15 02:54:52 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:54:52 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:54:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:54:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:54:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] No VIF found with MAC fa:16:3e:ef:5f:d5, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:54:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a0efa2cd-06ae-46a4-8a88-b45fb687b96f tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.395s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:54:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Acquiring lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:54:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:54:54 user nova-compute[75391]: DEBUG nova.compute.manager [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:54:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:54:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:54:54 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:54:54 user nova-compute[75391]: INFO nova.compute.claims [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Claim successful on node user
Nov 15 02:54:54 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:54:54 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:54:54 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:54:54 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:54:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:54:54 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG nova.compute.manager [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.342s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG nova.compute.manager [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG nova.network.neutron [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:54:55 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:54:55 user nova-compute[75391]: DEBUG nova.policy [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a687d6f2859d498492cecd3d7f366618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3451824ac0cb4f32a4882218fa8e63ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG nova.compute.manager [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:55 user nova-compute[75391]: INFO nova.virt.block_device [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Booting with volume b3d6140d-7f68-4811-a988-350366cf0281 at /dev/vda
Nov 15 02:54:55 user nova-compute[75391]: DEBUG os_brick.utils [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d21731-b723-4654-9a8f-850b7a0873ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a324d6a5-4c62-4154-a3f2-f39f7e228fd8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[05de4e46-4fb6-4d26-a175-59131c9e545b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ef0667-9722-4177-b1db-286e1c072493]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:54:55 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:54:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1325c2a9-6429-4d95-bc79-fec3cd9a7e31]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG os_brick.utils [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Updating existing volume attachment record: d0aa935d-4768-4d03-9556-d3c882365b6d {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:55 user nova-compute[75391]: DEBUG nova.network.neutron [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Successfully created port: 5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:54:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:56 user nova-compute[75391]: DEBUG nova.network.neutron [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Successfully updated port: 5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:54:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Acquiring lock "refresh_cache-991177b1-d6a7-41a7-b9fa-f08d04fa57c6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:54:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Acquired lock "refresh_cache-991177b1-d6a7-41a7-b9fa-f08d04fa57c6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:54:56 user nova-compute[75391]: DEBUG nova.network.neutron [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:54:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:54:56 user nova-compute[75391]: DEBUG nova.compute.manager [req-8507b757-9c61-4660-93b6-2b5a57c9a091 req-8b352ea7-36c6-4227-ba03-82b22a3e2d80 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Received event network-changed-5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:54:56 user nova-compute[75391]: DEBUG nova.compute.manager [req-8507b757-9c61-4660-93b6-2b5a57c9a091 req-8b352ea7-36c6-4227-ba03-82b22a3e2d80 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Refreshing instance network info cache due to event network-changed-5af75008-fab4-4b58-b936-3d35fdcc8199. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:54:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8507b757-9c61-4660-93b6-2b5a57c9a091 req-8b352ea7-36c6-4227-ba03-82b22a3e2d80 service nova] Acquiring lock "refresh_cache-991177b1-d6a7-41a7-b9fa-f08d04fa57c6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:54:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:56 user nova-compute[75391]: DEBUG nova.network.neutron [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:54:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:56 user nova-compute[75391]: DEBUG nova.network.neutron [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Updating instance_info_cache with network_info: [{"id": "5af75008-fab4-4b58-b936-3d35fdcc8199", "address": "fa:16:3e:20:f9:b0", "network": {"id": "525ff764-45a1-4e28-9a54-09f11b8e8a7d", "bridge": "br-int", "label": "tempest-TestShelveInstance-931031505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3451824ac0cb4f32a4882218fa8e63ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af75008-fa", "ovs_interfaceid": "5af75008-fab4-4b58-b936-3d35fdcc8199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:54:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Releasing lock "refresh_cache-991177b1-d6a7-41a7-b9fa-f08d04fa57c6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:54:57 user nova-compute[75391]: DEBUG nova.compute.manager [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Instance network_info: |[{"id": "5af75008-fab4-4b58-b936-3d35fdcc8199", "address": "fa:16:3e:20:f9:b0", "network": {"id": "525ff764-45a1-4e28-9a54-09f11b8e8a7d", "bridge": "br-int", "label": "tempest-TestShelveInstance-931031505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3451824ac0cb4f32a4882218fa8e63ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af75008-fa", "ovs_interfaceid": "5af75008-fab4-4b58-b936-3d35fdcc8199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:54:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8507b757-9c61-4660-93b6-2b5a57c9a091 req-8b352ea7-36c6-4227-ba03-82b22a3e2d80 service nova] Acquired lock "refresh_cache-991177b1-d6a7-41a7-b9fa-f08d04fa57c6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:54:57 user nova-compute[75391]: DEBUG nova.network.neutron [req-8507b757-9c61-4660-93b6-2b5a57c9a091 req-8b352ea7-36c6-4227-ba03-82b22a3e2d80 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Refreshing network info cache for port 5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:54:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:57 user nova-compute[75391]: DEBUG nova.network.neutron [req-8507b757-9c61-4660-93b6-2b5a57c9a091 req-8b352ea7-36c6-4227-ba03-82b22a3e2d80 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Updated VIF entry in instance network info cache for port 5af75008-fab4-4b58-b936-3d35fdcc8199. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:54:57 user nova-compute[75391]: DEBUG nova.network.neutron [req-8507b757-9c61-4660-93b6-2b5a57c9a091 req-8b352ea7-36c6-4227-ba03-82b22a3e2d80 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Updating instance_info_cache with network_info: [{"id": "5af75008-fab4-4b58-b936-3d35fdcc8199", "address": "fa:16:3e:20:f9:b0", "network": {"id": "525ff764-45a1-4e28-9a54-09f11b8e8a7d", "bridge": "br-int", "label": "tempest-TestShelveInstance-931031505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3451824ac0cb4f32a4882218fa8e63ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af75008-fa", "ovs_interfaceid": "5af75008-fab4-4b58-b936-3d35fdcc8199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:54:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8507b757-9c61-4660-93b6-2b5a57c9a091 req-8b352ea7-36c6-4227-ba03-82b22a3e2d80 service nova] Releasing lock "refresh_cache-991177b1-d6a7-41a7-b9fa-f08d04fa57c6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:54:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:54:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:54:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:54:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:54:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:54:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:54:59 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:54:59 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:54:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=7433MB free_disk=24.949295043945312GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:54:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:54:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:54:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9744c8a1-046e-4a00-92e0-92ebb3275ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:54:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance fc9484c0-9083-4797-8ab1-2ad392822ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:54:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6400a5f3-0ec9-4484-930c-1f5061ae5374 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:54:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:54:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance d36e2f64-11cb-4b35-8471-9a4df7f4c227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:54:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9909ae6b-7900-4f71-8900-2bf25185e436 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:54:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 7bd332f2-0f74-4a43-96a2-2322b6cbf982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:54:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:54:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance c767fb74-e57f-4ea0-bf4e-4034cf656a78 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:54:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance a0382af0-0509-4473-832f-1e5e6588be2e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:54:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 04dcd079-e89f-401c-a7ae-8af96beb3d6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:54:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 991177b1-d6a7-41a7-b9fa-f08d04fa57c6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:54:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:54:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.569s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG nova.compute.manager [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:55:00 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Creating image(s)
Nov 15 02:55:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Did not create local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Ensure instance console log exists: /opt/stack/data/nova/instances/991177b1-d6a7-41a7-b9fa-f08d04fa57c6/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Start _get_guest_xml network_info=[{"id": "5af75008-fab4-4b58-b936-3d35fdcc8199", "address": "fa:16:3e:20:f9:b0", "network": {"id": "525ff764-45a1-4e28-9a54-09f11b8e8a7d", "bridge": "br-int", "label": "tempest-TestShelveInstance-931031505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3451824ac0cb4f32a4882218fa8e63ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af75008-fa", "ovs_interfaceid": "5af75008-fab4-4b58-b936-3d35fdcc8199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'd0aa935d-4768-4d03-9556-d3c882365b6d', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnptVkFb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '991177b1-d6a7-41a7-b9fa-f08d04fa57c6', 'attached_at': '', 'detached_at': '', 'volume_id': 'b3d6140d-7f68-4811-a988-350366cf0281', 'serial': 'b3d6140d-7f68-4811-a988-350366cf0281'}, 'volume_type': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:55:00 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:55:00 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:55:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnptVkFb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:55:00 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:55:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:55:00 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:55:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:55:00 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:55:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a635df-c052-41d5-a048-7c713a0f14fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:55:00 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a83dad-b895-4e59-a438-3a8485da3043]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281] added
Nov 15 02:55:00 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd6d497-7d43-4100-b948-3c6fb4924e95]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ddeb62-7deb-4e80-b332-a229c69cdfcc]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UnptVkFb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UnptVkFb" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5970fa4e-b5ed-4fad-ac76-525ca27756a7]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UnptVkFb'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d740ed-eb70-430b-a8c4-cc442087bd38]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c72bc1-8aec-46f1-99fa-115771cdb5fd]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:55:00 user nova-compute[75391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:55:00 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:55:00 user nova-compute[75391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e (non-flash)
Nov 15 02:55:00 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:55:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:55:01 user nova-compute[75391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:55:01 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:55:01 user nova-compute[75391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e (non-flash)
Nov 15 02:55:01 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:55:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a18620-dad2-429e-b124-754f3537ded9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281, portal: 172.16.0.220,3260]
Nov 15 02:55:01 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281, portal: 172.16.0.220,3260] successful.
Nov 15 02:55:01 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f9c82b-b4a7-4984-95a2-7f94f50a67c4]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a928a9-7c17-403d-bd3e-c213b12b4d02]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:55:01 user nova-compute[75391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:55:01 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:55:01 user nova-compute[75391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e (non-flash)
Nov 15 02:55:01 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:55:01 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:55:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:55:01 user nova-compute[75391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:55:01 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:55:01 user nova-compute[75391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e (non-flash)
Nov 15 02:55:01 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:55:01 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:55:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:55:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:55:01 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:55:01 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:55:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fba93a4-8539-4894-b4cd-81ed7b6c0aad]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:01 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:55:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnptVkFb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:55:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:01 user nova-compute[75391]: INFO nova.compute.manager [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Detaching volume a1fa6781-14f2-4bdc-b8f0-200d171d8b6e
Nov 15 02:55:02 user nova-compute[75391]: INFO nova.virt.block_device [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Attempting to driver detach volume a1fa6781-14f2-4bdc-b8f0-200d171d8b6e from mountpoint /dev/vdb
Nov 15 02:55:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Attempting to detach device vdb from instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:55:02 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:55:02 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 02:55:02 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:55:02 user nova-compute[75391]:   <serial>a1fa6781-14f2-4bdc-b8f0-200d171d8b6e</serial>
Nov 15 02:55:02 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:55:02 user nova-compute[75391]: </disk>
Nov 15 02:55:02 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:55:02 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Successfully detached device vdb from instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 from the persistent domain config.
Nov 15 02:55:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:55:02 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:55:02 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 02:55:02 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:55:02 user nova-compute[75391]:   <serial>a1fa6781-14f2-4bdc-b8f0-200d171d8b6e</serial>
Nov 15 02:55:02 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:55:02 user nova-compute[75391]: </disk>
Nov 15 02:55:02 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23633663764316334', 'path': '/dev/sde'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633663764316334', 'path': '/dev/sde'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:54:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-88510188',display_name='tempest-TestShelveInstance-server-88510188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-88510188',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbWHq0u3vzYDdTA20T21WxOphyWDwBwUdcpvnjvB6rdYVJo9RyP642jhsv3kAcbxdgKg9Vmhj9Bu5vtsg1oFVXUy6TrBHh4+tXEhMns8mSFMH2pDgygK0NQ58MCoKv0yQ==',key_name='tempest-TestShelveInstance-469278701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3451824ac0cb4f32a4882218fa8e63ae',ramdisk_id='',reservation_id='r-zi0hjw2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-93691503',owner_user_name='tempest-TestShelveInstance-93691503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:54:55Z,user_data=None,user_id='a687d6f2859d498492cecd3d7f366618',uuid=991177b1-d6a7-41a7-b9fa-f08d04fa57c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5af75008-fab4-4b58-b936-3d35fdcc8199", "address": "fa:16:3e:20:f9:b0", "network": {"id": "525ff764-45a1-4e28-9a54-09f11b8e8a7d", "bridge": "br-int", "label": "tempest-TestShelveInstance-931031505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3451824ac0cb4f32a4882218fa8e63ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af75008-fa", "ovs_interfaceid": "5af75008-fab4-4b58-b936-3d35fdcc8199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Converting VIF {"id": "5af75008-fab4-4b58-b936-3d35fdcc8199", "address": "fa:16:3e:20:f9:b0", "network": {"id": "525ff764-45a1-4e28-9a54-09f11b8e8a7d", "bridge": "br-int", "label": "tempest-TestShelveInstance-931031505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3451824ac0cb4f32a4882218fa8e63ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af75008-fa", "ovs_interfaceid": "5af75008-fab4-4b58-b936-3d35fdcc8199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:f9:b0,bridge_name='br-int',has_traffic_filtering=True,id=5af75008-fab4-4b58-b936-3d35fdcc8199,network=Network(525ff764-45a1-4e28-9a54-09f11b8e8a7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5af75008-fa') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG nova.objects.instance [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lazy-loading 'pci_devices' on Instance uuid 991177b1-d6a7-41a7-b9fa-f08d04fa57c6 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:55:02 user nova-compute[75391]:   <uuid>991177b1-d6a7-41a7-b9fa-f08d04fa57c6</uuid>
Nov 15 02:55:02 user nova-compute[75391]:   <name>instance-00000022</name>
Nov 15 02:55:02 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:55:02 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:55:02 user nova-compute[75391]:   <metadata>
Nov 15 02:55:02 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:55:02 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:55:02 user nova-compute[75391]:       <nova:name>tempest-TestShelveInstance-server-88510188</nova:name>
Nov 15 02:55:02 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:55:00</nova:creationTime>
Nov 15 02:55:02 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:55:02 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:55:02 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:55:02 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:55:02 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:55:02 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:55:02 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:55:02 user nova-compute[75391]:       <nova:owner>
Nov 15 02:55:02 user nova-compute[75391]:         <nova:user uuid="a687d6f2859d498492cecd3d7f366618">tempest-TestShelveInstance-93691503-project-member</nova:user>
Nov 15 02:55:02 user nova-compute[75391]:         <nova:project uuid="3451824ac0cb4f32a4882218fa8e63ae">tempest-TestShelveInstance-93691503</nova:project>
Nov 15 02:55:02 user nova-compute[75391]:       </nova:owner>
Nov 15 02:55:02 user nova-compute[75391]:       <nova:ports>
Nov 15 02:55:02 user nova-compute[75391]:         <nova:port uuid="5af75008-fab4-4b58-b936-3d35fdcc8199">
Nov 15 02:55:02 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 02:55:02 user nova-compute[75391]:         </nova:port>
Nov 15 02:55:02 user nova-compute[75391]:       </nova:ports>
Nov 15 02:55:02 user nova-compute[75391]:     </nova:instance>
Nov 15 02:55:02 user nova-compute[75391]:   </metadata>
Nov 15 02:55:02 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:55:02 user nova-compute[75391]:     <system>
Nov 15 02:55:02 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:55:02 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:55:02 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:55:02 user nova-compute[75391]:       <entry name="serial">991177b1-d6a7-41a7-b9fa-f08d04fa57c6</entry>
Nov 15 02:55:02 user nova-compute[75391]:       <entry name="uuid">991177b1-d6a7-41a7-b9fa-f08d04fa57c6</entry>
Nov 15 02:55:02 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:55:02 user nova-compute[75391]:     </system>
Nov 15 02:55:02 user nova-compute[75391]:   </sysinfo>
Nov 15 02:55:02 user nova-compute[75391]:   <os>
Nov 15 02:55:02 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:55:02 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:55:02 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:55:02 user nova-compute[75391]:   </os>
Nov 15 02:55:02 user nova-compute[75391]:   <features>
Nov 15 02:55:02 user nova-compute[75391]:     <acpi/>
Nov 15 02:55:02 user nova-compute[75391]:     <apic/>
Nov 15 02:55:02 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:55:02 user nova-compute[75391]:   </features>
Nov 15 02:55:02 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:55:02 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:55:02 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:55:02 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:55:02 user nova-compute[75391]:   </clock>
Nov 15 02:55:02 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:55:02 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:55:02 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:55:02 user nova-compute[75391]:   </cpu>
Nov 15 02:55:02 user nova-compute[75391]:   <devices>
Nov 15 02:55:02 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 02:55:02 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:55:02 user nova-compute[75391]:       <source dev="/dev/sde"/>
Nov 15 02:55:02 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:55:02 user nova-compute[75391]:       <serial>b3d6140d-7f68-4811-a988-350366cf0281</serial>
Nov 15 02:55:02 user nova-compute[75391]:     </disk>
Nov 15 02:55:02 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:55:02 user nova-compute[75391]:       <mac address="fa:16:3e:20:f9:b0"/>
Nov 15 02:55:02 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:55:02 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:55:02 user nova-compute[75391]:       <target dev="tap5af75008-fa"/>
Nov 15 02:55:02 user nova-compute[75391]:     </interface>
Nov 15 02:55:02 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:55:02 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/991177b1-d6a7-41a7-b9fa-f08d04fa57c6/console.log" append="off"/>
Nov 15 02:55:02 user nova-compute[75391]:     </serial>
Nov 15 02:55:02 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:55:02 user nova-compute[75391]:     <video>
Nov 15 02:55:02 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:55:02 user nova-compute[75391]:     </video>
Nov 15 02:55:02 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:55:02 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:55:02 user nova-compute[75391]:     </rng>
Nov 15 02:55:02 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:55:02 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:55:02 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:55:02 user nova-compute[75391]:     </memballoon>
Nov 15 02:55:02 user nova-compute[75391]:   </devices>
Nov 15 02:55:02 user nova-compute[75391]: </domain>
Nov 15 02:55:02 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:54:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-88510188',display_name='tempest-TestShelveInstance-server-88510188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-88510188',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbWHq0u3vzYDdTA20T21WxOphyWDwBwUdcpvnjvB6rdYVJo9RyP642jhsv3kAcbxdgKg9Vmhj9Bu5vtsg1oFVXUy6TrBHh4+tXEhMns8mSFMH2pDgygK0NQ58MCoKv0yQ==',key_name='tempest-TestShelveInstance-469278701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3451824ac0cb4f32a4882218fa8e63ae',ramdisk_id='',reservation_id='r-zi0hjw2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-93691503',owner_user_name='tempest-TestShelveInstance-93691503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:54:55Z,user_data=None,user_id='a687d6f2859d498492cecd3d7f366618',uuid=991177b1-d6a7-41a7-b9fa-f08d04fa57c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5af75008-fab4-4b58-b936-3d35fdcc8199", "address": "fa:16:3e:20:f9:b0", "network": {"id": "525ff764-45a1-4e28-9a54-09f11b8e8a7d", "bridge": "br-int", "label": "tempest-TestShelveInstance-931031505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3451824ac0cb4f32a4882218fa8e63ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af75008-fa", "ovs_interfaceid": "5af75008-fab4-4b58-b936-3d35fdcc8199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Converting VIF {"id": "5af75008-fab4-4b58-b936-3d35fdcc8199", "address": "fa:16:3e:20:f9:b0", "network": {"id": "525ff764-45a1-4e28-9a54-09f11b8e8a7d", "bridge": "br-int", "label": "tempest-TestShelveInstance-931031505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3451824ac0cb4f32a4882218fa8e63ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af75008-fa", "ovs_interfaceid": "5af75008-fab4-4b58-b936-3d35fdcc8199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:f9:b0,bridge_name='br-int',has_traffic_filtering=True,id=5af75008-fab4-4b58-b936-3d35fdcc8199,network=Network(525ff764-45a1-4e28-9a54-09f11b8e8a7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5af75008-fa') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG os_vif [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:f9:b0,bridge_name='br-int',has_traffic_filtering=True,id=5af75008-fab4-4b58-b936-3d35fdcc8199,network=Network(525ff764-45a1-4e28-9a54-09f11b8e8a7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5af75008-fa') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1110639-c8f4-5b9c-abba-00af97db9e8a', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5af75008-fa, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5af75008-fa, col_values=(('qos', UUID('cfc8001e-ed28-493c-b044-95442265e0a6')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5af75008-fa, col_values=(('external_ids', {'iface-id': '5af75008-fab4-4b58-b936-3d35fdcc8199', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:f9:b0', 'vm-uuid': '991177b1-d6a7-41a7-b9fa-f08d04fa57c6'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:02 user nova-compute[75391]: INFO os_vif [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:f9:b0,bridge_name='br-int',has_traffic_filtering=True,id=5af75008-fab4-4b58-b936-3d35fdcc8199,network=Network(525ff764-45a1-4e28-9a54-09f11b8e8a7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5af75008-fa')
Nov 15 02:55:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] No VIF found with MAC fa:16:3e:20:f9:b0, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:55:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 02:55:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-fcc7c477-8a17-49a1-9be5-5977955bf86a req-048ba9fc-4f24-4887-8c62-0d0b7c5e7f3e service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Received event network-vif-plugged-5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-fcc7c477-8a17-49a1-9be5-5977955bf86a req-048ba9fc-4f24-4887-8c62-0d0b7c5e7f3e service nova] Acquiring lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-fcc7c477-8a17-49a1-9be5-5977955bf86a req-048ba9fc-4f24-4887-8c62-0d0b7c5e7f3e service nova] Lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-fcc7c477-8a17-49a1-9be5-5977955bf86a req-048ba9fc-4f24-4887-8c62-0d0b7c5e7f3e service nova] Lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-fcc7c477-8a17-49a1-9be5-5977955bf86a req-048ba9fc-4f24-4887-8c62-0d0b7c5e7f3e service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] No waiting events found dispatching network-vif-plugged-5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:55:04 user nova-compute[75391]: WARNING nova.compute.manager [req-fcc7c477-8a17-49a1-9be5-5977955bf86a req-048ba9fc-4f24-4887-8c62-0d0b7c5e7f3e service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Received unexpected event network-vif-plugged-5af75008-fab4-4b58-b936-3d35fdcc8199 for instance with vm_state building and task_state spawning.
Nov 15 02:55:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:05 user nova-compute[75391]: DEBUG nova.compute.manager [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:55:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:55:05 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Instance spawned successfully.
Nov 15 02:55:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:55:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:55:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:55:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:55:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:55:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:55:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:55:05 user nova-compute[75391]: INFO nova.compute.manager [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 15 02:55:05 user nova-compute[75391]: DEBUG nova.compute.manager [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:55:06 user nova-compute[75391]: INFO nova.compute.manager [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Took 11.49 seconds to build instance.
Nov 15 02:55:06 user nova-compute[75391]: DEBUG nova.compute.manager [req-f3799e15-7fea-4bdc-892b-f386b8852518 req-67dafd38-607e-4c41-9aca-3fc571710c72 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Received event network-vif-plugged-5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f3799e15-7fea-4bdc-892b-f386b8852518 req-67dafd38-607e-4c41-9aca-3fc571710c72 service nova] Acquiring lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f3799e15-7fea-4bdc-892b-f386b8852518 req-67dafd38-607e-4c41-9aca-3fc571710c72 service nova] Lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f3799e15-7fea-4bdc-892b-f386b8852518 req-67dafd38-607e-4c41-9aca-3fc571710c72 service nova] Lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:06 user nova-compute[75391]: DEBUG nova.compute.manager [req-f3799e15-7fea-4bdc-892b-f386b8852518 req-67dafd38-607e-4c41-9aca-3fc571710c72 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] No waiting events found dispatching network-vif-plugged-5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:55:06 user nova-compute[75391]: WARNING nova.compute.manager [req-f3799e15-7fea-4bdc-892b-f386b8852518 req-67dafd38-607e-4c41-9aca-3fc571710c72 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Received unexpected event network-vif-plugged-5af75008-fab4-4b58-b936-3d35fdcc8199 for instance with vm_state active and task_state None.
Nov 15 02:55:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cb901ca1-15f6-44ce-b89e-0cee9a16d2b1 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.601s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:11 user nova-compute[75391]: INFO nova.compute.manager [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Rescuing
Nov 15 02:55:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "refresh_cache-9909ae6b-7900-4f71-8900-2bf25185e436" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:55:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquired lock "refresh_cache-9909ae6b-7900-4f71-8900-2bf25185e436" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:55:11 user nova-compute[75391]: DEBUG nova.network.neutron [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:55:11 user nova-compute[75391]: INFO nova.compute.manager [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Rescuing
Nov 15 02:55:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "refresh_cache-c767fb74-e57f-4ea0-bf4e-4034cf656a78" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:55:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquired lock "refresh_cache-c767fb74-e57f-4ea0-bf4e-4034cf656a78" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:55:11 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:55:12 user nova-compute[75391]: DEBUG nova.network.neutron [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Updating instance_info_cache with network_info: [{"id": "45919066-22c9-4df6-b411-e07851e743b6", "address": "fa:16:3e:86:62:a8", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45919066-22", "ovs_interfaceid": "45919066-22c9-4df6-b411-e07851e743b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:55:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Releasing lock "refresh_cache-9909ae6b-7900-4f71-8900-2bf25185e436" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:55:12 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Updating instance_info_cache with network_info: [{"id": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "address": "fa:16:3e:9e:b6:f5", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a80868d-8a", "ovs_interfaceid": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:55:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Releasing lock "refresh_cache-c767fb74-e57f-4ea0-bf4e-4034cf656a78" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:55:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-8be517a0-50b0-44e3-bb5a-b9d972bf69fc req-4cd49439-78cd-4130-a13a-1e035f88ae62 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Received event network-vif-unplugged-45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8be517a0-50b0-44e3-bb5a-b9d972bf69fc req-4cd49439-78cd-4130-a13a-1e035f88ae62 service nova] Acquiring lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8be517a0-50b0-44e3-bb5a-b9d972bf69fc req-4cd49439-78cd-4130-a13a-1e035f88ae62 service nova] Lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8be517a0-50b0-44e3-bb5a-b9d972bf69fc req-4cd49439-78cd-4130-a13a-1e035f88ae62 service nova] Lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-8be517a0-50b0-44e3-bb5a-b9d972bf69fc req-4cd49439-78cd-4130-a13a-1e035f88ae62 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] No waiting events found dispatching network-vif-unplugged-45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:55:12 user nova-compute[75391]: WARNING nova.compute.manager [req-8be517a0-50b0-44e3-bb5a-b9d972bf69fc req-4cd49439-78cd-4130-a13a-1e035f88ae62 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Received unexpected event network-vif-unplugged-45919066-22c9-4df6-b411-e07851e743b6 for instance with vm_state active and task_state rescuing.
Nov 15 02:55:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-46987dd3-134a-401b-8412-86cd06393ee5 req-8da4c146-3c66-40c1-b6e2-14f2590ad00f service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received event network-vif-unplugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-46987dd3-134a-401b-8412-86cd06393ee5 req-8da4c146-3c66-40c1-b6e2-14f2590ad00f service nova] Acquiring lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-46987dd3-134a-401b-8412-86cd06393ee5 req-8da4c146-3c66-40c1-b6e2-14f2590ad00f service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-46987dd3-134a-401b-8412-86cd06393ee5 req-8da4c146-3c66-40c1-b6e2-14f2590ad00f service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-46987dd3-134a-401b-8412-86cd06393ee5 req-8da4c146-3c66-40c1-b6e2-14f2590ad00f service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] No waiting events found dispatching network-vif-unplugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:55:12 user nova-compute[75391]: WARNING nova.compute.manager [req-46987dd3-134a-401b-8412-86cd06393ee5 req-8da4c146-3c66-40c1-b6e2-14f2590ad00f service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received unexpected event network-vif-unplugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc for instance with vm_state active and task_state rescuing.
Nov 15 02:55:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:13 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Instance destroyed successfully.
Nov 15 02:55:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:13 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Instance destroyed successfully.
Nov 15 02:55:13 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Attempting rescue
Nov 15 02:55:13 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75391) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 02:55:13 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Attempting a stable device rescue
Nov 15 02:55:13 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Instance directory exists: not creating {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 02:55:13 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Creating image(s)
Nov 15 02:55:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "/opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "/opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "/opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:13 user nova-compute[75391]: DEBUG nova.objects.instance [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9909ae6b-7900-4f71-8900-2bf25185e436 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:55:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:13 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75391) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 02:55:13 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Instance directory exists: not creating {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 02:55:13 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Creating image(s)
Nov 15 02:55:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "/opt/stack/data/nova/instances/c767fb74-e57f-4ea0-bf4e-4034cf656a78/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "/opt/stack/data/nova/instances/c767fb74-e57f-4ea0-bf4e-4034cf656a78/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "/opt/stack/data/nova/instances/c767fb74-e57f-4ea0-bf4e-4034cf656a78/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:13 user nova-compute[75391]: DEBUG nova.objects.instance [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lazy-loading 'trusted_certs' on Instance uuid c767fb74-e57f-4ea0-bf4e-4034cf656a78 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:55:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "5ce9bbd94ef2de94cb01c6f05642b5b468b3eb0e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "5ce9bbd94ef2de94cb01c6f05642b5b468b3eb0e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.207s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk.rescue {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk.rescue" returned: 0 in 0.204s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.415s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:13 user nova-compute[75391]: DEBUG nova.objects.instance [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'migration_context' on Instance uuid 9909ae6b-7900-4f71-8900-2bf25185e436 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:55:13 user nova-compute[75391]: DEBUG nova.objects.base [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Object Instance<9909ae6b-7900-4f71-8900-2bf25185e436> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:55:13 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:55:13 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Start _get_guest_xml network_info=[{"id": "45919066-22c9-4df6-b411-e07851e743b6", "address": "fa:16:3e:86:62:a8", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "vif_mac": "fa:16:3e:86:62:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45919066-22", "ovs_interfaceid": "45919066-22c9-4df6-b411-e07851e743b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:55:13 user nova-compute[75391]: DEBUG nova.objects.instance [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'resources' on Instance uuid 9909ae6b-7900-4f71-8900-2bf25185e436 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ce9bbd94ef2de94cb01c6f05642b5b468b3eb0e.part --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.objects.base [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Object Instance<9909ae6b-7900-4f71-8900-2bf25185e436> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.objects.instance [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'numa_topology' on Instance uuid 9909ae6b-7900-4f71-8900-2bf25185e436 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.compute.manager [req-484b692e-c1a6-4130-8418-30eb6f6d2b3b req-f7392b41-3642-40a6-af50-8d2679056cc2 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Received event network-vif-plugged-45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-484b692e-c1a6-4130-8418-30eb6f6d2b3b req-f7392b41-3642-40a6-af50-8d2679056cc2 service nova] Acquiring lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-484b692e-c1a6-4130-8418-30eb6f6d2b3b req-f7392b41-3642-40a6-af50-8d2679056cc2 service nova] Lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-484b692e-c1a6-4130-8418-30eb6f6d2b3b req-f7392b41-3642-40a6-af50-8d2679056cc2 service nova] Lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.compute.manager [req-484b692e-c1a6-4130-8418-30eb6f6d2b3b req-f7392b41-3642-40a6-af50-8d2679056cc2 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] No waiting events found dispatching network-vif-plugged-45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:55:14 user nova-compute[75391]: WARNING nova.compute.manager [req-484b692e-c1a6-4130-8418-30eb6f6d2b3b req-f7392b41-3642-40a6-af50-8d2679056cc2 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Received unexpected event network-vif-plugged-45919066-22c9-4df6-b411-e07851e743b6 for instance with vm_state active and task_state rescuing.
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.compute.manager [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] Acquiring lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.compute.manager [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] No waiting events found dispatching network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:55:14 user nova-compute[75391]: WARNING nova.compute.manager [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received unexpected event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc for instance with vm_state active and task_state rescuing.
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.compute.manager [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] Acquiring lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.compute.manager [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] No waiting events found dispatching network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:55:14 user nova-compute[75391]: WARNING nova.compute.manager [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received unexpected event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc for instance with vm_state active and task_state rescuing.
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.compute.manager [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] Acquiring lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.compute.manager [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] No waiting events found dispatching network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:55:14 user nova-compute[75391]: WARNING nova.compute.manager [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received unexpected event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc for instance with vm_state active and task_state rescuing.
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.compute.manager [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received event network-vif-unplugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] Acquiring lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.compute.manager [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] No waiting events found dispatching network-vif-unplugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:55:14 user nova-compute[75391]: WARNING nova.compute.manager [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received unexpected event network-vif-unplugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc for instance with vm_state active and task_state rescuing.
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.compute.manager [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] Acquiring lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.compute.manager [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] No waiting events found dispatching network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:55:14 user nova-compute[75391]: WARNING nova.compute.manager [req-3c9f36f6-790e-46ad-8ea0-0d04dd1fd074 req-109bac00-06cb-4bb8-a856-358666b48f48 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received unexpected event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc for instance with vm_state active and task_state rescuing.
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.objects.base [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Object Instance<9909ae6b-7900-4f71-8900-2bf25185e436> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:55:14 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:55:14 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.objects.instance [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9909ae6b-7900-4f71-8900-2bf25185e436 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.objects.base [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Object Instance<9909ae6b-7900-4f71-8900-2bf25185e436> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2116588976',display_name='tempest-ServerRescueNegativeTestJSON-server-2116588976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2116588976',id=26,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:50:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8bfe79a4e16f4fa89437bcc50fc4b356',ramdisk_id='',reservation_id='r-68s69sl3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-388649299',owner_user_name='tempest-ServerRescueNegativeTestJSON-388649299-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:50:35Z,user_data=None,user_id='9b3fc7a83f6c4c5baa7621163e9f62aa',uuid=9909ae6b-7900-4f71-8900-2bf25185e436,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45919066-22c9-4df6-b411-e07851e743b6", "address": "fa:16:3e:86:62:a8", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "vif_mac": "fa:16:3e:86:62:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45919066-22", "ovs_interfaceid": "45919066-22c9-4df6-b411-e07851e743b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Converting VIF {"id": "45919066-22c9-4df6-b411-e07851e743b6", "address": "fa:16:3e:86:62:a8", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "vif_mac": "fa:16:3e:86:62:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45919066-22", "ovs_interfaceid": "45919066-22c9-4df6-b411-e07851e743b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:62:a8,bridge_name='br-int',has_traffic_filtering=True,id=45919066-22c9-4df6-b411-e07851e743b6,network=Network(079437cd-2e7d-40ea-98c0-24a1c9091aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45919066-22') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.objects.instance [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'pci_devices' on Instance uuid 9909ae6b-7900-4f71-8900-2bf25185e436 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.objects.base [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Object Instance<9909ae6b-7900-4f71-8900-2bf25185e436> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:55:14 user nova-compute[75391]:   <uuid>9909ae6b-7900-4f71-8900-2bf25185e436</uuid>
Nov 15 02:55:14 user nova-compute[75391]:   <name>instance-0000001a</name>
Nov 15 02:55:14 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:55:14 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:55:14 user nova-compute[75391]:   <metadata>
Nov 15 02:55:14 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:55:14 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:55:14 user nova-compute[75391]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2116588976</nova:name>
Nov 15 02:55:14 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:55:14</nova:creationTime>
Nov 15 02:55:14 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:55:14 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:55:14 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:55:14 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:55:14 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:55:14 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:55:14 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:55:14 user nova-compute[75391]:       <nova:owner>
Nov 15 02:55:14 user nova-compute[75391]:         <nova:user uuid="9b3fc7a83f6c4c5baa7621163e9f62aa">tempest-ServerRescueNegativeTestJSON-388649299-project-member</nova:user>
Nov 15 02:55:14 user nova-compute[75391]:         <nova:project uuid="8bfe79a4e16f4fa89437bcc50fc4b356">tempest-ServerRescueNegativeTestJSON-388649299</nova:project>
Nov 15 02:55:14 user nova-compute[75391]:       </nova:owner>
Nov 15 02:55:14 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:55:14 user nova-compute[75391]:       <nova:ports>
Nov 15 02:55:14 user nova-compute[75391]:         <nova:port uuid="45919066-22c9-4df6-b411-e07851e743b6">
Nov 15 02:55:14 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 02:55:14 user nova-compute[75391]:         </nova:port>
Nov 15 02:55:14 user nova-compute[75391]:       </nova:ports>
Nov 15 02:55:14 user nova-compute[75391]:     </nova:instance>
Nov 15 02:55:14 user nova-compute[75391]:   </metadata>
Nov 15 02:55:14 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:55:14 user nova-compute[75391]:     <system>
Nov 15 02:55:14 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:55:14 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:55:14 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:55:14 user nova-compute[75391]:       <entry name="serial">9909ae6b-7900-4f71-8900-2bf25185e436</entry>
Nov 15 02:55:14 user nova-compute[75391]:       <entry name="uuid">9909ae6b-7900-4f71-8900-2bf25185e436</entry>
Nov 15 02:55:14 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:55:14 user nova-compute[75391]:     </system>
Nov 15 02:55:14 user nova-compute[75391]:   </sysinfo>
Nov 15 02:55:14 user nova-compute[75391]:   <os>
Nov 15 02:55:14 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:55:14 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:55:14 user nova-compute[75391]:   </os>
Nov 15 02:55:14 user nova-compute[75391]:   <features>
Nov 15 02:55:14 user nova-compute[75391]:     <acpi/>
Nov 15 02:55:14 user nova-compute[75391]:     <apic/>
Nov 15 02:55:14 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:55:14 user nova-compute[75391]:   </features>
Nov 15 02:55:14 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:55:14 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:55:14 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:55:14 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:55:14 user nova-compute[75391]:   </clock>
Nov 15 02:55:14 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:55:14 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:55:14 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:55:14 user nova-compute[75391]:   </cpu>
Nov 15 02:55:14 user nova-compute[75391]:   <devices>
Nov 15 02:55:14 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:55:14 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:55:14 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk.rescue"/>
Nov 15 02:55:14 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:55:14 user nova-compute[75391]:     </disk>
Nov 15 02:55:14 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:55:14 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:55:14 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk"/>
Nov 15 02:55:14 user nova-compute[75391]:       <target dev="vdb" bus="virtio"/>
Nov 15 02:55:14 user nova-compute[75391]:     </disk>
Nov 15 02:55:14 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:55:14 user nova-compute[75391]:       <mac address="fa:16:3e:86:62:a8"/>
Nov 15 02:55:14 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:55:14 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:55:14 user nova-compute[75391]:       <target dev="tap45919066-22"/>
Nov 15 02:55:14 user nova-compute[75391]:     </interface>
Nov 15 02:55:14 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:55:14 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/console.log" append="off"/>
Nov 15 02:55:14 user nova-compute[75391]:     </serial>
Nov 15 02:55:14 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:55:14 user nova-compute[75391]:     <video>
Nov 15 02:55:14 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:55:14 user nova-compute[75391]:     </video>
Nov 15 02:55:14 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:55:14 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:55:14 user nova-compute[75391]:     </rng>
Nov 15 02:55:14 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:55:14 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:55:14 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:55:14 user nova-compute[75391]:     </memballoon>
Nov 15 02:55:14 user nova-compute[75391]:   </devices>
Nov 15 02:55:14 user nova-compute[75391]: </domain>
Nov 15 02:55:14 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:55:14 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Instance destroyed successfully.
Nov 15 02:55:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ce9bbd94ef2de94cb01c6f05642b5b468b3eb0e.part --force-share --output=json" returned: 0 in 0.197s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.virt.images [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] 7af41bef-fe28-4c7b-b1af-a93beb4e72b3 was qcow2, converting to raw {{(pid=75391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.privsep.utils [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5ce9bbd94ef2de94cb01c6f05642b5b468b3eb0e.part /opt/stack/data/nova/instances/_base/5ce9bbd94ef2de94cb01c6f05642b5b468b3eb0e.converted {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.compute.manager [req-2ba00cb2-8548-425a-b28c-da446c153998 req-6a3b8079-eb1e-46e8-b60c-9239564e47d8 service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Received event network-changed-d8f34e4c-5c99-45eb-a282-a721a2019209 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.compute.manager [req-2ba00cb2-8548-425a-b28c-da446c153998 req-6a3b8079-eb1e-46e8-b60c-9239564e47d8 service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Refreshing instance network info cache due to event network-changed-d8f34e4c-5c99-45eb-a282-a721a2019209. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2ba00cb2-8548-425a-b28c-da446c153998 req-6a3b8079-eb1e-46e8-b60c-9239564e47d8 service nova] Acquiring lock "refresh_cache-fc9484c0-9083-4797-8ab1-2ad392822ce8" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2ba00cb2-8548-425a-b28c-da446c153998 req-6a3b8079-eb1e-46e8-b60c-9239564e47d8 service nova] Acquired lock "refresh_cache-fc9484c0-9083-4797-8ab1-2ad392822ce8" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:55:14 user nova-compute[75391]: DEBUG nova.network.neutron [req-2ba00cb2-8548-425a-b28c-da446c153998 req-6a3b8079-eb1e-46e8-b60c-9239564e47d8 service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Refreshing network info cache for port d8f34e4c-5c99-45eb-a282-a721a2019209 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:55:15 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:55:15 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:55:15 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] No VIF found with MAC fa:16:3e:86:62:a8, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:55:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5ce9bbd94ef2de94cb01c6f05642b5b468b3eb0e.part /opt/stack/data/nova/instances/_base/5ce9bbd94ef2de94cb01c6f05642b5b468b3eb0e.converted" returned: 0 in 0.581s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ce9bbd94ef2de94cb01c6f05642b5b468b3eb0e.converted --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:15 user nova-compute[75391]: DEBUG nova.network.neutron [req-2ba00cb2-8548-425a-b28c-da446c153998 req-6a3b8079-eb1e-46e8-b60c-9239564e47d8 service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Updated VIF entry in instance network info cache for port d8f34e4c-5c99-45eb-a282-a721a2019209. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:55:15 user nova-compute[75391]: DEBUG nova.network.neutron [req-2ba00cb2-8548-425a-b28c-da446c153998 req-6a3b8079-eb1e-46e8-b60c-9239564e47d8 service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Updating instance_info_cache with network_info: [{"id": "d8f34e4c-5c99-45eb-a282-a721a2019209", "address": "fa:16:3e:ca:58:46", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f34e4c-5c", "ovs_interfaceid": "d8f34e4c-5c99-45eb-a282-a721a2019209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:55:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2ba00cb2-8548-425a-b28c-da446c153998 req-6a3b8079-eb1e-46e8-b60c-9239564e47d8 service nova] Releasing lock "refresh_cache-fc9484c0-9083-4797-8ab1-2ad392822ce8" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:55:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ce9bbd94ef2de94cb01c6f05642b5b468b3eb0e.converted --force-share --output=json" returned: 0 in 0.208s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "5ce9bbd94ef2de94cb01c6f05642b5b468b3eb0e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.159s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "5ce9bbd94ef2de94cb01c6f05642b5b468b3eb0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "5ce9bbd94ef2de94cb01c6f05642b5b468b3eb0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ce9bbd94ef2de94cb01c6f05642b5b468b3eb0e --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ce9bbd94ef2de94cb01c6f05642b5b468b3eb0e --force-share --output=json" returned: 0 in 0.184s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5ce9bbd94ef2de94cb01c6f05642b5b468b3eb0e,backing_fmt=raw /opt/stack/data/nova/instances/c767fb74-e57f-4ea0-bf4e-4034cf656a78/disk.rescue {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5ce9bbd94ef2de94cb01c6f05642b5b468b3eb0e,backing_fmt=raw /opt/stack/data/nova/instances/c767fb74-e57f-4ea0-bf4e-4034cf656a78/disk.rescue" returned: 0 in 0.053s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "5ce9bbd94ef2de94cb01c6f05642b5b468b3eb0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:15 user nova-compute[75391]: DEBUG nova.objects.instance [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lazy-loading 'migration_context' on Instance uuid c767fb74-e57f-4ea0-bf4e-4034cf656a78 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:55:15 user nova-compute[75391]: DEBUG nova.objects.base [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Object Instance<c767fb74-e57f-4ea0-bf4e-4034cf656a78> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:55:15 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:55:15 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Start _get_guest_xml network_info=[{"id": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "address": "fa:16:3e:9e:b6:f5", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "vif_mac": "fa:16:3e:9e:b6:f5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a80868d-8a", "ovs_interfaceid": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7af41bef-fe28-4c7b-b1af-a93beb4e72b3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'aa87f1ce-7e09-47b3-a418-4e48d29f12c3', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AlBTRFWf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'c767fb74-e57f-4ea0-bf4e-4034cf656a78', 'attached_at': '', 'detached_at': '', 'volume_id': '4aadee61-9526-4ff0-9a9b-16861d006d39', 'serial': '4aadee61-9526-4ff0-9a9b-16861d006d39'}, 'volume_type': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:55:15 user nova-compute[75391]: DEBUG nova.objects.instance [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lazy-loading 'resources' on Instance uuid c767fb74-e57f-4ea0-bf4e-4034cf656a78 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.objects.base [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Object Instance<c767fb74-e57f-4ea0-bf4e-4034cf656a78> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.objects.instance [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lazy-loading 'numa_topology' on Instance uuid c767fb74-e57f-4ea0-bf4e-4034cf656a78 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.objects.base [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Object Instance<c767fb74-e57f-4ea0-bf4e-4034cf656a78> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:55:16 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:55:16 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.objects.instance [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lazy-loading 'vcpu_model' on Instance uuid c767fb74-e57f-4ea0-bf4e-4034cf656a78 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.objects.base [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Object Instance<c767fb74-e57f-4ea0-bf4e-4034cf656a78> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AlBTRFWf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:55:16 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:55:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:55:16 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:55:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:55:16 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:55:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd32eb9-4e9f-4aeb-bed8-a686d6160d44]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = AlBTRFWf\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 02:55:16 user nova-compute[75391]: node.name = iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39
Nov 15 02:55:16 user nova-compute[75391]: node.tpgt = -1
Nov 15 02:55:16 user nova-compute[75391]: node.startup = automatic
Nov 15 02:55:16 user nova-compute[75391]: node.leading_login = No
Nov 15 02:55:16 user nova-compute[75391]: iface.iscsi_ifacename = default
Nov 15 02:55:16 user nova-compute[75391]: iface.net_ifacename = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.ipaddress = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.prefix_len = 0
Nov 15 02:55:16 user nova-compute[75391]: iface.hwaddress = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.transport_name = tcp
Nov 15 02:55:16 user nova-compute[75391]: iface.initiatorname = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.state = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.vlan_id = 0
Nov 15 02:55:16 user nova-compute[75391]: iface.vlan_priority = 0
Nov 15 02:55:16 user nova-compute[75391]: iface.vlan_state = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.iface_num = 0
Nov 15 02:55:16 user nova-compute[75391]: iface.mtu = 0
Nov 15 02:55:16 user nova-compute[75391]: iface.port = 0
Nov 15 02:55:16 user nova-compute[75391]: iface.bootproto = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.subnet_mask = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.gateway = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.dhcp_alt_client_id = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.dhcp_dns = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.dhcp_learn_iqn = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.dhcp_vendor_id_state = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.dhcp_vendor_id = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.dhcp_slp_da = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.fragmentation = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.gratuitous_arp = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.incoming_forwarding = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.tos_state = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.tos = 0
Nov 15 02:55:16 user nova-compute[75391]: iface.ttl = 0
Nov 15 02:55:16 user nova-compute[75391]: iface.delayed_ack = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.tcp_nagle = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.tcp_wsf_state = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.tcp_wsf = 0
Nov 15 02:55:16 user nova-compute[75391]: iface.tcp_timer_scale = 0
Nov 15 02:55:16 user nova-compute[75391]: iface.tcp_timestamp = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.redirect = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.def_task_mgmt_timeout = 0
Nov 15 02:55:16 user nova-compute[75391]: iface.header_digest = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.data_digest = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.immediate_data = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.initial_r2t = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.data_seq_inorder = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.data_pdu_inorder = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.erl = 0
Nov 15 02:55:16 user nova-compute[75391]: iface.max_receive_data_len = 0
Nov 15 02:55:16 user nova-compute[75391]: iface.first_burst_len = 0
Nov 15 02:55:16 user nova-compute[75391]: iface.max_outstanding_r2t = 0
Nov 15 02:55:16 user nova-compute[75391]: iface.max_burst_len = 0
Nov 15 02:55:16 user nova-compute[75391]: iface.chap_auth = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.bidi_chap = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.strict_login_compliance = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.discovery_auth = <empty>
Nov 15 02:55:16 user nova-compute[75391]: iface.discovery_logout = <empty>
Nov 15 02:55:16 user nova-compute[75391]: node.discovery_address = <empty>
Nov 15 02:55:16 user nova-compute[75391]: node.discovery_port = 0
Nov 15 02:55:16 user nova-compute[75391]: node.discovery_type = static
Nov 15 02:55:16 user nova-compute[75391]: node.session.initial_cmdsn = 0
Nov 15 02:55:16 user nova-compute[75391]: node.session.initial_login_retry_max = 8
Nov 15 02:55:16 user nova-compute[75391]: node.session.xmit_thread_priority = -20
Nov 15 02:55:16 user nova-compute[75391]: node.session.cmds_max = 128
Nov 15 02:55:16 user nova-compute[75391]: node.session.queue_depth = 32
Nov 15 02:55:16 user nova-compute[75391]: node.session.nr_sessions = 1
Nov 15 02:55:16 user nova-compute[75391]: node.session.auth.authmethod = CHAP
Nov 15 02:55:16 user nova-compute[75391]: node.session.auth.username = AlBTRFWf
Nov 15 02:55:16 user nova-compute[75391]: node.session.auth.password = ***
Nov 15 02:55:16 user nova-compute[75391]: node.session.auth.username_in = <empty>
Nov 15 02:55:16 user nova-compute[75391]: node.session.auth.password_in = <empty>
Nov 15 02:55:16 user nova-compute[75391]: node.session.auth.chap_algs = MD5
Nov 15 02:55:16 user nova-compute[75391]: node.session.timeo.replacement_timeout = 120
Nov 15 02:55:16 user nova-compute[75391]: node.session.err_timeo.abort_timeout = 15
Nov 15 02:55:16 user nova-compute[75391]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 02:55:16 user nova-compute[75391]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 02:55:16 user nova-compute[75391]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 02:55:16 user nova-compute[75391]: node.session.iscsi.FastAbort = Yes
Nov 15 02:55:16 user nova-compute[75391]: node.session.iscsi.InitialR2T = No
Nov 15 02:55:16 user nova-compute[75391]: node.session.iscsi.ImmediateData = Yes
Nov 15 02:55:16 user nova-compute[75391]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 02:55:16 user nova-compute[75391]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 02:55:16 user nova-compute[75391]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 02:55:16 user nova-compute[75391]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 02:55:16 user nova-compute[75391]: node.session.iscsi.MaxConnections = 1
Nov 15 02:55:16 user nova-compute[75391]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 02:55:16 user nova-compute[75391]: node.session.iscsi.ERL = 0
Nov 15 02:55:16 user nova-compute[75391]: node.session.scan = manual
Nov 15 02:55:16 user nova-compute[75391]: node.session.reopen_max = 0
Nov 15 02:55:16 user nova-compute[75391]: node.conn[0].address = 172.16.0.220
Nov 15 02:55:16 user nova-compute[75391]: node.conn[0].port = 3260
Nov 15 02:55:16 user nova-compute[75391]: node.conn[0].startup = manual
Nov 15 02:55:16 user nova-compute[75391]: node.conn[0].tcp.window_size = 524288
Nov 15 02:55:16 user nova-compute[75391]: node.conn[0].tcp.type_of_service = 0
Nov 15 02:55:16 user nova-compute[75391]: node.conn[0].timeo.logout_timeout = 15
Nov 15 02:55:16 user nova-compute[75391]: node.conn[0].timeo.login_timeout = 15
Nov 15 02:55:16 user nova-compute[75391]: node.conn[0].timeo.auth_timeout = 45
Nov 15 02:55:16 user nova-compute[75391]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 02:55:16 user nova-compute[75391]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 02:55:16 user nova-compute[75391]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 02:55:16 user nova-compute[75391]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 02:55:16 user nova-compute[75391]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 02:55:16 user nova-compute[75391]: node.conn[0].iscsi.DataDigest = None
Nov 15 02:55:16 user nova-compute[75391]: node.conn[0].iscsi.IFMarker = No
Nov 15 02:55:16 user nova-compute[75391]: node.conn[0].iscsi.OFMarker = No
Nov 15 02:55:16 user nova-compute[75391]: # END RECORD
Nov 15 02:55:16 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5d5bd0-c64a-4f3d-aaa1-4f232c41cc99]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d62e262-d3f7-416d-81de-ac7a0f0e4faa]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AlBTRFWf {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AlBTRFWf" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef028567-1fd1-4efa-8a3d-0e06f9500b7c]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AlBTRFWf'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a40f9be-7f49-447b-8a8c-dc3951404913]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b902b05-cfd0-4fa9-854c-c34692e798bc]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:55:16 user nova-compute[75391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:55:16 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:55:16 user nova-compute[75391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e (non-flash)
Nov 15 02:55:16 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:55:16 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:55:16 user nova-compute[75391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:55:16 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:55:16 user nova-compute[75391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e (non-flash)
Nov 15 02:55:16 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:55:16 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.175s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] HCTL ('35', '0', '0', 0) found on session 37 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f49538-1ee6-4e3e-8c4a-3e94d5557c5d]: (4, ('0 0 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Searching for a device in session 37 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AlBTRFWf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.203s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] <== connect_volume: return (204ms) {'type': 'block', 'scsi_wwn': '26166303839326134', 'path': '/dev/sdd'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166303839326134', 'path': '/dev/sdd'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:53:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1960364305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1960364305',id=31,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:53:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e63a88a9fe824c3e9c0807a50b569d54',ramdisk_id='',reservation_id='r-zgxz855s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-141063167',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:53:40Z,user_data=None,user_id='0aa106a59c374dde99b7697f94407339',uuid=c767fb74-e57f-4ea0-bf4e-4034cf656a78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "address": "fa:16:3e:9e:b6:f5", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "vif_mac": "fa:16:3e:9e:b6:f5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a80868d-8a", "ovs_interfaceid": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Converting VIF {"id": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "address": "fa:16:3e:9e:b6:f5", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "vif_mac": "fa:16:3e:9e:b6:f5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a80868d-8a", "ovs_interfaceid": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:b6:f5,bridge_name='br-int',has_traffic_filtering=True,id=5a80868d-8a1f-4a83-8c22-d3f504963bbc,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a80868d-8a') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.objects.instance [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lazy-loading 'pci_devices' on Instance uuid c767fb74-e57f-4ea0-bf4e-4034cf656a78 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.objects.base [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Object Instance<c767fb74-e57f-4ea0-bf4e-4034cf656a78> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:55:16 user nova-compute[75391]:   <uuid>c767fb74-e57f-4ea0-bf4e-4034cf656a78</uuid>
Nov 15 02:55:16 user nova-compute[75391]:   <name>instance-0000001f</name>
Nov 15 02:55:16 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:55:16 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:55:16 user nova-compute[75391]:   <metadata>
Nov 15 02:55:16 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:55:16 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:55:16 user nova-compute[75391]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1960364305</nova:name>
Nov 15 02:55:16 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:55:16</nova:creationTime>
Nov 15 02:55:16 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:55:16 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:55:16 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:55:16 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:55:16 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:55:16 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:55:16 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:55:16 user nova-compute[75391]:       <nova:owner>
Nov 15 02:55:16 user nova-compute[75391]:         <nova:user uuid="0aa106a59c374dde99b7697f94407339">tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member</nova:user>
Nov 15 02:55:16 user nova-compute[75391]:         <nova:project uuid="e63a88a9fe824c3e9c0807a50b569d54">tempest-ServerBootFromVolumeStableRescueTest-141063167</nova:project>
Nov 15 02:55:16 user nova-compute[75391]:       </nova:owner>
Nov 15 02:55:16 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:55:16 user nova-compute[75391]:       <nova:ports>
Nov 15 02:55:16 user nova-compute[75391]:         <nova:port uuid="5a80868d-8a1f-4a83-8c22-d3f504963bbc">
Nov 15 02:55:16 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 02:55:16 user nova-compute[75391]:         </nova:port>
Nov 15 02:55:16 user nova-compute[75391]:       </nova:ports>
Nov 15 02:55:16 user nova-compute[75391]:     </nova:instance>
Nov 15 02:55:16 user nova-compute[75391]:   </metadata>
Nov 15 02:55:16 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:55:16 user nova-compute[75391]:     <system>
Nov 15 02:55:16 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:55:16 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:55:16 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:55:16 user nova-compute[75391]:       <entry name="serial">c767fb74-e57f-4ea0-bf4e-4034cf656a78</entry>
Nov 15 02:55:16 user nova-compute[75391]:       <entry name="uuid">c767fb74-e57f-4ea0-bf4e-4034cf656a78</entry>
Nov 15 02:55:16 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:55:16 user nova-compute[75391]:     </system>
Nov 15 02:55:16 user nova-compute[75391]:   </sysinfo>
Nov 15 02:55:16 user nova-compute[75391]:   <os>
Nov 15 02:55:16 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:55:16 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:55:16 user nova-compute[75391]:   </os>
Nov 15 02:55:16 user nova-compute[75391]:   <features>
Nov 15 02:55:16 user nova-compute[75391]:     <acpi/>
Nov 15 02:55:16 user nova-compute[75391]:     <apic/>
Nov 15 02:55:16 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:55:16 user nova-compute[75391]:   </features>
Nov 15 02:55:16 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:55:16 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:55:16 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:55:16 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:55:16 user nova-compute[75391]:   </clock>
Nov 15 02:55:16 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:55:16 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:55:16 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:55:16 user nova-compute[75391]:   </cpu>
Nov 15 02:55:16 user nova-compute[75391]:   <devices>
Nov 15 02:55:16 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 02:55:16 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:55:16 user nova-compute[75391]:       <source dev="/dev/sdd"/>
Nov 15 02:55:16 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:55:16 user nova-compute[75391]:       <serial>4aadee61-9526-4ff0-9a9b-16861d006d39</serial>
Nov 15 02:55:16 user nova-compute[75391]:     </disk>
Nov 15 02:55:16 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:55:16 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:55:16 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/c767fb74-e57f-4ea0-bf4e-4034cf656a78/disk.rescue"/>
Nov 15 02:55:16 user nova-compute[75391]:       <target dev="vdb" bus="virtio"/>
Nov 15 02:55:16 user nova-compute[75391]:       <boot order="1"/>
Nov 15 02:55:16 user nova-compute[75391]:     </disk>
Nov 15 02:55:16 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:55:16 user nova-compute[75391]:       <mac address="fa:16:3e:9e:b6:f5"/>
Nov 15 02:55:16 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:55:16 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:55:16 user nova-compute[75391]:       <target dev="tap5a80868d-8a"/>
Nov 15 02:55:16 user nova-compute[75391]:     </interface>
Nov 15 02:55:16 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:55:16 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/c767fb74-e57f-4ea0-bf4e-4034cf656a78/console.log" append="off"/>
Nov 15 02:55:16 user nova-compute[75391]:     </serial>
Nov 15 02:55:16 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:55:16 user nova-compute[75391]:     <video>
Nov 15 02:55:16 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:55:16 user nova-compute[75391]:     </video>
Nov 15 02:55:16 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:55:16 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:55:16 user nova-compute[75391]:     </rng>
Nov 15 02:55:16 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:55:16 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:55:16 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:55:16 user nova-compute[75391]:     </memballoon>
Nov 15 02:55:16 user nova-compute[75391]:   </devices>
Nov 15 02:55:16 user nova-compute[75391]: </domain>
Nov 15 02:55:16 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:55:16 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Instance destroyed successfully.
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] No VIF found with MAC fa:16:3e:9e:b6:f5, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.compute.manager [req-bfb8ec10-6197-4857-ab74-093b60c39064 req-8fe0eddb-c0f6-4ae1-85b3-981468f33364 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Received event network-vif-plugged-45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bfb8ec10-6197-4857-ab74-093b60c39064 req-8fe0eddb-c0f6-4ae1-85b3-981468f33364 service nova] Acquiring lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bfb8ec10-6197-4857-ab74-093b60c39064 req-8fe0eddb-c0f6-4ae1-85b3-981468f33364 service nova] Lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bfb8ec10-6197-4857-ab74-093b60c39064 req-8fe0eddb-c0f6-4ae1-85b3-981468f33364 service nova] Lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.compute.manager [req-bfb8ec10-6197-4857-ab74-093b60c39064 req-8fe0eddb-c0f6-4ae1-85b3-981468f33364 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] No waiting events found dispatching network-vif-plugged-45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:55:16 user nova-compute[75391]: WARNING nova.compute.manager [req-bfb8ec10-6197-4857-ab74-093b60c39064 req-8fe0eddb-c0f6-4ae1-85b3-981468f33364 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Received unexpected event network-vif-plugged-45919066-22c9-4df6-b411-e07851e743b6 for instance with vm_state active and task_state rescuing.
Nov 15 02:55:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.compute.manager [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Stashing vm_state: active {{(pid=75391) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:55:16 user nova-compute[75391]: INFO nova.compute.claims [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Claim successful on node user
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.compute.manager [req-f275f1ab-bf56-4b9d-9a07-5d73309e53d2 req-5c8fca2f-e008-4171-95f7-8ddf9379d8f6 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Received event network-changed-f4cd02a6-d62a-435e-93fd-e5216134f788 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.compute.manager [req-f275f1ab-bf56-4b9d-9a07-5d73309e53d2 req-5c8fca2f-e008-4171-95f7-8ddf9379d8f6 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Refreshing instance network info cache due to event network-changed-f4cd02a6-d62a-435e-93fd-e5216134f788. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f275f1ab-bf56-4b9d-9a07-5d73309e53d2 req-5c8fca2f-e008-4171-95f7-8ddf9379d8f6 service nova] Acquiring lock "refresh_cache-a0382af0-0509-4473-832f-1e5e6588be2e" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f275f1ab-bf56-4b9d-9a07-5d73309e53d2 req-5c8fca2f-e008-4171-95f7-8ddf9379d8f6 service nova] Acquired lock "refresh_cache-a0382af0-0509-4473-832f-1e5e6588be2e" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:55:16 user nova-compute[75391]: DEBUG nova.network.neutron [req-f275f1ab-bf56-4b9d-9a07-5d73309e53d2 req-5c8fca2f-e008-4171-95f7-8ddf9379d8f6 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Refreshing network info cache for port f4cd02a6-d62a-435e-93fd-e5216134f788 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:55:17 user nova-compute[75391]: INFO nova.compute.resource_tracker [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Updating resource usage from migration deec6e20-7b5f-4f09-8e17-9fbab60c8af8
Nov 15 02:55:17 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:17 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:55:17 user nova-compute[75391]: DEBUG nova.network.neutron [req-f275f1ab-bf56-4b9d-9a07-5d73309e53d2 req-5c8fca2f-e008-4171-95f7-8ddf9379d8f6 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Updated VIF entry in instance network info cache for port f4cd02a6-d62a-435e-93fd-e5216134f788. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:55:17 user nova-compute[75391]: DEBUG nova.network.neutron [req-f275f1ab-bf56-4b9d-9a07-5d73309e53d2 req-5c8fca2f-e008-4171-95f7-8ddf9379d8f6 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Updating instance_info_cache with network_info: [{"id": "f4cd02a6-d62a-435e-93fd-e5216134f788", "address": "fa:16:3e:af:ba:88", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd02a6-d6", "ovs_interfaceid": "f4cd02a6-d62a-435e-93fd-e5216134f788", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:55:17 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:55:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f275f1ab-bf56-4b9d-9a07-5d73309e53d2 req-5c8fca2f-e008-4171-95f7-8ddf9379d8f6 service nova] Releasing lock "refresh_cache-a0382af0-0509-4473-832f-1e5e6588be2e" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:55:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.563s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:17 user nova-compute[75391]: INFO nova.compute.manager [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Migrating
Nov 15 02:55:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "refresh_cache-a0382af0-0509-4473-832f-1e5e6588be2e" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:55:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquired lock "refresh_cache-a0382af0-0509-4473-832f-1e5e6588be2e" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:55:17 user nova-compute[75391]: DEBUG nova.network.neutron [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:55:17 user nova-compute[75391]: DEBUG nova.network.neutron [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Updating instance_info_cache with network_info: [{"id": "f4cd02a6-d62a-435e-93fd-e5216134f788", "address": "fa:16:3e:af:ba:88", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd02a6-d6", "ovs_interfaceid": "f4cd02a6-d62a-435e-93fd-e5216134f788", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:55:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Releasing lock "refresh_cache-a0382af0-0509-4473-832f-1e5e6588be2e" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Starting migrate_disk_and_power_off {{(pid=75391) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG nova.compute.manager [req-d71fed32-f802-41cf-ab18-42d6850e59c9 req-a87499fa-3dba-41ee-8f63-58a5a3dc3849 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d71fed32-f802-41cf-ab18-42d6850e59c9 req-a87499fa-3dba-41ee-8f63-58a5a3dc3849 service nova] Acquiring lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d71fed32-f802-41cf-ab18-42d6850e59c9 req-a87499fa-3dba-41ee-8f63-58a5a3dc3849 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d71fed32-f802-41cf-ab18-42d6850e59c9 req-a87499fa-3dba-41ee-8f63-58a5a3dc3849 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG nova.compute.manager [req-d71fed32-f802-41cf-ab18-42d6850e59c9 req-a87499fa-3dba-41ee-8f63-58a5a3dc3849 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] No waiting events found dispatching network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:55:18 user nova-compute[75391]: WARNING nova.compute.manager [req-d71fed32-f802-41cf-ab18-42d6850e59c9 req-a87499fa-3dba-41ee-8f63-58a5a3dc3849 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received unexpected event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc for instance with vm_state active and task_state rescuing.
Nov 15 02:55:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG nova.compute.manager [req-004c7bb5-a68f-4df8-984a-979fedda502e req-2983f008-4f36-4516-9cb6-53bb0eb63439 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Received event network-vif-plugged-45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-004c7bb5-a68f-4df8-984a-979fedda502e req-2983f008-4f36-4516-9cb6-53bb0eb63439 service nova] Acquiring lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-004c7bb5-a68f-4df8-984a-979fedda502e req-2983f008-4f36-4516-9cb6-53bb0eb63439 service nova] Lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-004c7bb5-a68f-4df8-984a-979fedda502e req-2983f008-4f36-4516-9cb6-53bb0eb63439 service nova] Lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG nova.compute.manager [req-004c7bb5-a68f-4df8-984a-979fedda502e req-2983f008-4f36-4516-9cb6-53bb0eb63439 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] No waiting events found dispatching network-vif-plugged-45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:55:18 user nova-compute[75391]: WARNING nova.compute.manager [req-004c7bb5-a68f-4df8-984a-979fedda502e req-2983f008-4f36-4516-9cb6-53bb0eb63439 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Received unexpected event network-vif-plugged-45919066-22c9-4df6-b411-e07851e743b6 for instance with vm_state active and task_state rescuing.
Nov 15 02:55:18 user nova-compute[75391]: DEBUG nova.compute.manager [req-004c7bb5-a68f-4df8-984a-979fedda502e req-2983f008-4f36-4516-9cb6-53bb0eb63439 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Received event network-vif-unplugged-f4cd02a6-d62a-435e-93fd-e5216134f788 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-004c7bb5-a68f-4df8-984a-979fedda502e req-2983f008-4f36-4516-9cb6-53bb0eb63439 service nova] Acquiring lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-004c7bb5-a68f-4df8-984a-979fedda502e req-2983f008-4f36-4516-9cb6-53bb0eb63439 service nova] Lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-004c7bb5-a68f-4df8-984a-979fedda502e req-2983f008-4f36-4516-9cb6-53bb0eb63439 service nova] Lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG nova.compute.manager [req-004c7bb5-a68f-4df8-984a-979fedda502e req-2983f008-4f36-4516-9cb6-53bb0eb63439 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] No waiting events found dispatching network-vif-unplugged-f4cd02a6-d62a-435e-93fd-e5216134f788 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:55:18 user nova-compute[75391]: WARNING nova.compute.manager [req-004c7bb5-a68f-4df8-984a-979fedda502e req-2983f008-4f36-4516-9cb6-53bb0eb63439 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Received unexpected event network-vif-unplugged-f4cd02a6-d62a-435e-93fd-e5216134f788 for instance with vm_state active and task_state resize_migrating.
Nov 15 02:55:18 user nova-compute[75391]: DEBUG nova.compute.manager [req-004c7bb5-a68f-4df8-984a-979fedda502e req-2983f008-4f36-4516-9cb6-53bb0eb63439 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Received event network-vif-plugged-f4cd02a6-d62a-435e-93fd-e5216134f788 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-004c7bb5-a68f-4df8-984a-979fedda502e req-2983f008-4f36-4516-9cb6-53bb0eb63439 service nova] Acquiring lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-004c7bb5-a68f-4df8-984a-979fedda502e req-2983f008-4f36-4516-9cb6-53bb0eb63439 service nova] Lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-004c7bb5-a68f-4df8-984a-979fedda502e req-2983f008-4f36-4516-9cb6-53bb0eb63439 service nova] Lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG nova.compute.manager [req-004c7bb5-a68f-4df8-984a-979fedda502e req-2983f008-4f36-4516-9cb6-53bb0eb63439 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] No waiting events found dispatching network-vif-plugged-f4cd02a6-d62a-435e-93fd-e5216134f788 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:55:18 user nova-compute[75391]: WARNING nova.compute.manager [req-004c7bb5-a68f-4df8-984a-979fedda502e req-2983f008-4f36-4516-9cb6-53bb0eb63439 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Received unexpected event network-vif-plugged-f4cd02a6-d62a-435e-93fd-e5216134f788 for instance with vm_state active and task_state resize_migrating.
Nov 15 02:55:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:18 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Instance destroyed successfully.
Nov 15 02:55:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:53:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-15524939',display_name='tempest-ServerActionsTestOtherA-server-15524939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-15524939',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItI9ByRPHa+npkHzUM7/DmFQcMmvmf/UTbrL8IIRz+RgnE4/GT/cT4MtYBSEthl3H1QqF7/CYKc5G1nHfxc2lqIIfQchUdl2quGrdDYzv011COZxukmBFCsP+0gJadT/A==',key_name='tempest-keypair-1167614249',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:53:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='81798f0465704c4d9c09d8c3d3175ac5',ramdisk_id='',reservation_id='r-cpqh006p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1177660790',owner_user_name='tempest-ServerActionsTestOtherA-1177660790-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:55:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ea5480ad1e49afa394e636c37e3b70',uuid=a0382af0-0509-4473-832f-1e5e6588be2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4cd02a6-d62a-435e-93fd-e5216134f788", "address": "fa:16:3e:af:ba:88", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1680507754-network", "vif_mac": "fa:16:3e:af:ba:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd02a6-d6", "ovs_interfaceid": "f4cd02a6-d62a-435e-93fd-e5216134f788", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converting VIF {"id": "f4cd02a6-d62a-435e-93fd-e5216134f788", "address": "fa:16:3e:af:ba:88", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1680507754-network", "vif_mac": "fa:16:3e:af:ba:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd02a6-d6", "ovs_interfaceid": "f4cd02a6-d62a-435e-93fd-e5216134f788", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:ba:88,bridge_name='br-int',has_traffic_filtering=True,id=f4cd02a6-d62a-435e-93fd-e5216134f788,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4cd02a6-d6') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG os_vif [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:ba:88,bridge_name='br-int',has_traffic_filtering=True,id=f4cd02a6-d62a-435e-93fd-e5216134f788,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4cd02a6-d6') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4cd02a6-d6, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e6ed1e2-faaf-4247-9e3b-08e9c29166f2) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:18 user nova-compute[75391]: INFO os_vif [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:ba:88,bridge_name='br-int',has_traffic_filtering=True,id=f4cd02a6-d62a-435e-93fd-e5216134f788,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4cd02a6-d6')
Nov 15 02:55:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KOsrcXFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:55:18 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:55:18 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:18 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c14ee1-b9bd-4f1f-8f0e-574abef45650]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:55:19 user nova-compute[75391]: No targets found.
Nov 15 02:55:19 user nova-compute[75391]: iSNS:
Nov 15 02:55:19 user nova-compute[75391]: No targets found.
Nov 15 02:55:19 user nova-compute[75391]: STATIC:
Nov 15 02:55:19 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e
Nov 15 02:55:19 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:55:19 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:55:19 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281
Nov 15 02:55:19 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:55:19 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:55:19 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b
Nov 15 02:55:19 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:55:19 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:55:19 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:55:19 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:55:19 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:55:19 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39
Nov 15 02:55:19 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:55:19 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:55:19 user nova-compute[75391]: FIRMWARE:
Nov 15 02:55:19 user nova-compute[75391]: No targets found.
Nov 15 02:55:19 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:55:19 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:55:19 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7f877b-ef76-449f-9b6e-b1ba1b239495]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[488bd95b-a23e-4c77-b2f5-2d71f9543fcd]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:55:19 user nova-compute[75391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:55:19 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:55:19 user nova-compute[75391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e (non-flash)
Nov 15 02:55:19 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:55:19 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:55:19 user nova-compute[75391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:55:19 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:55:19 user nova-compute[75391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e (non-flash)
Nov 15 02:55:19 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:55:19 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6224630430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b'): ({'sdc'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Removing single pathed devices sdc {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7be808-56ad-4147-9ea4-1c0257917bd9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.042s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f001fba3-fc27-49bd-9083-9330c912f7b6]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Flushing IO for device /dev/sdc {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[469361e2-f2c2-4555-ba27-c7e5af3c3763]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.094s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5989e9-745c-46cc-868c-14e259fd84da]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] SCSI volumes sdc have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae4c60f-11c6-4046-92f3-347ddb24c3f1]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --logout" returned: 0 in 0.281s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2377d1-7271-406a-a892-43facbda1c10]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b, portal: 172.16.0.220,3260]
Nov 15 02:55:19 user nova-compute[75391]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b, portal: 172.16.0.220,3260] successful.
Nov 15 02:55:19 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8597fd5-3b23-41c4-9140-ef6cc566ba0d]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.699s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] <== disconnect_volume: return (700ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:55:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:55:20 user nova-compute[75391]: DEBUG nova.compute.manager [None req-6453177a-87cf-4dbe-99bf-63206c2168ce tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:55:20 user nova-compute[75391]: DEBUG nova.compute.manager [req-88eaf158-6d0e-4c30-937e-c4026e0fd6f5 req-5cd335a8-ea89-4aa5-8f3d-7414ee7e6ca8 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-88eaf158-6d0e-4c30-937e-c4026e0fd6f5 req-5cd335a8-ea89-4aa5-8f3d-7414ee7e6ca8 service nova] Acquiring lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-88eaf158-6d0e-4c30-937e-c4026e0fd6f5 req-5cd335a8-ea89-4aa5-8f3d-7414ee7e6ca8 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-88eaf158-6d0e-4c30-937e-c4026e0fd6f5 req-5cd335a8-ea89-4aa5-8f3d-7414ee7e6ca8 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:20 user nova-compute[75391]: DEBUG nova.compute.manager [req-88eaf158-6d0e-4c30-937e-c4026e0fd6f5 req-5cd335a8-ea89-4aa5-8f3d-7414ee7e6ca8 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] No waiting events found dispatching network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:55:20 user nova-compute[75391]: WARNING nova.compute.manager [req-88eaf158-6d0e-4c30-937e-c4026e0fd6f5 req-5cd335a8-ea89-4aa5-8f3d-7414ee7e6ca8 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received unexpected event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc for instance with vm_state active and task_state rescuing.
Nov 15 02:55:20 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f4a4846d-68ea-4d8c-9252-4e4563dce237 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG nova.network.neutron [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Port f4cd02a6-d62a-435e-93fd-e5216134f788 binding to destination host user is already ACTIVE {{(pid=75391) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Acquiring lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG nova.objects.instance [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lazy-loading 'flavor' on Instance uuid 04dcd079-e89f-401c-a7ae-8af96beb3d6d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:22 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 is timed out.
Nov 15 02:55:22 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Successfully detached device vdb from instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 from the live domain config.
Nov 15 02:55:22 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uWbmwrCt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:55:22 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:55:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca00fdac-7ab5-439c-ab3b-1b35da0124e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:55:22 user nova-compute[75391]: No targets found.
Nov 15 02:55:22 user nova-compute[75391]: iSNS:
Nov 15 02:55:22 user nova-compute[75391]: No targets found.
Nov 15 02:55:22 user nova-compute[75391]: STATIC:
Nov 15 02:55:22 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e
Nov 15 02:55:22 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:55:22 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:55:22 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281
Nov 15 02:55:22 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:55:22 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:55:22 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:55:22 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:55:22 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:55:22 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39
Nov 15 02:55:22 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:55:22 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:55:22 user nova-compute[75391]: FIRMWARE:
Nov 15 02:55:22 user nova-compute[75391]: No targets found.
Nov 15 02:55:22 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:55:22 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:55:22 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG nova.compute.manager [req-df4d846e-8927-4bf5-9bad-228885453ed0 req-93023416-f99f-449a-9f74-e78e9542423b service nova] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Received event network-changed-285df593-2636-40a8-a8e8-1e01e84d0c0b {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG nova.compute.manager [req-df4d846e-8927-4bf5-9bad-228885453ed0 req-93023416-f99f-449a-9f74-e78e9542423b service nova] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Refreshing instance network info cache due to event network-changed-285df593-2636-40a8-a8e8-1e01e84d0c0b. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-df4d846e-8927-4bf5-9bad-228885453ed0 req-93023416-f99f-449a-9f74-e78e9542423b service nova] Acquiring lock "refresh_cache-04dcd079-e89f-401c-a7ae-8af96beb3d6d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-df4d846e-8927-4bf5-9bad-228885453ed0 req-93023416-f99f-449a-9f74-e78e9542423b service nova] Acquired lock "refresh_cache-04dcd079-e89f-401c-a7ae-8af96beb3d6d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG nova.network.neutron [req-df4d846e-8927-4bf5-9bad-228885453ed0 req-93023416-f99f-449a-9f74-e78e9542423b service nova] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Refreshing network info cache for port 285df593-2636-40a8-a8e8-1e01e84d0c0b {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdabca1-5edb-4018-a543-90af73b8375e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.053s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf191149-44dc-4757-8858-2e6857619646]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:55:22 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:55:22 user nova-compute[75391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e (non-flash)
Nov 15 02:55:22 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:55:22 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:55:22 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:55:22 user nova-compute[75391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e (non-flash)
Nov 15 02:55:22 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:55:22 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f623c0fd2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e'): ({'sdb'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Removing single pathed devices sdb {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Acquiring lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:22 user nova-compute[75391]: INFO nova.compute.manager [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Attaching volume 97e18e62-9827-49f7-8b9f-4180b53c2613 to /dev/vdb
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad66ef7d-7a96-4bc2-9b5e-499c2fb2ce5f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d541bab-8fbd-4c59-b688-05652627db1c]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Flushing IO for device /dev/sdb {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7c7db5-a3af-47c0-b93f-264b36cb0754]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG os_brick.utils [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "refresh_cache-a0382af0-0509-4473-832f-1e5e6588be2e" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquired lock "refresh_cache-a0382af0-0509-4473-832f-1e5e6588be2e" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG nova.network.neutron [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[268ef9f9-1fab-4eed-a23c-09aa6c03598c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.071s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaace28-cbc2-47ba-9f59-fb67434d41e0]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1f0a38-3ca2-414c-8bb6-1045a20b7a40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6929698-5764-46a8-82e8-db0484a4737c]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.037s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4724adc-6402-44e1-95fb-7f2f216e9e41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b399593-7255-47f7-8075-d3658445479a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8a6745-eabb-43da-afe3-57eecccc4cc5]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e, portal: 172.16.0.220,3260]
Nov 15 02:55:22 user nova-compute[75391]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e, portal: 172.16.0.220,3260] successful.
Nov 15 02:55:22 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:55:22 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c1c8d3-1355-4775-843c-27f03af1990b]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG os_brick.utils [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] <== get_connector_properties: return (196ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Updating existing volume attachment record: 7b576ef3-9781-4e2d-b92a-63baf30682c3 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1fa6781-14f2-4bdc-b8f0-200d171d8b6e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e67fd35-2955-4c51-8282-abbaf0f7eba2]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.494s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] <== disconnect_volume: return (496ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:55:22 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:55:23 user nova-compute[75391]: DEBUG nova.network.neutron [req-df4d846e-8927-4bf5-9bad-228885453ed0 req-93023416-f99f-449a-9f74-e78e9542423b service nova] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Updated VIF entry in instance network info cache for port 285df593-2636-40a8-a8e8-1e01e84d0c0b. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:55:23 user nova-compute[75391]: DEBUG nova.network.neutron [req-df4d846e-8927-4bf5-9bad-228885453ed0 req-93023416-f99f-449a-9f74-e78e9542423b service nova] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Updating instance_info_cache with network_info: [{"id": "285df593-2636-40a8-a8e8-1e01e84d0c0b", "address": "fa:16:3e:a9:37:1c", "network": {"id": "b93bc3bd-6927-4924-a435-7d5199e553ad", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-840530940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "592f722752cf4cc48a70b3227d2ff3ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap285df593-26", "ovs_interfaceid": "285df593-2636-40a8-a8e8-1e01e84d0c0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:55:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-df4d846e-8927-4bf5-9bad-228885453ed0 req-93023416-f99f-449a-9f74-e78e9542423b service nova] Releasing lock "refresh_cache-04dcd079-e89f-401c-a7ae-8af96beb3d6d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:55:23 user nova-compute[75391]: DEBUG nova.network.neutron [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Updating instance_info_cache with network_info: [{"id": "f4cd02a6-d62a-435e-93fd-e5216134f788", "address": "fa:16:3e:af:ba:88", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd02a6-d6", "ovs_interfaceid": "f4cd02a6-d62a-435e-93fd-e5216134f788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:55:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Releasing lock "refresh_cache-a0382af0-0509-4473-832f-1e5e6588be2e" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:55:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:23 user nova-compute[75391]: DEBUG os_brick.utils [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:55:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ccada3-837f-48b2-a59e-e8b679458262]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9715661d-5278-4ec3-9de6-7d2ba3d409eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e01224b-e7b1-40ad-b1c9-ae51384d65f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c7a257-b5eb-4e4b-9de7-87ed7cac624c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:55:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:55:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:55:23 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:55:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c70fed-2541-44a0-ae0f-982489538beb]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:55:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:55:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:55:23 user nova-compute[75391]: DEBUG os_brick.utils [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:55:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:23 user nova-compute[75391]: DEBUG nova.objects.instance [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lazy-loading 'flavor' on Instance uuid 28a1ec10-2748-4d0c-9b73-9636fc1cc237 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:55:24 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4e8f04ca-b735-4171-84dc-50af697d7a1b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.071s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:24 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:24 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:24 user nova-compute[75391]: INFO nova.compute.manager [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Unshelving
Nov 15 02:55:25 user nova-compute[75391]: INFO nova.virt.block_device [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Booting with volume 9be06d7a-a1d3-4f22-aa37-0e469ee3008a at /dev/vdc
Nov 15 02:55:25 user nova-compute[75391]: DEBUG os_brick.utils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:55:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:25 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d5eb6f-62c9-4d4a-a492-65e63080007f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:25 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f4ca8d-558e-44ee-8ef6-679e332646bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:25 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[abda0730-9b0c-49b8-a968-75e0ad97b93a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:25 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31d9dc0-38fa-484c-96cb-fa5b7359852b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:55:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:55:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:55:25 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:55:25 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d273deb-719a-46c1-9b3e-16f92c9cd9a3]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:55:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:55:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:55:25 user nova-compute[75391]: DEBUG os_brick.utils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:55:25 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Updating existing volume attachment record: b4144298-c1ed-45b9-abca-8e3a1d776068 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FIsuVazk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:55:28 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:55:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:55:28 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:55:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:55:28 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[38142881-78fb-43a9-bde6-d826aab9de6f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:55:28 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de0ef92-6caa-4db1-b029-5cc57b8b5f82]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613] added
Nov 15 02:55:28 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fda1876-168c-4c91-be4a-b64af26cb518]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10f0633-a4b3-498d-b4e6-bf9d08ad0f9c]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FIsuVazk {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FIsuVazk" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d92a80-32bc-44c5-a43c-1a6f7c1e599f]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FIsuVazk'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[114cccf2-729c-42d2-be64-fa8f4ce0884d]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bf7d64-697a-4c3e-a718-1885b68f1908]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:55:28 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:55:28 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:55:28 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:55:28 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:55:28 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:55:28 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ffe875-4358-4a20-87ad-41aa23a1d73e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613, portal: 172.16.0.220,3260]
Nov 15 02:55:28 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613, portal: 172.16.0.220,3260] successful.
Nov 15 02:55:28 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4fbf8b-61b8-4463-bdc7-f5dd794bda5c]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9753f835-2b31-4cc9-87f6-90fed041d07c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:55:28 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:55:28 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:55:28 user nova-compute[75391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)
Nov 15 02:55:28 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:55:28 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:55:28 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:55:28 user nova-compute[75391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)
Nov 15 02:55:28 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[213f2be8-95e9-454c-93ea-ae2d7175a730]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:55:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FIsuVazk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Starting finish_migration {{(pid=75391) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Instance directory exists: not creating {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 02:55:29 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Creating image(s)
Nov 15 02:55:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Did not create local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Ensure instance console log exists: /opt/stack/data/nova/instances/a0382af0-0509-4473-832f-1e5e6588be2e/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Start _get_guest_xml network_info=[{"id": "f4cd02a6-d62a-435e-93fd-e5216134f788", "address": "fa:16:3e:af:ba:88", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1680507754-network", "vif_mac": "fa:16:3e:af:ba:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd02a6-d6", "ovs_interfaceid": "f4cd02a6-d62a-435e-93fd-e5216134f788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '28c59d3c-a9e7-4223-a096-742b44fb674a', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KOsrcXFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a0382af0-0509-4473-832f-1e5e6588be2e', 'attached_at': '2023-11-15T02:55:29.000000', 'detached_at': '', 'volume_id': '77e17fe9-4e90-4cf8-a98a-1a887987165b', 'serial': '77e17fe9-4e90-4cf8-a98a-1a887987165b'}, 'volume_type': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:55:29 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:55:29 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:55:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KOsrcXFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:55:29 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:55:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23162626665346337', 'path': '/dev/sdb'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162626665346337', 'path': '/dev/sdb'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.245s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:55:29 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:55:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:55:29 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:55:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:29 user nova-compute[75391]: DEBUG nova.objects.instance [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lazy-loading 'flavor' on Instance uuid 04dcd079-e89f-401c-a7ae-8af96beb3d6d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[10607c77-3091-4633-84ae-c5c46c39918f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:55:30 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 02:55:30 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:55:30 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 02:55:30 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:55:30 user nova-compute[75391]:   <serial>97e18e62-9827-49f7-8b9f-4180b53c2613</serial>
Nov 15 02:55:30 user nova-compute[75391]: </disk>
Nov 15 02:55:30 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6491418-c2b1-444c-a1ae-c6373b03b8d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b] added
Nov 15 02:55:30 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bef76b2-5590-4c0f-ba5e-27df1603951c]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[687019bc-3f6a-418f-b7eb-078936e3663a]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KOsrcXFp {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KOsrcXFp" returned: 0 in 0.045s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ed7d19-260a-43a1-ab43-1d2a618df2dd]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KOsrcXFp'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.060s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2288ec50-561c-4587-925e-8a4cd6c76154]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8328909f-1d15-4cec-8f23-5c485487ee94]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:55:30 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:55:30 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:55:30 user nova-compute[75391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)
Nov 15 02:55:30 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:55:30 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:55:30 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:55:30 user nova-compute[75391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)
Nov 15 02:55:30 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52f0333-9059-4031-9f78-10db7a809e8c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b, portal: 172.16.0.220,3260]
Nov 15 02:55:30 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b, portal: 172.16.0.220,3260] successful.
Nov 15 02:55:30 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f19442-6278-46c2-a933-031bd26b9a82]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b6a2e7-1b89-448c-91a4-0692b7f9e484]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:55:30 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:55:30 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:55:30 user nova-compute[75391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)
Nov 15 02:55:30 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:55:30 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:55:30 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:55:30 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:55:30 user nova-compute[75391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)
Nov 15 02:55:30 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:55:30 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.437s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cbad21-e06d-4b0a-b9c6-9a98e9bf0178]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: None {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] No VIF found with MAC fa:16:3e:a9:37:1c, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:55:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-50a9bc60-18ef-4197-b71a-42f2e886538b tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.114s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KOsrcXFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.474s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] <== connect_volume: return (1718ms) {'type': 'block', 'scsi_wwn': '26634306530326461', 'path': '/dev/sdc'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634306530326461', 'path': '/dev/sdc'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:53:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-15524939',display_name='tempest-ServerActionsTestOtherA-server-15524939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-15524939',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItI9ByRPHa+npkHzUM7/DmFQcMmvmf/UTbrL8IIRz+RgnE4/GT/cT4MtYBSEthl3H1QqF7/CYKc5G1nHfxc2lqIIfQchUdl2quGrdDYzv011COZxukmBFCsP+0gJadT/A==',key_name='tempest-keypair-1167614249',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:53:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='81798f0465704c4d9c09d8c3d3175ac5',ramdisk_id='',reservation_id='r-cpqh006p',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1177660790',owner_user_name='tempest-ServerActionsTestOtherA-1177660790-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:55:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ea5480ad1e49afa394e636c37e3b70',uuid=a0382af0-0509-4473-832f-1e5e6588be2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4cd02a6-d62a-435e-93fd-e5216134f788", "address": "fa:16:3e:af:ba:88", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1680507754-network", "vif_mac": "fa:16:3e:af:ba:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd02a6-d6", "ovs_interfaceid": "f4cd02a6-d62a-435e-93fd-e5216134f788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converting VIF {"id": "f4cd02a6-d62a-435e-93fd-e5216134f788", "address": "fa:16:3e:af:ba:88", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1680507754-network", "vif_mac": "fa:16:3e:af:ba:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd02a6-d6", "ovs_interfaceid": "f4cd02a6-d62a-435e-93fd-e5216134f788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:ba:88,bridge_name='br-int',has_traffic_filtering=True,id=f4cd02a6-d62a-435e-93fd-e5216134f788,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4cd02a6-d6') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:55:31 user nova-compute[75391]:   <uuid>a0382af0-0509-4473-832f-1e5e6588be2e</uuid>
Nov 15 02:55:31 user nova-compute[75391]:   <name>instance-00000020</name>
Nov 15 02:55:31 user nova-compute[75391]:   <memory>2097152</memory>
Nov 15 02:55:31 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:55:31 user nova-compute[75391]:   <metadata>
Nov 15 02:55:31 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:55:31 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:55:31 user nova-compute[75391]:       <nova:name>tempest-ServerActionsTestOtherA-server-15524939</nova:name>
Nov 15 02:55:31 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:55:29</nova:creationTime>
Nov 15 02:55:31 user nova-compute[75391]:       <nova:flavor name="m1.small">
Nov 15 02:55:31 user nova-compute[75391]:         <nova:memory>2048</nova:memory>
Nov 15 02:55:31 user nova-compute[75391]:         <nova:disk>20</nova:disk>
Nov 15 02:55:31 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:55:31 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:55:31 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:55:31 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:55:31 user nova-compute[75391]:       <nova:owner>
Nov 15 02:55:31 user nova-compute[75391]:         <nova:user uuid="f6ea5480ad1e49afa394e636c37e3b70">tempest-ServerActionsTestOtherA-1177660790-project-member</nova:user>
Nov 15 02:55:31 user nova-compute[75391]:         <nova:project uuid="81798f0465704c4d9c09d8c3d3175ac5">tempest-ServerActionsTestOtherA-1177660790</nova:project>
Nov 15 02:55:31 user nova-compute[75391]:       </nova:owner>
Nov 15 02:55:31 user nova-compute[75391]:       <nova:ports>
Nov 15 02:55:31 user nova-compute[75391]:         <nova:port uuid="f4cd02a6-d62a-435e-93fd-e5216134f788">
Nov 15 02:55:31 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 02:55:31 user nova-compute[75391]:         </nova:port>
Nov 15 02:55:31 user nova-compute[75391]:       </nova:ports>
Nov 15 02:55:31 user nova-compute[75391]:     </nova:instance>
Nov 15 02:55:31 user nova-compute[75391]:   </metadata>
Nov 15 02:55:31 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:55:31 user nova-compute[75391]:     <system>
Nov 15 02:55:31 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:55:31 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:55:31 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:55:31 user nova-compute[75391]:       <entry name="serial">a0382af0-0509-4473-832f-1e5e6588be2e</entry>
Nov 15 02:55:31 user nova-compute[75391]:       <entry name="uuid">a0382af0-0509-4473-832f-1e5e6588be2e</entry>
Nov 15 02:55:31 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:55:31 user nova-compute[75391]:     </system>
Nov 15 02:55:31 user nova-compute[75391]:   </sysinfo>
Nov 15 02:55:31 user nova-compute[75391]:   <os>
Nov 15 02:55:31 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:55:31 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:55:31 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:55:31 user nova-compute[75391]:   </os>
Nov 15 02:55:31 user nova-compute[75391]:   <features>
Nov 15 02:55:31 user nova-compute[75391]:     <acpi/>
Nov 15 02:55:31 user nova-compute[75391]:     <apic/>
Nov 15 02:55:31 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:55:31 user nova-compute[75391]:   </features>
Nov 15 02:55:31 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:55:31 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:55:31 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:55:31 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:55:31 user nova-compute[75391]:   </clock>
Nov 15 02:55:31 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:55:31 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:55:31 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:55:31 user nova-compute[75391]:   </cpu>
Nov 15 02:55:31 user nova-compute[75391]:   <devices>
Nov 15 02:55:31 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 02:55:31 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:55:31 user nova-compute[75391]:       <source dev="/dev/sdc"/>
Nov 15 02:55:31 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:55:31 user nova-compute[75391]:       <serial>77e17fe9-4e90-4cf8-a98a-1a887987165b</serial>
Nov 15 02:55:31 user nova-compute[75391]:     </disk>
Nov 15 02:55:31 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:55:31 user nova-compute[75391]:       <mac address="fa:16:3e:af:ba:88"/>
Nov 15 02:55:31 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:55:31 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:55:31 user nova-compute[75391]:       <target dev="tapf4cd02a6-d6"/>
Nov 15 02:55:31 user nova-compute[75391]:     </interface>
Nov 15 02:55:31 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:55:31 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/a0382af0-0509-4473-832f-1e5e6588be2e/console.log" append="off"/>
Nov 15 02:55:31 user nova-compute[75391]:     </serial>
Nov 15 02:55:31 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:55:31 user nova-compute[75391]:     <video>
Nov 15 02:55:31 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:55:31 user nova-compute[75391]:     </video>
Nov 15 02:55:31 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:55:31 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:55:31 user nova-compute[75391]:     </rng>
Nov 15 02:55:31 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:55:31 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:55:31 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:55:31 user nova-compute[75391]:     </memballoon>
Nov 15 02:55:31 user nova-compute[75391]:   </devices>
Nov 15 02:55:31 user nova-compute[75391]: </domain>
Nov 15 02:55:31 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:53:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-15524939',display_name='tempest-ServerActionsTestOtherA-server-15524939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-15524939',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItI9ByRPHa+npkHzUM7/DmFQcMmvmf/UTbrL8IIRz+RgnE4/GT/cT4MtYBSEthl3H1QqF7/CYKc5G1nHfxc2lqIIfQchUdl2quGrdDYzv011COZxukmBFCsP+0gJadT/A==',key_name='tempest-keypair-1167614249',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:53:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='81798f0465704c4d9c09d8c3d3175ac5',ramdisk_id='',reservation_id='r-cpqh006p',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1177660790',owner_user_name='tempest-ServerActionsTestOtherA-1177660790-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:55:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ea5480ad1e49afa394e636c37e3b70',uuid=a0382af0-0509-4473-832f-1e5e6588be2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4cd02a6-d62a-435e-93fd-e5216134f788", "address": "fa:16:3e:af:ba:88", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1680507754-network", "vif_mac": "fa:16:3e:af:ba:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd02a6-d6", "ovs_interfaceid": "f4cd02a6-d62a-435e-93fd-e5216134f788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converting VIF {"id": "f4cd02a6-d62a-435e-93fd-e5216134f788", "address": "fa:16:3e:af:ba:88", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1680507754-network", "vif_mac": "fa:16:3e:af:ba:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd02a6-d6", "ovs_interfaceid": "f4cd02a6-d62a-435e-93fd-e5216134f788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:ba:88,bridge_name='br-int',has_traffic_filtering=True,id=f4cd02a6-d62a-435e-93fd-e5216134f788,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4cd02a6-d6') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG os_vif [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:ba:88,bridge_name='br-int',has_traffic_filtering=True,id=f4cd02a6-d62a-435e-93fd-e5216134f788,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4cd02a6-d6') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6dcc8bed-837f-5a1e-a9a7-955f3fc43c85', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4cd02a6-d6, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4cd02a6-d6, col_values=(('qos', UUID('62d3558c-21d4-474c-be21-3c9d718d501a')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4cd02a6-d6, col_values=(('external_ids', {'iface-id': 'f4cd02a6-d62a-435e-93fd-e5216134f788', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:ba:88', 'vm-uuid': 'a0382af0-0509-4473-832f-1e5e6588be2e'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:31 user nova-compute[75391]: INFO os_vif [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:ba:88,bridge_name='br-int',has_traffic_filtering=True,id=f4cd02a6-d62a-435e-93fd-e5216134f788,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4cd02a6-d6')
Nov 15 02:55:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] No VIF found with MAC fa:16:3e:af:ba:88, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG nova.objects.instance [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lazy-loading 'pci_requests' on Instance uuid 341dfd0a-e264-4a6f-9537-35ba9ed980c4 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG nova.objects.instance [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lazy-loading 'numa_topology' on Instance uuid 341dfd0a-e264-4a6f-9537-35ba9ed980c4 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:55:31 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:55:31 user nova-compute[75391]: INFO nova.compute.claims [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Claim successful on node user
Nov 15 02:55:32 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:55:32 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:55:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.650s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:32 user nova-compute[75391]: INFO nova.network.neutron [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Updating port f81de438-c24a-4cc9-93ab-508fea76d915 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 02:55:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "refresh_cache-341dfd0a-e264-4a6f-9537-35ba9ed980c4" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:55:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquired lock "refresh_cache-341dfd0a-e264-4a6f-9537-35ba9ed980c4" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:55:33 user nova-compute[75391]: DEBUG nova.network.neutron [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:55:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-ad087c16-dd72-4400-aee0-50d289a28276 req-0f1e2313-4da2-46f4-9fc1-9ebe2e416549 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Received event network-changed-f81de438-c24a-4cc9-93ab-508fea76d915 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-ad087c16-dd72-4400-aee0-50d289a28276 req-0f1e2313-4da2-46f4-9fc1-9ebe2e416549 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Refreshing instance network info cache due to event network-changed-f81de438-c24a-4cc9-93ab-508fea76d915. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:55:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ad087c16-dd72-4400-aee0-50d289a28276 req-0f1e2313-4da2-46f4-9fc1-9ebe2e416549 service nova] Acquiring lock "refresh_cache-341dfd0a-e264-4a6f-9537-35ba9ed980c4" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:55:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Acquiring lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:33 user nova-compute[75391]: DEBUG nova.objects.instance [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lazy-loading 'flavor' on Instance uuid 04dcd079-e89f-401c-a7ae-8af96beb3d6d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:55:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:34 user nova-compute[75391]: DEBUG nova.network.neutron [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Updating instance_info_cache with network_info: [{"id": "f81de438-c24a-4cc9-93ab-508fea76d915", "address": "fa:16:3e:47:1f:19", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81de438-c2", "ovs_interfaceid": "f81de438-c24a-4cc9-93ab-508fea76d915", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:55:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Releasing lock "refresh_cache-341dfd0a-e264-4a6f-9537-35ba9ed980c4" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:55:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:55:34 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Creating image(s)
Nov 15 02:55:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "/opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "/opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "/opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:34 user nova-compute[75391]: DEBUG nova.objects.instance [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lazy-loading 'trusted_certs' on Instance uuid 341dfd0a-e264-4a6f-9537-35ba9ed980c4 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:55:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ad087c16-dd72-4400-aee0-50d289a28276 req-0f1e2313-4da2-46f4-9fc1-9ebe2e416549 service nova] Acquired lock "refresh_cache-341dfd0a-e264-4a6f-9537-35ba9ed980c4" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:55:34 user nova-compute[75391]: DEBUG nova.network.neutron [req-ad087c16-dd72-4400-aee0-50d289a28276 req-0f1e2313-4da2-46f4-9fc1-9ebe2e416549 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Refreshing network info cache for port f81de438-c24a-4cc9-93ab-508fea76d915 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:55:34 user nova-compute[75391]: DEBUG nova.objects.base [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Object Instance<341dfd0a-e264-4a6f-9537-35ba9ed980c4> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:55:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "2d7f86196cc3cb103a88c70361a80dec296d71e3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "2d7f86196cc3cb103a88c70361a80dec296d71e3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Acquiring lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:34 user nova-compute[75391]: INFO nova.compute.manager [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Attaching volume 936f932a-9fc0-43a4-8892-eefc6ab4971f to /dev/vdc
Nov 15 02:55:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d7f86196cc3cb103a88c70361a80dec296d71e3.part --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG os_brick.utils [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77f3f30-f40c-4593-a899-41797505f645]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a08edd-789e-48fb-ba0f-06fc9ba5be41]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6dc44f-2c2c-4a9c-9844-e505ce06be32]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cd75d9-efa8-4021-83a8-5e8b302fceab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-989445a3-4cb0-43d1-bdec-bc3a98183e91 req-28fe88b1-c1c2-4de7-bc75-9fdfc542f0b9 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Received event network-vif-plugged-f4cd02a6-d62a-435e-93fd-e5216134f788 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-989445a3-4cb0-43d1-bdec-bc3a98183e91 req-28fe88b1-c1c2-4de7-bc75-9fdfc542f0b9 service nova] Acquiring lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-989445a3-4cb0-43d1-bdec-bc3a98183e91 req-28fe88b1-c1c2-4de7-bc75-9fdfc542f0b9 service nova] Lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-989445a3-4cb0-43d1-bdec-bc3a98183e91 req-28fe88b1-c1c2-4de7-bc75-9fdfc542f0b9 service nova] Lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-989445a3-4cb0-43d1-bdec-bc3a98183e91 req-28fe88b1-c1c2-4de7-bc75-9fdfc542f0b9 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] No waiting events found dispatching network-vif-plugged-f4cd02a6-d62a-435e-93fd-e5216134f788 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:55:35 user nova-compute[75391]: WARNING nova.compute.manager [req-989445a3-4cb0-43d1-bdec-bc3a98183e91 req-28fe88b1-c1c2-4de7-bc75-9fdfc542f0b9 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Received unexpected event network-vif-plugged-f4cd02a6-d62a-435e-93fd-e5216134f788 for instance with vm_state active and task_state resize_finish.
Nov 15 02:55:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-989445a3-4cb0-43d1-bdec-bc3a98183e91 req-28fe88b1-c1c2-4de7-bc75-9fdfc542f0b9 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Received event network-vif-plugged-f4cd02a6-d62a-435e-93fd-e5216134f788 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-989445a3-4cb0-43d1-bdec-bc3a98183e91 req-28fe88b1-c1c2-4de7-bc75-9fdfc542f0b9 service nova] Acquiring lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-989445a3-4cb0-43d1-bdec-bc3a98183e91 req-28fe88b1-c1c2-4de7-bc75-9fdfc542f0b9 service nova] Lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-989445a3-4cb0-43d1-bdec-bc3a98183e91 req-28fe88b1-c1c2-4de7-bc75-9fdfc542f0b9 service nova] Lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-989445a3-4cb0-43d1-bdec-bc3a98183e91 req-28fe88b1-c1c2-4de7-bc75-9fdfc542f0b9 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] No waiting events found dispatching network-vif-plugged-f4cd02a6-d62a-435e-93fd-e5216134f788 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:55:35 user nova-compute[75391]: WARNING nova.compute.manager [req-989445a3-4cb0-43d1-bdec-bc3a98183e91 req-28fe88b1-c1c2-4de7-bc75-9fdfc542f0b9 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Received unexpected event network-vif-plugged-f4cd02a6-d62a-435e-93fd-e5216134f788 for instance with vm_state active and task_state resize_finish.
Nov 15 02:55:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:55:35 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:55:35 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e76fd2-627b-490a-91a0-bd22b22e11e9]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG nova.compute.manager [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG os_brick.utils [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Updating existing volume attachment record: f8f2578c-2db0-4a24-8e38-97902133a42a {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d7f86196cc3cb103a88c70361a80dec296d71e3.part --force-share --output=json" returned: 0 in 0.256s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG nova.virt.images [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] fd572c92-9fde-4b28-b495-3b0e446a9d3a was qcow2, converting to raw {{(pid=75391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG nova.privsep.utils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2d7f86196cc3cb103a88c70361a80dec296d71e3.part /opt/stack/data/nova/instances/_base/2d7f86196cc3cb103a88c70361a80dec296d71e3.converted {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:35 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Instance running successfully.
Nov 15 02:55:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Failed to set time: agent not configured {{(pid=75391) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6f1ed344-3edb-43c4-afe4-757fd400237b tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] finish_migration finished successfully. {{(pid=75391) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG nova.network.neutron [req-ad087c16-dd72-4400-aee0-50d289a28276 req-0f1e2313-4da2-46f4-9fc1-9ebe2e416549 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Updated VIF entry in instance network info cache for port f81de438-c24a-4cc9-93ab-508fea76d915. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG nova.network.neutron [req-ad087c16-dd72-4400-aee0-50d289a28276 req-0f1e2313-4da2-46f4-9fc1-9ebe2e416549 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Updating instance_info_cache with network_info: [{"id": "f81de438-c24a-4cc9-93ab-508fea76d915", "address": "fa:16:3e:47:1f:19", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81de438-c2", "ovs_interfaceid": "f81de438-c24a-4cc9-93ab-508fea76d915", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ad087c16-dd72-4400-aee0-50d289a28276 req-0f1e2313-4da2-46f4-9fc1-9ebe2e416549 service nova] Releasing lock "refresh_cache-341dfd0a-e264-4a6f-9537-35ba9ed980c4" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2d7f86196cc3cb103a88c70361a80dec296d71e3.part /opt/stack/data/nova/instances/_base/2d7f86196cc3cb103a88c70361a80dec296d71e3.converted" returned: 0 in 0.412s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d7f86196cc3cb103a88c70361a80dec296d71e3.converted --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d7f86196cc3cb103a88c70361a80dec296d71e3.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "2d7f86196cc3cb103a88c70361a80dec296d71e3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.865s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d7f86196cc3cb103a88c70361a80dec296d71e3 --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d7f86196cc3cb103a88c70361a80dec296d71e3 --force-share --output=json" returned: 0 in 0.387s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "2d7f86196cc3cb103a88c70361a80dec296d71e3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "2d7f86196cc3cb103a88c70361a80dec296d71e3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d7f86196cc3cb103a88c70361a80dec296d71e3 --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-70b066a0-be96-4f96-89bb-b5392d2581a5 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-70b066a0-be96-4f96-89bb-b5392d2581a5 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-70b066a0-be96-4f96-89bb-b5392d2581a5 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-70b066a0-be96-4f96-89bb-b5392d2581a5 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-70b066a0-be96-4f96-89bb-b5392d2581a5 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:36 user nova-compute[75391]: INFO nova.compute.manager [None req-70b066a0-be96-4f96-89bb-b5392d2581a5 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Terminating instance
Nov 15 02:55:36 user nova-compute[75391]: DEBUG nova.compute.manager [None req-70b066a0-be96-4f96-89bb-b5392d2581a5 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:55:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d7f86196cc3cb103a88c70361a80dec296d71e3 --force-share --output=json" returned: 0 in 0.237s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2d7f86196cc3cb103a88c70361a80dec296d71e3,backing_fmt=raw /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2d7f86196cc3cb103a88c70361a80dec296d71e3,backing_fmt=raw /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk 1073741824" returned: 0 in 0.092s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "2d7f86196cc3cb103a88c70361a80dec296d71e3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.335s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d7f86196cc3cb103a88c70361a80dec296d71e3 --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:36 user nova-compute[75391]: DEBUG nova.compute.manager [req-3110c45c-0527-4158-b75d-2f11ee744684 req-5e31901d-551a-4154-8152-a5e723d62f85 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received event network-vif-unplugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3110c45c-0527-4158-b75d-2f11ee744684 req-5e31901d-551a-4154-8152-a5e723d62f85 service nova] Acquiring lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3110c45c-0527-4158-b75d-2f11ee744684 req-5e31901d-551a-4154-8152-a5e723d62f85 service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3110c45c-0527-4158-b75d-2f11ee744684 req-5e31901d-551a-4154-8152-a5e723d62f85 service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:36 user nova-compute[75391]: DEBUG nova.compute.manager [req-3110c45c-0527-4158-b75d-2f11ee744684 req-5e31901d-551a-4154-8152-a5e723d62f85 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] No waiting events found dispatching network-vif-unplugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:55:36 user nova-compute[75391]: DEBUG nova.compute.manager [req-3110c45c-0527-4158-b75d-2f11ee744684 req-5e31901d-551a-4154-8152-a5e723d62f85 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received event network-vif-unplugged-f3eff2a5-1256-4a92-969a-62aca65b7452 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:55:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d7f86196cc3cb103a88c70361a80dec296d71e3 --force-share --output=json" returned: 0 in 0.254s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:37 user nova-compute[75391]: DEBUG nova.objects.instance [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lazy-loading 'migration_context' on Instance uuid 341dfd0a-e264-4a6f-9537-35ba9ed980c4 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:55:37 user nova-compute[75391]: DEBUG nova.objects.base [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Object Instance<341dfd0a-e264-4a6f-9537-35ba9ed980c4> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:55:37 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Rebasing disk image.
Nov 15 02:55:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.212s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a -F raw /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:37 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Instance destroyed successfully.
Nov 15 02:55:37 user nova-compute[75391]: DEBUG nova.objects.instance [None req-70b066a0-be96-4f96-89bb-b5392d2581a5 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'resources' on Instance uuid da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:55:37 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-70b066a0-be96-4f96-89bb-b5392d2581a5 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:45:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2059106196',display_name='tempest-AttachVolumeTestJSON-server-2059106196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2059106196',id=16,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCD3L1SyX/DHVmOgefUSKxNSWOZ+sTPqXiHUSBukECcD3u5gRzMMwQl2EIJXu8cBcituCl5oxuFwWyqmLGHfNTrWeVvrAhqAma6otXiHGESdUtG7YKOLDquTjdHFcZgT9g==',key_name='tempest-keypair-354891702',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:45:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ae33412d3944fbcb20520ae0b5d5d17',ramdisk_id='',reservation_id='r-rjbq8t39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-452422979',owner_user_name='tempest-AttachVolumeTestJSON-452422979-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:53:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa67273822f247b2ae2d34ec9cd8c8b4',uuid=da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3eff2a5-1256-4a92-969a-62aca65b7452", "address": "fa:16:3e:1d:2d:fe", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eff2a5-12", "ovs_interfaceid": "f3eff2a5-1256-4a92-969a-62aca65b7452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:55:37 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-70b066a0-be96-4f96-89bb-b5392d2581a5 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Converting VIF {"id": "f3eff2a5-1256-4a92-969a-62aca65b7452", "address": "fa:16:3e:1d:2d:fe", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eff2a5-12", "ovs_interfaceid": "f3eff2a5-1256-4a92-969a-62aca65b7452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:55:37 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-70b066a0-be96-4f96-89bb-b5392d2581a5 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:2d:fe,bridge_name='br-int',has_traffic_filtering=True,id=f3eff2a5-1256-4a92-969a-62aca65b7452,network=Network(4866e9c3-d16f-4496-b56a-1f100ea5622a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3eff2a5-12') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:55:37 user nova-compute[75391]: DEBUG os_vif [None req-70b066a0-be96-4f96-89bb-b5392d2581a5 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:2d:fe,bridge_name='br-int',has_traffic_filtering=True,id=f3eff2a5-1256-4a92-969a-62aca65b7452,network=Network(4866e9c3-d16f-4496-b56a-1f100ea5622a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3eff2a5-12') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:55:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3eff2a5-12, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:55:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7e3fecf-025c-4503-9164-b6f61f21738e) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:55:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:37 user nova-compute[75391]: INFO os_vif [None req-70b066a0-be96-4f96-89bb-b5392d2581a5 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:2d:fe,bridge_name='br-int',has_traffic_filtering=True,id=f3eff2a5-1256-4a92-969a-62aca65b7452,network=Network(4866e9c3-d16f-4496-b56a-1f100ea5622a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3eff2a5-12')
Nov 15 02:55:37 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-70b066a0-be96-4f96-89bb-b5392d2581a5 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Deleting instance files /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f_del
Nov 15 02:55:37 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-70b066a0-be96-4f96-89bb-b5392d2581a5 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Deletion of /opt/stack/data/nova/instances/da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f_del complete
Nov 15 02:55:37 user nova-compute[75391]: INFO nova.compute.manager [None req-70b066a0-be96-4f96-89bb-b5392d2581a5 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 15 02:55:37 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-70b066a0-be96-4f96-89bb-b5392d2581a5 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:55:37 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:55:37 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:55:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:38 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:55:38 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Took 0.95 seconds to deallocate network for instance.
Nov 15 02:55:38 user nova-compute[75391]: DEBUG nova.compute.manager [req-1d6ef560-55a3-4558-873f-d6796709b57d req-8b749327-bf7f-4d0d-bae3-af2ee34b9fa8 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received event network-vif-deleted-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-70b066a0-be96-4f96-89bb-b5392d2581a5 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-70b066a0-be96-4f96-89bb-b5392d2581a5 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:38 user nova-compute[75391]: DEBUG nova.compute.manager [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received event network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] Acquiring lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:38 user nova-compute[75391]: DEBUG nova.compute.manager [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] No waiting events found dispatching network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:55:39 user nova-compute[75391]: WARNING nova.compute.manager [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received unexpected event network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 for instance with vm_state deleted and task_state None.
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.compute.manager [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received event network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] Acquiring lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.compute.manager [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] No waiting events found dispatching network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:55:39 user nova-compute[75391]: WARNING nova.compute.manager [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received unexpected event network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 for instance with vm_state deleted and task_state None.
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.compute.manager [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received event network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] Acquiring lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.compute.manager [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] No waiting events found dispatching network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:55:39 user nova-compute[75391]: WARNING nova.compute.manager [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received unexpected event network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 for instance with vm_state deleted and task_state None.
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.compute.manager [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received event network-vif-unplugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] Acquiring lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.compute.manager [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] No waiting events found dispatching network-vif-unplugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:55:39 user nova-compute[75391]: WARNING nova.compute.manager [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received unexpected event network-vif-unplugged-f3eff2a5-1256-4a92-969a-62aca65b7452 for instance with vm_state deleted and task_state None.
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.compute.manager [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received event network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] Acquiring lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.compute.manager [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] No waiting events found dispatching network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:55:39 user nova-compute[75391]: WARNING nova.compute.manager [req-a6d9b12b-3d92-47aa-91df-086aa96d0645 req-56388220-0af5-463c-bf39-e728d1216267 service nova] [instance: da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f] Received unexpected event network-vif-plugged-f3eff2a5-1256-4a92-969a-62aca65b7452 for instance with vm_state deleted and task_state None.
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-70b066a0-be96-4f96-89bb-b5392d2581a5 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-70b066a0-be96-4f96-89bb-b5392d2581a5 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-70b066a0-be96-4f96-89bb-b5392d2581a5 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.525s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:39 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-70b066a0-be96-4f96-89bb-b5392d2581a5 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Deleted allocations for instance da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f
Nov 15 02:55:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-70b066a0-be96-4f96-89bb-b5392d2581a5 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "da1d36ba-3cec-4d68-abe3-8fc8eadc1b3f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.049s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a -F raw /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk" returned: 0 in 2.545s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Ensure instance console log exists: /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Start _get_guest_xml network_info=[{"id": "f81de438-c24a-4cc9-93ab-508fea76d915", "address": "fa:16:3e:47:1f:19", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81de438-c2", "ovs_interfaceid": "f81de438-c24a-4cc9-93ab-508fea76d915", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c777fcab399d88c3184d673126f58935',container_format='bare',created_at=2023-11-15T02:53:31Z,direct_url=<?>,disk_format='qcow2',id=fd572c92-9fde-4b28-b495-3b0e446a9d3a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1537643616-shelved',owner='f1ec3021653b4209a509852c7a28bf46',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T02:53:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'b4144298-c1ed-45b9-abca-8e3a1d776068', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRoeVGBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '341dfd0a-e264-4a6f-9537-35ba9ed980c4', 'attached_at': '', 'detached_at': '', 'volume_id': '9be06d7a-a1d3-4f22-aa37-0e469ee3008a', 'serial': '9be06d7a-a1d3-4f22-aa37-0e469ee3008a'}, 'volume_type': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:55:39 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:55:39 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c777fcab399d88c3184d673126f58935',container_format='bare',created_at=2023-11-15T02:53:31Z,direct_url=<?>,disk_format='qcow2',id=fd572c92-9fde-4b28-b495-3b0e446a9d3a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1537643616-shelved',owner='f1ec3021653b4209a509852c7a28bf46',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T02:53:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.objects.instance [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lazy-loading 'vcpu_model' on Instance uuid 341dfd0a-e264-4a6f-9537-35ba9ed980c4 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.objects.base [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Object Instance<341dfd0a-e264-4a6f-9537-35ba9ed980c4> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRoeVGBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:55:39 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:55:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:55:39 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:55:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:55:39 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:55:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[458e656a-c166-4347-9521-e4ac9e3d3838]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:55:39 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b51ce3-fe06-4c2a-b35f-3c6f9db60893]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a] added
Nov 15 02:55:39 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1ea241-0e0f-4f32-a1ca-170f0746ff13]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e036ea9e-15bf-4c77-be69-c04ce099e302]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WRoeVGBE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WRoeVGBE" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ced4b4-aa1f-4429-b998-2653bcf41080]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WRoeVGBE'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad16d8f-f7d2-4c8a-8b0a-e17a08b51b70]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e52a9a3-30a9-4742-9a56-77f69587c2fd]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:55:40 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:55:40 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:55:40 user nova-compute[75391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)
Nov 15 02:55:40 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:55:40 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:55:40 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:55:40 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:55:40 user nova-compute[75391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)
Nov 15 02:55:40 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:55:40 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc4e39f-148c-4e4a-a165-91bba340a71b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a, portal: 172.16.0.220,3260]
Nov 15 02:55:40 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a, portal: 172.16.0.220,3260] successful.
Nov 15 02:55:40 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4724886-3fd4-4991-8ddf-c2edc752a707]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[53179491-fb07-4fee-9638-21b131c5f84b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:55:40 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:55:40 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:55:40 user nova-compute[75391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)
Nov 15 02:55:40 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:55:40 user nova-compute[75391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)
Nov 15 02:55:40 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:55:40 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:55:40 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:55:40 user nova-compute[75391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)
Nov 15 02:55:40 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:55:40 user nova-compute[75391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)
Nov 15 02:55:40 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] HCTL ('38', '-', '-', 0) found on session 43 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4998a5a7-4a23-4657-8f5a-e95a546188ad]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Searching for a device in session 43 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:55:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRoeVGBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJaCNVzv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:55:41 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:55:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23538623238636333', 'path': '/dev/sdg'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538623238636333', 'path': '/dev/sdg'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.181s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:55:41 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:55:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:55:41 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[43caaa30-c999-4cb6-b56a-e7d67dfcfdb5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:55:41 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T02:51:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1537643616',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1537643616',id=29,image_ref='fd572c92-9fde-4b28-b495-3b0e446a9d3a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1968484645',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:51:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f1ec3021653b4209a509852c7a28bf46',ramdisk_id='',reservation_id='r-mwaawx6j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1315675398',owner_user_name='tempest-AttachVolumeShelveTestJSON-1315675398-project-member',shelved_at='2023-11-15T02:53:36.895430',shelved_host='user',shelved_image_id='fd572c92-9fde-4b28-b495-3b0e446a9d3a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:55:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e55cae841f994756843bc97a063ebe86',uuid=341dfd0a-e264-4a6f-9537-35ba9ed980c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f81de438-c24a-4cc9-93ab-508fea76d915", "address": "fa:16:3e:47:1f:19", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81de438-c2", "ovs_interfaceid": "f81de438-c24a-4cc9-93ab-508fea76d915", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Converting VIF {"id": "f81de438-c24a-4cc9-93ab-508fea76d915", "address": "fa:16:3e:47:1f:19", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81de438-c2", "ovs_interfaceid": "f81de438-c24a-4cc9-93ab-508fea76d915", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:1f:19,bridge_name='br-int',has_traffic_filtering=True,id=f81de438-c24a-4cc9-93ab-508fea76d915,network=Network(64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf81de438-c2') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG nova.objects.instance [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lazy-loading 'pci_devices' on Instance uuid 341dfd0a-e264-4a6f-9537-35ba9ed980c4 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG nova.objects.base [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Object Instance<341dfd0a-e264-4a6f-9537-35ba9ed980c4> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:55:41 user nova-compute[75391]:   <uuid>341dfd0a-e264-4a6f-9537-35ba9ed980c4</uuid>
Nov 15 02:55:41 user nova-compute[75391]:   <name>instance-0000001d</name>
Nov 15 02:55:41 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:55:41 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:55:41 user nova-compute[75391]:   <metadata>
Nov 15 02:55:41 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:55:41 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:55:41 user nova-compute[75391]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1537643616</nova:name>
Nov 15 02:55:41 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:55:39</nova:creationTime>
Nov 15 02:55:41 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:55:41 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:55:41 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:55:41 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:55:41 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:55:41 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:55:41 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:55:41 user nova-compute[75391]:       <nova:owner>
Nov 15 02:55:41 user nova-compute[75391]:         <nova:user uuid="e55cae841f994756843bc97a063ebe86">tempest-AttachVolumeShelveTestJSON-1315675398-project-member</nova:user>
Nov 15 02:55:41 user nova-compute[75391]:         <nova:project uuid="f1ec3021653b4209a509852c7a28bf46">tempest-AttachVolumeShelveTestJSON-1315675398</nova:project>
Nov 15 02:55:41 user nova-compute[75391]:       </nova:owner>
Nov 15 02:55:41 user nova-compute[75391]:       <nova:root type="image" uuid="fd572c92-9fde-4b28-b495-3b0e446a9d3a"/>
Nov 15 02:55:41 user nova-compute[75391]:       <nova:ports>
Nov 15 02:55:41 user nova-compute[75391]:         <nova:port uuid="f81de438-c24a-4cc9-93ab-508fea76d915">
Nov 15 02:55:41 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 02:55:41 user nova-compute[75391]:         </nova:port>
Nov 15 02:55:41 user nova-compute[75391]:       </nova:ports>
Nov 15 02:55:41 user nova-compute[75391]:     </nova:instance>
Nov 15 02:55:41 user nova-compute[75391]:   </metadata>
Nov 15 02:55:41 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:55:41 user nova-compute[75391]:     <system>
Nov 15 02:55:41 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:55:41 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:55:41 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:55:41 user nova-compute[75391]:       <entry name="serial">341dfd0a-e264-4a6f-9537-35ba9ed980c4</entry>
Nov 15 02:55:41 user nova-compute[75391]:       <entry name="uuid">341dfd0a-e264-4a6f-9537-35ba9ed980c4</entry>
Nov 15 02:55:41 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:55:41 user nova-compute[75391]:     </system>
Nov 15 02:55:41 user nova-compute[75391]:   </sysinfo>
Nov 15 02:55:41 user nova-compute[75391]:   <os>
Nov 15 02:55:41 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:55:41 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:55:41 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:55:41 user nova-compute[75391]:   </os>
Nov 15 02:55:41 user nova-compute[75391]:   <features>
Nov 15 02:55:41 user nova-compute[75391]:     <acpi/>
Nov 15 02:55:41 user nova-compute[75391]:     <apic/>
Nov 15 02:55:41 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:55:41 user nova-compute[75391]:   </features>
Nov 15 02:55:41 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:55:41 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:55:41 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:55:41 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:55:41 user nova-compute[75391]:   </clock>
Nov 15 02:55:41 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:55:41 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:55:41 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:55:41 user nova-compute[75391]:   </cpu>
Nov 15 02:55:41 user nova-compute[75391]:   <devices>
Nov 15 02:55:41 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:55:41 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:55:41 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk"/>
Nov 15 02:55:41 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:55:41 user nova-compute[75391]:     </disk>
Nov 15 02:55:41 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 02:55:41 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:55:41 user nova-compute[75391]:       <source dev="/dev/sdg"/>
Nov 15 02:55:41 user nova-compute[75391]:       <target dev="vdc" bus="virtio"/>
Nov 15 02:55:41 user nova-compute[75391]:       <serial>9be06d7a-a1d3-4f22-aa37-0e469ee3008a</serial>
Nov 15 02:55:41 user nova-compute[75391]:     </disk>
Nov 15 02:55:41 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:55:41 user nova-compute[75391]:       <mac address="fa:16:3e:47:1f:19"/>
Nov 15 02:55:41 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:55:41 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:55:41 user nova-compute[75391]:       <target dev="tapf81de438-c2"/>
Nov 15 02:55:41 user nova-compute[75391]:     </interface>
Nov 15 02:55:41 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:55:41 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/console.log" append="off"/>
Nov 15 02:55:41 user nova-compute[75391]:     </serial>
Nov 15 02:55:41 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:55:41 user nova-compute[75391]:     <video>
Nov 15 02:55:41 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:55:41 user nova-compute[75391]:     </video>
Nov 15 02:55:41 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:55:41 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:55:41 user nova-compute[75391]:     </rng>
Nov 15 02:55:41 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:55:41 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:55:41 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:55:41 user nova-compute[75391]:     </memballoon>
Nov 15 02:55:41 user nova-compute[75391]:   </devices>
Nov 15 02:55:41 user nova-compute[75391]: </domain>
Nov 15 02:55:41 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T02:51:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1537643616',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1537643616',id=29,image_ref='fd572c92-9fde-4b28-b495-3b0e446a9d3a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1968484645',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:51:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f1ec3021653b4209a509852c7a28bf46',ramdisk_id='',reservation_id='r-mwaawx6j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1315675398',owner_user_name='tempest-AttachVolumeShelveTestJSON-1315675398-project-member',shelved_at='2023-11-15T02:53:36.895430',shelved_host='user',shelved_image_id='fd572c92-9fde-4b28-b495-3b0e446a9d3a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:55:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e55cae841f994756843bc97a063ebe86',uuid=341dfd0a-e264-4a6f-9537-35ba9ed980c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f81de438-c24a-4cc9-93ab-508fea76d915", "address": "fa:16:3e:47:1f:19", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81de438-c2", "ovs_interfaceid": "f81de438-c24a-4cc9-93ab-508fea76d915", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Converting VIF {"id": "f81de438-c24a-4cc9-93ab-508fea76d915", "address": "fa:16:3e:47:1f:19", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81de438-c2", "ovs_interfaceid": "f81de438-c24a-4cc9-93ab-508fea76d915", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:1f:19,bridge_name='br-int',has_traffic_filtering=True,id=f81de438-c24a-4cc9-93ab-508fea76d915,network=Network(64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf81de438-c2') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG os_vif [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:1f:19,bridge_name='br-int',has_traffic_filtering=True,id=f81de438-c24a-4cc9-93ab-508fea76d915,network=Network(64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf81de438-c2') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bd4367-006e-45f5-871c-7f9f5d39517b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f] added
Nov 15 02:55:41 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd6f2c5a0-e1b6-58de-ac1f-ff9b04265767', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf81de438-c2, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf81de438-c2, col_values=(('qos', UUID('0568f547-2c82-41e2-b408-3856ba0008e8')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf81de438-c2, col_values=(('external_ids', {'iface-id': 'f81de438-c24a-4cc9-93ab-508fea76d915', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:1f:19', 'vm-uuid': '341dfd0a-e264-4a6f-9537-35ba9ed980c4'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb0400b-aff9-417e-a6d0-66e6eb630357]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:41 user nova-compute[75391]: INFO os_vif [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:1f:19,bridge_name='br-int',has_traffic_filtering=True,id=f81de438-c24a-4cc9-93ab-508fea76d915,network=Network(64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf81de438-c2')
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c4523b-f088-41b4-8ee7-5da0f2e2a16a]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LJaCNVzv {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LJaCNVzv" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a91036-ebf6-48c2-b97d-1b0dc537e69c]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LJaCNVzv'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] No VIF found with MAC fa:16:3e:47:1f:19, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[371b6475-7f82-41e0-991f-55a39df93101]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd111026-fea9-4b59-adba-8e154d931759]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:55:41 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:55:41 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:55:41 user nova-compute[75391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)
Nov 15 02:55:41 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:55:41 user nova-compute[75391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)
Nov 15 02:55:41 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:55:41 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:55:41 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:55:41 user nova-compute[75391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)
Nov 15 02:55:41 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:55:41 user nova-compute[75391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)
Nov 15 02:55:41 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd957c02-8e22-46b8-bfd7-ca7ddb214bf8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f, portal: 172.16.0.220,3260]
Nov 15 02:55:41 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f, portal: 172.16.0.220,3260] successful.
Nov 15 02:55:41 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9164b915-e559-412e-bb53-8d464f6edb01]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3803e973-e3be-4486-b847-123f5d7c2727]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:55:41 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:55:41 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:55:41 user nova-compute[75391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)
Nov 15 02:55:41 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:55:41 user nova-compute[75391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)
Nov 15 02:55:41 user nova-compute[75391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f (non-flash)
Nov 15 02:55:41 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:55:41 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:55:41 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:55:41 user nova-compute[75391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)
Nov 15 02:55:41 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:55:41 user nova-compute[75391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)
Nov 15 02:55:41 user nova-compute[75391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f (non-flash)
Nov 15 02:55:41 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] HCTL ('39', '-', '-', 0) found on session 44 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d34a7ca-78f2-432a-b2e2-36ee75102186]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Searching for a device in session 44 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:55:41 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJaCNVzv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:55:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:55:42 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] <== connect_volume: return (1586ms) {'type': 'block', 'scsi_wwn': '23663363431373338', 'path': '/dev/sdh'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:55:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663363431373338', 'path': '/dev/sdh'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:55:42 user nova-compute[75391]: DEBUG nova.objects.instance [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lazy-loading 'flavor' on Instance uuid 04dcd079-e89f-401c-a7ae-8af96beb3d6d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:55:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 02:55:42 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:55:42 user nova-compute[75391]:   <source dev="/dev/sdh"/>
Nov 15 02:55:42 user nova-compute[75391]:   <target dev="vdc" bus="virtio"/>
Nov 15 02:55:42 user nova-compute[75391]:   <serial>936f932a-9fc0-43a4-8892-eefc6ab4971f</serial>
Nov 15 02:55:42 user nova-compute[75391]: </disk>
Nov 15 02:55:42 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:55:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:43 user nova-compute[75391]: DEBUG nova.compute.manager [req-5857ac4f-306d-494e-9ae8-c5a192b02c39 req-e2bfa633-f539-40ad-892b-64081fd3ac03 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Received event network-vif-plugged-f81de438-c24a-4cc9-93ab-508fea76d915 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5857ac4f-306d-494e-9ae8-c5a192b02c39 req-e2bfa633-f539-40ad-892b-64081fd3ac03 service nova] Acquiring lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5857ac4f-306d-494e-9ae8-c5a192b02c39 req-e2bfa633-f539-40ad-892b-64081fd3ac03 service nova] Lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5857ac4f-306d-494e-9ae8-c5a192b02c39 req-e2bfa633-f539-40ad-892b-64081fd3ac03 service nova] Lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:43 user nova-compute[75391]: DEBUG nova.compute.manager [req-5857ac4f-306d-494e-9ae8-c5a192b02c39 req-e2bfa633-f539-40ad-892b-64081fd3ac03 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] No waiting events found dispatching network-vif-plugged-f81de438-c24a-4cc9-93ab-508fea76d915 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:55:43 user nova-compute[75391]: WARNING nova.compute.manager [req-5857ac4f-306d-494e-9ae8-c5a192b02c39 req-e2bfa633-f539-40ad-892b-64081fd3ac03 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Received unexpected event network-vif-plugged-f81de438-c24a-4cc9-93ab-508fea76d915 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 02:55:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:55:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:55:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:55:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] No VIF found with MAC fa:16:3e:a9:37:1c, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:55:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6ce158cc-2fe1-4e90-9bf8-c1406e85c74a tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.313s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Acquiring lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:44 user nova-compute[75391]: INFO nova.compute.manager [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Detaching volume 936f932a-9fc0-43a4-8892-eefc6ab4971f
Nov 15 02:55:44 user nova-compute[75391]: INFO nova.virt.block_device [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Attempting to driver detach volume 936f932a-9fc0-43a4-8892-eefc6ab4971f from mountpoint /dev/vdc
Nov 15 02:55:44 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Attempting to detach device vdc from instance 04dcd079-e89f-401c-a7ae-8af96beb3d6d from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:55:44 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:55:44 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:55:44 user nova-compute[75391]:   <source dev="/dev/sdh"/>
Nov 15 02:55:44 user nova-compute[75391]:   <target dev="vdc" bus="virtio"/>
Nov 15 02:55:44 user nova-compute[75391]:   <serial>936f932a-9fc0-43a4-8892-eefc6ab4971f</serial>
Nov 15 02:55:44 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 02:55:44 user nova-compute[75391]: </disk>
Nov 15 02:55:44 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:55:44 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Successfully detached device vdc from instance 04dcd079-e89f-401c-a7ae-8af96beb3d6d from the persistent domain config.
Nov 15 02:55:44 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 04dcd079-e89f-401c-a7ae-8af96beb3d6d from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 02:55:44 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:55:44 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:55:44 user nova-compute[75391]:   <source dev="/dev/sdh"/>
Nov 15 02:55:44 user nova-compute[75391]:   <target dev="vdc" bus="virtio"/>
Nov 15 02:55:44 user nova-compute[75391]:   <serial>936f932a-9fc0-43a4-8892-eefc6ab4971f</serial>
Nov 15 02:55:44 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 02:55:44 user nova-compute[75391]: </disk>
Nov 15 02:55:44 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:55:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 04dcd079-e89f-401c-a7ae-8af96beb3d6d {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 02:55:45 user nova-compute[75391]: DEBUG nova.compute.manager [req-69084836-0f83-4afd-94b7-9395b986d72e req-a9737f26-6137-4b99-992c-bbf0c57820cc service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Received event network-vif-plugged-f81de438-c24a-4cc9-93ab-508fea76d915 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:55:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-69084836-0f83-4afd-94b7-9395b986d72e req-a9737f26-6137-4b99-992c-bbf0c57820cc service nova] Acquiring lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-69084836-0f83-4afd-94b7-9395b986d72e req-a9737f26-6137-4b99-992c-bbf0c57820cc service nova] Lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-69084836-0f83-4afd-94b7-9395b986d72e req-a9737f26-6137-4b99-992c-bbf0c57820cc service nova] Lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:45 user nova-compute[75391]: DEBUG nova.compute.manager [req-69084836-0f83-4afd-94b7-9395b986d72e req-a9737f26-6137-4b99-992c-bbf0c57820cc service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] No waiting events found dispatching network-vif-plugged-f81de438-c24a-4cc9-93ab-508fea76d915 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:55:45 user nova-compute[75391]: WARNING nova.compute.manager [req-69084836-0f83-4afd-94b7-9395b986d72e req-a9737f26-6137-4b99-992c-bbf0c57820cc service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Received unexpected event network-vif-plugged-f81de438-c24a-4cc9-93ab-508fea76d915 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 02:55:45 user nova-compute[75391]: DEBUG nova.compute.manager [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:55:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:55:45 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Instance spawned successfully.
Nov 15 02:55:46 user nova-compute[75391]: DEBUG nova.compute.manager [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:55:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1d2caff0-68bd-4b71-a0d9-7f15cd06fc06 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 21.566s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:49 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:55:50 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:55:50 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:55:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-6400a5f3-0ec9-4484-930c-1f5061ae5374" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:55:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-6400a5f3-0ec9-4484-930c-1f5061ae5374" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:55:50 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 02:55:51 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Updating instance_info_cache with network_info: [{"id": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "address": "fa:16:3e:84:8e:2f", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f803b5-4e", "ovs_interfaceid": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:55:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-6400a5f3-0ec9-4484-930c-1f5061ae5374" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:55:51 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 02:55:51 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:55:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:52 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:55:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:54 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:55:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:54 user nova-compute[75391]: DEBUG nova.objects.instance [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lazy-loading 'flavor' on Instance uuid 28a1ec10-2748-4d0c-9b73-9636fc1cc237 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:55 user nova-compute[75391]: INFO nova.compute.manager [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Attaching volume 3eef2127-0587-4d05-a59e-73b8d59a2ed6 to /dev/vdb
Nov 15 02:55:55 user nova-compute[75391]: DEBUG os_brick.utils [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[18300542-c609-4a2f-ac59-c60918c50c90]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2a6096-bb4f-4d3a-940c-c3ef0ab7b72a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c82e28-7b56-40ee-8be0-a044d6f063a1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[726bf411-6be4-41df-9da0-ec0f16d1855d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:55:55 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:55:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedf5650-a637-441d-a466-3a2232521056]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG os_brick.utils [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Updating existing volume attachment record: 6d2cbc71-cc71-4986-b5f1-39fb86253799 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:55:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:55:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:55:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:55:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:55:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:55:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:55:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:55:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:55:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c767fb74-e57f-4ea0-bf4e-4034cf656a78/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c767fb74-e57f-4ea0-bf4e-4034cf656a78/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c767fb74-e57f-4ea0-bf4e-4034cf656a78/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c767fb74-e57f-4ea0-bf4e-4034cf656a78/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nfAISgqF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:56:00 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:56:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:56:00 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:56:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:56:00 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:56:00 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:56:00 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:56:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=7293MB free_disk=24.84079360961914GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e817a645-3e70-4600-81ff-94bf7fbb129d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:56:00 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5a7195-4927-4f79-b750-585c8bb3396e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6] added
Nov 15 02:56:00 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd268e76-a181-4039-acfd-c0bd82dae730]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3d3ad8-dbb3-4630-8081-6e6e6fe9dd9e]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nfAISgqF {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nfAISgqF" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1656c449-377d-459d-bfb8-747bb85812bc]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nfAISgqF'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d98b5f-9beb-4819-bb4e-36f4339df735]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Applying migration context for instance a0382af0-0509-4473-832f-1e5e6588be2e as it has an incoming, in-progress migration deec6e20-7b5f-4f09-8e17-9fbab60c8af8. Migration status is finished {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 02:56:00 user nova-compute[75391]: INFO nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Updating resource usage from migration deec6e20-7b5f-4f09-8e17-9fbab60c8af8
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2978758d-2a52-4389-81f3-065c3989ec47]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:56:00 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:56:00 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:56:00 user nova-compute[75391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)
Nov 15 02:56:00 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:56:00 user nova-compute[75391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)
Nov 15 02:56:00 user nova-compute[75391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f (non-flash)
Nov 15 02:56:00 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:56:00 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:56:00 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:56:00 user nova-compute[75391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)
Nov 15 02:56:00 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:56:00 user nova-compute[75391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)
Nov 15 02:56:00 user nova-compute[75391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f (non-flash)
Nov 15 02:56:00 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9744c8a1-046e-4a00-92e0-92ebb3275ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance fc9484c0-9083-4797-8ab1-2ad392822ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6400a5f3-0ec9-4484-930c-1f5061ae5374 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance d36e2f64-11cb-4b35-8471-9a4df7f4c227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9909ae6b-7900-4f71-8900-2bf25185e436 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 7bd332f2-0f74-4a43-96a2-2322b6cbf982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance c767fb74-e57f-4ea0-bf4e-4034cf656a78 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 04dcd079-e89f-401c-a7ae-8af96beb3d6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 991177b1-d6a7-41a7-b9fa-f08d04fa57c6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Migration deec6e20-7b5f-4f09-8e17-9fbab60c8af8 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance a0382af0-0509-4473-832f-1e5e6588be2e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 341dfd0a-e264-4a6f-9537-35ba9ed980c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac1ecc9-91f3-4d12-82e1-99bf5bc99044]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6, portal: 172.16.0.220,3260]
Nov 15 02:56:00 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6, portal: 172.16.0.220,3260] successful.
Nov 15 02:56:00 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:56:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ca2c93-cbd4-40ae-9214-f3f42ac5e8a3]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:56:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fd19a6-854c-4e5c-b1ca-e1647dc4bf3d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:56:01 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:56:01 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:56:01 user nova-compute[75391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)
Nov 15 02:56:01 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:56:01 user nova-compute[75391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)
Nov 15 02:56:01 user nova-compute[75391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f (non-flash)
Nov 15 02:56:01 user nova-compute[75391]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 (non-flash)
Nov 15 02:56:01 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:56:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:56:01 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:56:01 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:56:01 user nova-compute[75391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)
Nov 15 02:56:01 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:56:01 user nova-compute[75391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)
Nov 15 02:56:01 user nova-compute[75391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f (non-flash)
Nov 15 02:56:01 user nova-compute[75391]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 (non-flash)
Nov 15 02:56:01 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:56:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:56:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:56:01 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] HCTL ('40', '-', '-', 0) found on session 45 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:56:01 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:56:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9cee13-b402-4556-8599-4226a1c51be4]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:01 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Searching for a device in session 45 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:56:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nfAISgqF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:56:01 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:56:01 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:56:01 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:56:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.611s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:56:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:56:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23233373563643961', 'path': '/dev/sdi'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:56:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233373563643961', 'path': '/dev/sdi'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:56:02 user nova-compute[75391]: DEBUG nova.objects.instance [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lazy-loading 'flavor' on Instance uuid 28a1ec10-2748-4d0c-9b73-9636fc1cc237 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:56:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 02:56:02 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:56:02 user nova-compute[75391]:   <source dev="/dev/sdi"/>
Nov 15 02:56:02 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:56:02 user nova-compute[75391]:   <serial>3eef2127-0587-4d05-a59e-73b8d59a2ed6</serial>
Nov 15 02:56:02 user nova-compute[75391]: </disk>
Nov 15 02:56:02 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:56:02 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:56:02 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:56:02 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:56:02 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:56:02 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:56:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:56:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:56:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] No VIF found with MAC fa:16:3e:ef:5f:d5, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:56:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5efff742-f6fc-490a-84d5-5127b4456ffb tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.556s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:56:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:05 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 04dcd079-e89f-401c-a7ae-8af96beb3d6d is timed out.
Nov 15 02:56:05 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Successfully detached device vdc from instance 04dcd079-e89f-401c-a7ae-8af96beb3d6d from the live domain config.
Nov 15 02:56:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJaCNVzv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:56:05 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:56:05 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a3854e-d96a-4225-832e-9be9fc45a180]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:56:05 user nova-compute[75391]: No targets found.
Nov 15 02:56:05 user nova-compute[75391]: iSNS:
Nov 15 02:56:05 user nova-compute[75391]: No targets found.
Nov 15 02:56:05 user nova-compute[75391]: STATIC:
Nov 15 02:56:05 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613
Nov 15 02:56:05 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:56:05 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:56:05 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281
Nov 15 02:56:05 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:56:05 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:56:05 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6
Nov 15 02:56:05 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:56:05 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:56:05 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a
Nov 15 02:56:05 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:56:05 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:56:05 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b
Nov 15 02:56:05 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:56:05 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:56:05 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:56:05 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:56:05 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:56:05 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f
Nov 15 02:56:05 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:56:05 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:56:05 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39
Nov 15 02:56:05 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:56:05 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:56:05 user nova-compute[75391]: FIRMWARE:
Nov 15 02:56:05 user nova-compute[75391]: No targets found.
Nov 15 02:56:05 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:56:05 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:56:05 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8c6ab9-2529-4549-9a25-db92fd9b2cb3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[873141a1-ec41-4f02-8146-5bf95d798a69]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:56:05 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:56:05 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:56:05 user nova-compute[75391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)
Nov 15 02:56:05 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:56:05 user nova-compute[75391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)
Nov 15 02:56:05 user nova-compute[75391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f (non-flash)
Nov 15 02:56:05 user nova-compute[75391]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 (non-flash)
Nov 15 02:56:05 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:56:05 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:56:05 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:56:05 user nova-compute[75391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)
Nov 15 02:56:05 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:56:05 user nova-compute[75391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)
Nov 15 02:56:05 user nova-compute[75391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f (non-flash)
Nov 15 02:56:05 user nova-compute[75391]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 (non-flash)
Nov 15 02:56:05 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f623c141870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f'): ({'sdh'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Removing single pathed devices sdh {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[676722b5-c88c-408e-aebe-b65e4159d2fa]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01abe9e-4927-4c4b-ac0f-2ca57c257c59]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Flushing IO for device /dev/sdh {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb29aae-5d43-480b-a783-e61f6cd53547]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.058s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1b239d-ad75-4369-adbc-e661f7efab19]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] SCSI volumes sdh have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[689c05cb-0603-4d34-af23-b5a1cc303246]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[89de5a55-3f4c-400d-8744-36484e234d5c]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f, portal: 172.16.0.220,3260]
Nov 15 02:56:05 user nova-compute[75391]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f, portal: 172.16.0.220,3260] successful.
Nov 15 02:56:05 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:936f932a-9fc0-43a4-8892-eefc6ab4971f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[555099ea-cc47-4ef2-be1e-6eabf1cae7ed]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] <== disconnect_volume: return (363ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:56:05 user nova-compute[75391]: INFO nova.compute.manager [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Detaching volume 3eef2127-0587-4d05-a59e-73b8d59a2ed6
Nov 15 02:56:05 user nova-compute[75391]: INFO nova.virt.block_device [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Attempting to driver detach volume 3eef2127-0587-4d05-a59e-73b8d59a2ed6 from mountpoint /dev/vdb
Nov 15 02:56:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Attempting to detach device vdb from instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:56:05 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:56:05 user nova-compute[75391]:   <source dev="/dev/sdi"/>
Nov 15 02:56:05 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:56:05 user nova-compute[75391]:   <serial>3eef2127-0587-4d05-a59e-73b8d59a2ed6</serial>
Nov 15 02:56:05 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:56:05 user nova-compute[75391]: </disk>
Nov 15 02:56:05 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:56:05 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Successfully detached device vdb from instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 from the persistent domain config.
Nov 15 02:56:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 02:56:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:56:05 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:56:05 user nova-compute[75391]:   <source dev="/dev/sdi"/>
Nov 15 02:56:05 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:56:05 user nova-compute[75391]:   <serial>3eef2127-0587-4d05-a59e-73b8d59a2ed6</serial>
Nov 15 02:56:05 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:56:05 user nova-compute[75391]: </disk>
Nov 15 02:56:05 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:56:06 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 02:56:06 user nova-compute[75391]: DEBUG nova.objects.instance [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lazy-loading 'flavor' on Instance uuid 04dcd079-e89f-401c-a7ae-8af96beb3d6d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:56:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2aabdf0e-f7f8-41fc-9dcd-5fb5d5a63a14 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.963s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:56:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:21 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:26 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 is timed out.
Nov 15 02:56:26 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Successfully detached device vdb from instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 from the live domain config.
Nov 15 02:56:26 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nfAISgqF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:56:26 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:56:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[73be6e44-4d5d-407c-95b0-7f5db0108ef2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:56:26 user nova-compute[75391]: No targets found.
Nov 15 02:56:26 user nova-compute[75391]: iSNS:
Nov 15 02:56:26 user nova-compute[75391]: No targets found.
Nov 15 02:56:26 user nova-compute[75391]: STATIC:
Nov 15 02:56:26 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613
Nov 15 02:56:26 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:56:26 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:56:26 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281
Nov 15 02:56:26 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:56:26 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:56:26 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6
Nov 15 02:56:26 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:56:26 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:56:26 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a
Nov 15 02:56:26 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:56:26 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:56:26 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b
Nov 15 02:56:26 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:56:26 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:56:26 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:56:26 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:56:26 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:56:26 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39
Nov 15 02:56:26 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:56:26 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:56:26 user nova-compute[75391]: FIRMWARE:
Nov 15 02:56:26 user nova-compute[75391]: No targets found.
Nov 15 02:56:26 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:56:26 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:56:26 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf122ee-3762-4e6b-8e1d-8d080c4efcca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e1f6c5-6196-4b49-82b1-684a881eef3a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:56:26 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:56:26 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:56:26 user nova-compute[75391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)
Nov 15 02:56:26 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:56:26 user nova-compute[75391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)
Nov 15 02:56:26 user nova-compute[75391]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 (non-flash)
Nov 15 02:56:26 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:56:26 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:56:26 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:56:26 user nova-compute[75391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)
Nov 15 02:56:26 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:56:26 user nova-compute[75391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)
Nov 15 02:56:26 user nova-compute[75391]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 (non-flash)
Nov 15 02:56:26 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62442cca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6'): ({'sdi'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Removing single pathed devices sdi {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aeccd43-fbc9-4ae5-8566-b614ec87fb05]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f1e1b9-be19-4978-bbbb-613946eb12cd]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Flushing IO for device /dev/sdi {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[227a87cc-f1b0-4241-a9f6-99b81176f331]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.059s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73255e7-0729-468a-965f-d5e15b4c7a91]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] SCSI volumes sdi have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c90331-25ad-422b-b7e8-86919f401093]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7628ca-c576-494f-a3bd-b9a3f5ecca81]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6, portal: 172.16.0.220,3260]
Nov 15 02:56:26 user nova-compute[75391]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6, portal: 172.16.0.220,3260] successful.
Nov 15 02:56:26 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eef2127-0587-4d05-a59e-73b8d59a2ed6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0051881-0886-446d-ad55-64176c1afb47]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] <== disconnect_volume: return (371ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:56:26 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:56:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:27 user nova-compute[75391]: DEBUG nova.objects.instance [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lazy-loading 'flavor' on Instance uuid 28a1ec10-2748-4d0c-9b73-9636fc1cc237 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:56:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-56e37eba-9942-4828-bbbf-34b4723c558c tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.664s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:56:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "62a403f1-f50a-45dc-b194-4cd74570f2e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:56:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "62a403f1-f50a-45dc-b194-4cd74570f2e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:56:30 user nova-compute[75391]: DEBUG nova.compute.manager [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:56:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:56:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:56:30 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:56:30 user nova-compute[75391]: INFO nova.compute.claims [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Claim successful on node user
Nov 15 02:56:30 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:56:30 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:56:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:56:30 user nova-compute[75391]: DEBUG nova.compute.manager [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:56:30 user nova-compute[75391]: DEBUG nova.compute.manager [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:56:30 user nova-compute[75391]: DEBUG nova.network.neutron [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:56:30 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:56:30 user nova-compute[75391]: DEBUG nova.compute.manager [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:56:30 user nova-compute[75391]: DEBUG nova.policy [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa67273822f247b2ae2d34ec9cd8c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae33412d3944fbcb20520ae0b5d5d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:56:30 user nova-compute[75391]: DEBUG nova.compute.manager [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:56:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:56:30 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Creating image(s)
Nov 15 02:56:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "/opt/stack/data/nova/instances/62a403f1-f50a-45dc-b194-4cd74570f2e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:56:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "/opt/stack/data/nova/instances/62a403f1-f50a-45dc-b194-4cd74570f2e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:56:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "/opt/stack/data/nova/instances/62a403f1-f50a-45dc-b194-4cd74570f2e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:56:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.184s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:56:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:56:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.176s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/62a403f1-f50a-45dc-b194-4cd74570f2e9/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/62a403f1-f50a-45dc-b194-4cd74570f2e9/disk 1073741824" returned: 0 in 0.046s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:56:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:31 user nova-compute[75391]: DEBUG nova.network.neutron [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Successfully created port: fc4d7e54-3e1e-4439-b78a-a542d743cbc6 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:56:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.177s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:31 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62a403f1-f50a-45dc-b194-4cd74570f2e9/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:56:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62a403f1-f50a-45dc-b194-4cd74570f2e9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62a403f1-f50a-45dc-b194-4cd74570f2e9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:31 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Cannot resize image /opt/stack/data/nova/instances/62a403f1-f50a-45dc-b194-4cd74570f2e9/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:56:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:56:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Ensure instance console log exists: /opt/stack/data/nova/instances/62a403f1-f50a-45dc-b194-4cd74570f2e9/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:56:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:56:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:56:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:56:31 user nova-compute[75391]: DEBUG nova.network.neutron [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Successfully updated port: fc4d7e54-3e1e-4439-b78a-a542d743cbc6 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "refresh_cache-62a403f1-f50a-45dc-b194-4cd74570f2e9" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquired lock "refresh_cache-62a403f1-f50a-45dc-b194-4cd74570f2e9" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.network.neutron [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.compute.manager [req-a5499317-b7bd-468d-902c-c8bc14936153 req-1ca5a820-0397-43bd-afb6-d0ebbbd47f08 service nova] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Received event network-changed-fc4d7e54-3e1e-4439-b78a-a542d743cbc6 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.compute.manager [req-a5499317-b7bd-468d-902c-c8bc14936153 req-1ca5a820-0397-43bd-afb6-d0ebbbd47f08 service nova] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Refreshing instance network info cache due to event network-changed-fc4d7e54-3e1e-4439-b78a-a542d743cbc6. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a5499317-b7bd-468d-902c-c8bc14936153 req-1ca5a820-0397-43bd-afb6-d0ebbbd47f08 service nova] Acquiring lock "refresh_cache-62a403f1-f50a-45dc-b194-4cd74570f2e9" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.network.neutron [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.network.neutron [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Updating instance_info_cache with network_info: [{"id": "fc4d7e54-3e1e-4439-b78a-a542d743cbc6", "address": "fa:16:3e:bd:e8:68", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4d7e54-3e", "ovs_interfaceid": "fc4d7e54-3e1e-4439-b78a-a542d743cbc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Releasing lock "refresh_cache-62a403f1-f50a-45dc-b194-4cd74570f2e9" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.compute.manager [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Instance network_info: |[{"id": "fc4d7e54-3e1e-4439-b78a-a542d743cbc6", "address": "fa:16:3e:bd:e8:68", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4d7e54-3e", "ovs_interfaceid": "fc4d7e54-3e1e-4439-b78a-a542d743cbc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a5499317-b7bd-468d-902c-c8bc14936153 req-1ca5a820-0397-43bd-afb6-d0ebbbd47f08 service nova] Acquired lock "refresh_cache-62a403f1-f50a-45dc-b194-4cd74570f2e9" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.network.neutron [req-a5499317-b7bd-468d-902c-c8bc14936153 req-1ca5a820-0397-43bd-afb6-d0ebbbd47f08 service nova] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Refreshing network info cache for port fc4d7e54-3e1e-4439-b78a-a542d743cbc6 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Start _get_guest_xml network_info=[{"id": "fc4d7e54-3e1e-4439-b78a-a542d743cbc6", "address": "fa:16:3e:bd:e8:68", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4d7e54-3e", "ovs_interfaceid": "fc4d7e54-3e1e-4439-b78a-a542d743cbc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:56:32 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:56:32 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2077648366',display_name='tempest-AttachVolumeTestJSON-server-2077648366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2077648366',id=35,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk6igpjvau4+imFaTS5sCRgwYeZCwRtqolELPwrrgYugVf4Ne2t5WkuG4KntUeSOcfNVsANlF76V5rmQ19gwueRyjMkITosgfv32ruHER6TS54snZB0AS/oLiKI7KaIew==',key_name='tempest-keypair-1037573230',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ae33412d3944fbcb20520ae0b5d5d17',ramdisk_id='',reservation_id='r-36ay192f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-452422979',owner_user_name='tempest-AttachVolumeTestJSON-452422979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:56:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa67273822f247b2ae2d34ec9cd8c8b4',uuid=62a403f1-f50a-45dc-b194-4cd74570f2e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc4d7e54-3e1e-4439-b78a-a542d743cbc6", "address": "fa:16:3e:bd:e8:68", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4d7e54-3e", "ovs_interfaceid": "fc4d7e54-3e1e-4439-b78a-a542d743cbc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Converting VIF {"id": "fc4d7e54-3e1e-4439-b78a-a542d743cbc6", "address": "fa:16:3e:bd:e8:68", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4d7e54-3e", "ovs_interfaceid": "fc4d7e54-3e1e-4439-b78a-a542d743cbc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:e8:68,bridge_name='br-int',has_traffic_filtering=True,id=fc4d7e54-3e1e-4439-b78a-a542d743cbc6,network=Network(4866e9c3-d16f-4496-b56a-1f100ea5622a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4d7e54-3e') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.objects.instance [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'pci_devices' on Instance uuid 62a403f1-f50a-45dc-b194-4cd74570f2e9 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:56:32 user nova-compute[75391]:   <uuid>62a403f1-f50a-45dc-b194-4cd74570f2e9</uuid>
Nov 15 02:56:32 user nova-compute[75391]:   <name>instance-00000023</name>
Nov 15 02:56:32 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:56:32 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:56:32 user nova-compute[75391]:   <metadata>
Nov 15 02:56:32 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:56:32 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:56:32 user nova-compute[75391]:       <nova:name>tempest-AttachVolumeTestJSON-server-2077648366</nova:name>
Nov 15 02:56:32 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:56:32</nova:creationTime>
Nov 15 02:56:32 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:56:32 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:56:32 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:56:32 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:56:32 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:56:32 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:56:32 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:56:32 user nova-compute[75391]:       <nova:owner>
Nov 15 02:56:32 user nova-compute[75391]:         <nova:user uuid="aa67273822f247b2ae2d34ec9cd8c8b4">tempest-AttachVolumeTestJSON-452422979-project-member</nova:user>
Nov 15 02:56:32 user nova-compute[75391]:         <nova:project uuid="3ae33412d3944fbcb20520ae0b5d5d17">tempest-AttachVolumeTestJSON-452422979</nova:project>
Nov 15 02:56:32 user nova-compute[75391]:       </nova:owner>
Nov 15 02:56:32 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:56:32 user nova-compute[75391]:       <nova:ports>
Nov 15 02:56:32 user nova-compute[75391]:         <nova:port uuid="fc4d7e54-3e1e-4439-b78a-a542d743cbc6">
Nov 15 02:56:32 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 02:56:32 user nova-compute[75391]:         </nova:port>
Nov 15 02:56:32 user nova-compute[75391]:       </nova:ports>
Nov 15 02:56:32 user nova-compute[75391]:     </nova:instance>
Nov 15 02:56:32 user nova-compute[75391]:   </metadata>
Nov 15 02:56:32 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:56:32 user nova-compute[75391]:     <system>
Nov 15 02:56:32 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:56:32 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:56:32 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:56:32 user nova-compute[75391]:       <entry name="serial">62a403f1-f50a-45dc-b194-4cd74570f2e9</entry>
Nov 15 02:56:32 user nova-compute[75391]:       <entry name="uuid">62a403f1-f50a-45dc-b194-4cd74570f2e9</entry>
Nov 15 02:56:32 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:56:32 user nova-compute[75391]:     </system>
Nov 15 02:56:32 user nova-compute[75391]:   </sysinfo>
Nov 15 02:56:32 user nova-compute[75391]:   <os>
Nov 15 02:56:32 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:56:32 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:56:32 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:56:32 user nova-compute[75391]:   </os>
Nov 15 02:56:32 user nova-compute[75391]:   <features>
Nov 15 02:56:32 user nova-compute[75391]:     <acpi/>
Nov 15 02:56:32 user nova-compute[75391]:     <apic/>
Nov 15 02:56:32 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:56:32 user nova-compute[75391]:   </features>
Nov 15 02:56:32 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:56:32 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:56:32 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:56:32 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:56:32 user nova-compute[75391]:   </clock>
Nov 15 02:56:32 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:56:32 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:56:32 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:56:32 user nova-compute[75391]:   </cpu>
Nov 15 02:56:32 user nova-compute[75391]:   <devices>
Nov 15 02:56:32 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:56:32 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:56:32 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/62a403f1-f50a-45dc-b194-4cd74570f2e9/disk"/>
Nov 15 02:56:32 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:56:32 user nova-compute[75391]:     </disk>
Nov 15 02:56:32 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:56:32 user nova-compute[75391]:       <mac address="fa:16:3e:bd:e8:68"/>
Nov 15 02:56:32 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:56:32 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:56:32 user nova-compute[75391]:       <target dev="tapfc4d7e54-3e"/>
Nov 15 02:56:32 user nova-compute[75391]:     </interface>
Nov 15 02:56:32 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:56:32 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/62a403f1-f50a-45dc-b194-4cd74570f2e9/console.log" append="off"/>
Nov 15 02:56:32 user nova-compute[75391]:     </serial>
Nov 15 02:56:32 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:56:32 user nova-compute[75391]:     <video>
Nov 15 02:56:32 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:56:32 user nova-compute[75391]:     </video>
Nov 15 02:56:32 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:56:32 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:56:32 user nova-compute[75391]:     </rng>
Nov 15 02:56:32 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:56:32 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:56:32 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:56:32 user nova-compute[75391]:     </memballoon>
Nov 15 02:56:32 user nova-compute[75391]:   </devices>
Nov 15 02:56:32 user nova-compute[75391]: </domain>
Nov 15 02:56:32 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2077648366',display_name='tempest-AttachVolumeTestJSON-server-2077648366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2077648366',id=35,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk6igpjvau4+imFaTS5sCRgwYeZCwRtqolELPwrrgYugVf4Ne2t5WkuG4KntUeSOcfNVsANlF76V5rmQ19gwueRyjMkITosgfv32ruHER6TS54snZB0AS/oLiKI7KaIew==',key_name='tempest-keypair-1037573230',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ae33412d3944fbcb20520ae0b5d5d17',ramdisk_id='',reservation_id='r-36ay192f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-452422979',owner_user_name='tempest-AttachVolumeTestJSON-452422979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:56:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa67273822f247b2ae2d34ec9cd8c8b4',uuid=62a403f1-f50a-45dc-b194-4cd74570f2e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc4d7e54-3e1e-4439-b78a-a542d743cbc6", "address": "fa:16:3e:bd:e8:68", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4d7e54-3e", "ovs_interfaceid": "fc4d7e54-3e1e-4439-b78a-a542d743cbc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Converting VIF {"id": "fc4d7e54-3e1e-4439-b78a-a542d743cbc6", "address": "fa:16:3e:bd:e8:68", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4d7e54-3e", "ovs_interfaceid": "fc4d7e54-3e1e-4439-b78a-a542d743cbc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:e8:68,bridge_name='br-int',has_traffic_filtering=True,id=fc4d7e54-3e1e-4439-b78a-a542d743cbc6,network=Network(4866e9c3-d16f-4496-b56a-1f100ea5622a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4d7e54-3e') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG os_vif [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:e8:68,bridge_name='br-int',has_traffic_filtering=True,id=fc4d7e54-3e1e-4439-b78a-a542d743cbc6,network=Network(4866e9c3-d16f-4496-b56a-1f100ea5622a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4d7e54-3e') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b0ad94e-f9ac-54a7-b287-05e9366e67fe', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc4d7e54-3e, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc4d7e54-3e, col_values=(('qos', UUID('cddc4c38-a21f-4bd8-9b22-c919c40a1b6d')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc4d7e54-3e, col_values=(('external_ids', {'iface-id': 'fc4d7e54-3e1e-4439-b78a-a542d743cbc6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:e8:68', 'vm-uuid': '62a403f1-f50a-45dc-b194-4cd74570f2e9'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:32 user nova-compute[75391]: INFO os_vif [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:e8:68,bridge_name='br-int',has_traffic_filtering=True,id=fc4d7e54-3e1e-4439-b78a-a542d743cbc6,network=Network(4866e9c3-d16f-4496-b56a-1f100ea5622a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4d7e54-3e')
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] No VIF found with MAC fa:16:3e:bd:e8:68, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.network.neutron [req-a5499317-b7bd-468d-902c-c8bc14936153 req-1ca5a820-0397-43bd-afb6-d0ebbbd47f08 service nova] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Updated VIF entry in instance network info cache for port fc4d7e54-3e1e-4439-b78a-a542d743cbc6. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG nova.network.neutron [req-a5499317-b7bd-468d-902c-c8bc14936153 req-1ca5a820-0397-43bd-afb6-d0ebbbd47f08 service nova] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Updating instance_info_cache with network_info: [{"id": "fc4d7e54-3e1e-4439-b78a-a542d743cbc6", "address": "fa:16:3e:bd:e8:68", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4d7e54-3e", "ovs_interfaceid": "fc4d7e54-3e1e-4439-b78a-a542d743cbc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:56:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a5499317-b7bd-468d-902c-c8bc14936153 req-1ca5a820-0397-43bd-afb6-d0ebbbd47f08 service nova] Releasing lock "refresh_cache-62a403f1-f50a-45dc-b194-4cd74570f2e9" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:56:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:34 user nova-compute[75391]: DEBUG nova.compute.manager [req-2cc15ee7-a4d2-4e71-8f77-27e867090b21 req-31aea85b-8afe-43af-ade7-c1328febe577 service nova] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Received event network-vif-plugged-fc4d7e54-3e1e-4439-b78a-a542d743cbc6 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:56:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2cc15ee7-a4d2-4e71-8f77-27e867090b21 req-31aea85b-8afe-43af-ade7-c1328febe577 service nova] Acquiring lock "62a403f1-f50a-45dc-b194-4cd74570f2e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:56:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2cc15ee7-a4d2-4e71-8f77-27e867090b21 req-31aea85b-8afe-43af-ade7-c1328febe577 service nova] Lock "62a403f1-f50a-45dc-b194-4cd74570f2e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:56:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2cc15ee7-a4d2-4e71-8f77-27e867090b21 req-31aea85b-8afe-43af-ade7-c1328febe577 service nova] Lock "62a403f1-f50a-45dc-b194-4cd74570f2e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:56:34 user nova-compute[75391]: DEBUG nova.compute.manager [req-2cc15ee7-a4d2-4e71-8f77-27e867090b21 req-31aea85b-8afe-43af-ade7-c1328febe577 service nova] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] No waiting events found dispatching network-vif-plugged-fc4d7e54-3e1e-4439-b78a-a542d743cbc6 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:56:34 user nova-compute[75391]: WARNING nova.compute.manager [req-2cc15ee7-a4d2-4e71-8f77-27e867090b21 req-31aea85b-8afe-43af-ade7-c1328febe577 service nova] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Received unexpected event network-vif-plugged-fc4d7e54-3e1e-4439-b78a-a542d743cbc6 for instance with vm_state building and task_state spawning.
Nov 15 02:56:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Acquiring lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:56:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:56:34 user nova-compute[75391]: INFO nova.compute.manager [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Detaching volume 97e18e62-9827-49f7-8b9f-4180b53c2613
Nov 15 02:56:35 user nova-compute[75391]: INFO nova.virt.block_device [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Attempting to driver detach volume 97e18e62-9827-49f7-8b9f-4180b53c2613 from mountpoint /dev/vdb
Nov 15 02:56:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Attempting to detach device vdb from instance 04dcd079-e89f-401c-a7ae-8af96beb3d6d from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:56:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:56:35 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:56:35 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 02:56:35 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:56:35 user nova-compute[75391]:   <serial>97e18e62-9827-49f7-8b9f-4180b53c2613</serial>
Nov 15 02:56:35 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:56:35 user nova-compute[75391]: </disk>
Nov 15 02:56:35 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:56:35 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Successfully detached device vdb from instance 04dcd079-e89f-401c-a7ae-8af96beb3d6d from the persistent domain config.
Nov 15 02:56:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 04dcd079-e89f-401c-a7ae-8af96beb3d6d from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 02:56:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:56:35 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:56:35 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 02:56:35 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:56:35 user nova-compute[75391]:   <serial>97e18e62-9827-49f7-8b9f-4180b53c2613</serial>
Nov 15 02:56:35 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:56:35 user nova-compute[75391]: </disk>
Nov 15 02:56:35 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:56:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 04dcd079-e89f-401c-a7ae-8af96beb3d6d {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 02:56:35 user nova-compute[75391]: DEBUG nova.compute.manager [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:56:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:56:35 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Instance spawned successfully.
Nov 15 02:56:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:56:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:56:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:56:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:56:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:56:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:56:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:56:36 user nova-compute[75391]: INFO nova.compute.manager [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Took 5.12 seconds to spawn the instance on the hypervisor.
Nov 15 02:56:36 user nova-compute[75391]: DEBUG nova.compute.manager [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:56:36 user nova-compute[75391]: INFO nova.compute.manager [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Took 5.94 seconds to build instance.
Nov 15 02:56:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-51363e07-3bb7-42dd-9552-e34c16dc861d tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "62a403f1-f50a-45dc-b194-4cd74570f2e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.064s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:56:36 user nova-compute[75391]: DEBUG nova.compute.manager [req-e3d9b8dd-b9a0-412d-805d-c936fcc202f0 req-7fbf595f-d3e9-48c0-b9e2-befc773c8a12 service nova] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Received event network-vif-plugged-fc4d7e54-3e1e-4439-b78a-a542d743cbc6 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:56:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e3d9b8dd-b9a0-412d-805d-c936fcc202f0 req-7fbf595f-d3e9-48c0-b9e2-befc773c8a12 service nova] Acquiring lock "62a403f1-f50a-45dc-b194-4cd74570f2e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:56:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e3d9b8dd-b9a0-412d-805d-c936fcc202f0 req-7fbf595f-d3e9-48c0-b9e2-befc773c8a12 service nova] Lock "62a403f1-f50a-45dc-b194-4cd74570f2e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:56:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e3d9b8dd-b9a0-412d-805d-c936fcc202f0 req-7fbf595f-d3e9-48c0-b9e2-befc773c8a12 service nova] Lock "62a403f1-f50a-45dc-b194-4cd74570f2e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:56:36 user nova-compute[75391]: DEBUG nova.compute.manager [req-e3d9b8dd-b9a0-412d-805d-c936fcc202f0 req-7fbf595f-d3e9-48c0-b9e2-befc773c8a12 service nova] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] No waiting events found dispatching network-vif-plugged-fc4d7e54-3e1e-4439-b78a-a542d743cbc6 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:56:36 user nova-compute[75391]: WARNING nova.compute.manager [req-e3d9b8dd-b9a0-412d-805d-c936fcc202f0 req-7fbf595f-d3e9-48c0-b9e2-befc773c8a12 service nova] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Received unexpected event network-vif-plugged-fc4d7e54-3e1e-4439-b78a-a542d743cbc6 for instance with vm_state active and task_state None.
Nov 15 02:56:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-83a6754a-c588-4646-a156-6831cfe17589 req-bb2f254a-d934-4da2-8ccd-e8dfbccdbb43 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Received event network-changed-5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:56:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-83a6754a-c588-4646-a156-6831cfe17589 req-bb2f254a-d934-4da2-8ccd-e8dfbccdbb43 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Refreshing instance network info cache due to event network-changed-5af75008-fab4-4b58-b936-3d35fdcc8199. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:56:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-83a6754a-c588-4646-a156-6831cfe17589 req-bb2f254a-d934-4da2-8ccd-e8dfbccdbb43 service nova] Acquiring lock "refresh_cache-991177b1-d6a7-41a7-b9fa-f08d04fa57c6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:56:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-83a6754a-c588-4646-a156-6831cfe17589 req-bb2f254a-d934-4da2-8ccd-e8dfbccdbb43 service nova] Acquired lock "refresh_cache-991177b1-d6a7-41a7-b9fa-f08d04fa57c6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:56:46 user nova-compute[75391]: DEBUG nova.network.neutron [req-83a6754a-c588-4646-a156-6831cfe17589 req-bb2f254a-d934-4da2-8ccd-e8dfbccdbb43 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Refreshing network info cache for port 5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:56:46 user nova-compute[75391]: DEBUG nova.network.neutron [req-83a6754a-c588-4646-a156-6831cfe17589 req-bb2f254a-d934-4da2-8ccd-e8dfbccdbb43 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Updated VIF entry in instance network info cache for port 5af75008-fab4-4b58-b936-3d35fdcc8199. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:56:46 user nova-compute[75391]: DEBUG nova.network.neutron [req-83a6754a-c588-4646-a156-6831cfe17589 req-bb2f254a-d934-4da2-8ccd-e8dfbccdbb43 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Updating instance_info_cache with network_info: [{"id": "5af75008-fab4-4b58-b936-3d35fdcc8199", "address": "fa:16:3e:20:f9:b0", "network": {"id": "525ff764-45a1-4e28-9a54-09f11b8e8a7d", "bridge": "br-int", "label": "tempest-TestShelveInstance-931031505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3451824ac0cb4f32a4882218fa8e63ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af75008-fa", "ovs_interfaceid": "5af75008-fab4-4b58-b936-3d35fdcc8199", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:56:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-83a6754a-c588-4646-a156-6831cfe17589 req-bb2f254a-d934-4da2-8ccd-e8dfbccdbb43 service nova] Releasing lock "refresh_cache-991177b1-d6a7-41a7-b9fa-f08d04fa57c6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:56:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Acquiring lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:56:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:56:46 user nova-compute[75391]: INFO nova.compute.manager [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Shelve offloading
Nov 15 02:56:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-77161afd-4a88-4f73-8eda-733e9eb0d1da req-3ced7355-1065-43eb-ba7c-967d8e5d05e3 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Received event network-vif-unplugged-5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:56:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-77161afd-4a88-4f73-8eda-733e9eb0d1da req-3ced7355-1065-43eb-ba7c-967d8e5d05e3 service nova] Acquiring lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:56:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-77161afd-4a88-4f73-8eda-733e9eb0d1da req-3ced7355-1065-43eb-ba7c-967d8e5d05e3 service nova] Lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:56:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-77161afd-4a88-4f73-8eda-733e9eb0d1da req-3ced7355-1065-43eb-ba7c-967d8e5d05e3 service nova] Lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:56:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-77161afd-4a88-4f73-8eda-733e9eb0d1da req-3ced7355-1065-43eb-ba7c-967d8e5d05e3 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] No waiting events found dispatching network-vif-unplugged-5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:56:46 user nova-compute[75391]: WARNING nova.compute.manager [req-77161afd-4a88-4f73-8eda-733e9eb0d1da req-3ced7355-1065-43eb-ba7c-967d8e5d05e3 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Received unexpected event network-vif-unplugged-5af75008-fab4-4b58-b936-3d35fdcc8199 for instance with vm_state active and task_state shelving.
Nov 15 02:56:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:47 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Instance destroyed successfully.
Nov 15 02:56:47 user nova-compute[75391]: DEBUG nova.compute.manager [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:56:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Acquiring lock "refresh_cache-991177b1-d6a7-41a7-b9fa-f08d04fa57c6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:56:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Acquired lock "refresh_cache-991177b1-d6a7-41a7-b9fa-f08d04fa57c6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:56:47 user nova-compute[75391]: DEBUG nova.network.neutron [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:56:47 user nova-compute[75391]: DEBUG nova.network.neutron [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Updating instance_info_cache with network_info: [{"id": "5af75008-fab4-4b58-b936-3d35fdcc8199", "address": "fa:16:3e:20:f9:b0", "network": {"id": "525ff764-45a1-4e28-9a54-09f11b8e8a7d", "bridge": "br-int", "label": "tempest-TestShelveInstance-931031505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3451824ac0cb4f32a4882218fa8e63ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af75008-fa", "ovs_interfaceid": "5af75008-fab4-4b58-b936-3d35fdcc8199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:56:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Releasing lock "refresh_cache-991177b1-d6a7-41a7-b9fa-f08d04fa57c6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:56:48 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Instance destroyed successfully.
Nov 15 02:56:48 user nova-compute[75391]: DEBUG nova.objects.instance [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lazy-loading 'resources' on Instance uuid 991177b1-d6a7-41a7-b9fa-f08d04fa57c6 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:54:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-88510188',display_name='tempest-TestShelveInstance-server-88510188',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-88510188',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbWHq0u3vzYDdTA20T21WxOphyWDwBwUdcpvnjvB6rdYVJo9RyP642jhsv3kAcbxdgKg9Vmhj9Bu5vtsg1oFVXUy6TrBHh4+tXEhMns8mSFMH2pDgygK0NQ58MCoKv0yQ==',key_name='tempest-TestShelveInstance-469278701',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:55:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3451824ac0cb4f32a4882218fa8e63ae',ramdisk_id='',reservation_id='r-zi0hjw2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-93691503',owner_user_name='tempest-TestShelveInstance-93691503-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:55:06Z,user_data=None,user_id='a687d6f2859d498492cecd3d7f366618',uuid=991177b1-d6a7-41a7-b9fa-f08d04fa57c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5af75008-fab4-4b58-b936-3d35fdcc8199", "address": "fa:16:3e:20:f9:b0", "network": {"id": "525ff764-45a1-4e28-9a54-09f11b8e8a7d", "bridge": "br-int", "label": "tempest-TestShelveInstance-931031505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3451824ac0cb4f32a4882218fa8e63ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af75008-fa", "ovs_interfaceid": "5af75008-fab4-4b58-b936-3d35fdcc8199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Converting VIF {"id": "5af75008-fab4-4b58-b936-3d35fdcc8199", "address": "fa:16:3e:20:f9:b0", "network": {"id": "525ff764-45a1-4e28-9a54-09f11b8e8a7d", "bridge": "br-int", "label": "tempest-TestShelveInstance-931031505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3451824ac0cb4f32a4882218fa8e63ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af75008-fa", "ovs_interfaceid": "5af75008-fab4-4b58-b936-3d35fdcc8199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:f9:b0,bridge_name='br-int',has_traffic_filtering=True,id=5af75008-fab4-4b58-b936-3d35fdcc8199,network=Network(525ff764-45a1-4e28-9a54-09f11b8e8a7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5af75008-fa') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG os_vif [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:f9:b0,bridge_name='br-int',has_traffic_filtering=True,id=5af75008-fab4-4b58-b936-3d35fdcc8199,network=Network(525ff764-45a1-4e28-9a54-09f11b8e8a7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5af75008-fa') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5af75008-fa, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG nova.compute.manager [req-91c2ab34-1c81-46f1-a255-dca07aef19ca req-5f509708-3a49-412b-810c-e845aacea673 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Received event network-changed-5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG nova.compute.manager [req-91c2ab34-1c81-46f1-a255-dca07aef19ca req-5f509708-3a49-412b-810c-e845aacea673 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Refreshing instance network info cache due to event network-changed-5af75008-fab4-4b58-b936-3d35fdcc8199. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-91c2ab34-1c81-46f1-a255-dca07aef19ca req-5f509708-3a49-412b-810c-e845aacea673 service nova] Acquiring lock "refresh_cache-991177b1-d6a7-41a7-b9fa-f08d04fa57c6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-91c2ab34-1c81-46f1-a255-dca07aef19ca req-5f509708-3a49-412b-810c-e845aacea673 service nova] Acquired lock "refresh_cache-991177b1-d6a7-41a7-b9fa-f08d04fa57c6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG nova.network.neutron [req-91c2ab34-1c81-46f1-a255-dca07aef19ca req-5f509708-3a49-412b-810c-e845aacea673 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Refreshing network info cache for port 5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cfc8001e-ed28-493c-b044-95442265e0a6) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:48 user nova-compute[75391]: INFO os_vif [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:f9:b0,bridge_name='br-int',has_traffic_filtering=True,id=5af75008-fab4-4b58-b936-3d35fdcc8199,network=Network(525ff764-45a1-4e28-9a54-09f11b8e8a7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5af75008-fa')
Nov 15 02:56:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnptVkFb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:56:48 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:56:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc26f95-b55b-415e-a44b-610a81596f21]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:56:48 user nova-compute[75391]: No targets found.
Nov 15 02:56:48 user nova-compute[75391]: iSNS:
Nov 15 02:56:48 user nova-compute[75391]: No targets found.
Nov 15 02:56:48 user nova-compute[75391]: STATIC:
Nov 15 02:56:48 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613
Nov 15 02:56:48 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:56:48 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:56:48 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281
Nov 15 02:56:48 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:56:48 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:56:48 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a
Nov 15 02:56:48 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:56:48 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:56:48 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b
Nov 15 02:56:48 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:56:48 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:56:48 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:56:48 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:56:48 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:56:48 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39
Nov 15 02:56:48 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:56:48 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:56:48 user nova-compute[75391]: FIRMWARE:
Nov 15 02:56:48 user nova-compute[75391]: No targets found.
Nov 15 02:56:48 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:56:48 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:56:48 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2c5fec-a549-49ab-ac6e-c88a06346682]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[be76243c-e276-4571-8b5c-974404792d85]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:56:48 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:56:48 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:56:48 user nova-compute[75391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)
Nov 15 02:56:48 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:56:48 user nova-compute[75391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)
Nov 15 02:56:48 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:56:48 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:56:48 user nova-compute[75391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:56:48 user nova-compute[75391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)
Nov 15 02:56:48 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:56:48 user nova-compute[75391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)
Nov 15 02:56:48 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6248cc71c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281'): ({'sde'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Removing single pathed devices sde {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[410474cf-eaae-42df-9562-2824a2273790]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bef558d-d66d-4f5e-ad60-1aa562a199d5]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Flushing IO for device /dev/sde {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc802f1a-0015-4d49-9c56-ebc5ed882311]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[534a4f98-13a8-4a79-8645-f41f298d75dc]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] SCSI volumes sde have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:56:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:49 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91519e7-aead-4fa0-b9f3-c656ca1541d6]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:49 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:56:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:49 user nova-compute[75391]: DEBUG nova.compute.manager [req-1c5ad68f-f2aa-4494-83f2-2e031ae3eeb8 req-e978a85a-aa15-4810-acd0-8f49ce04d099 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Received event network-vif-plugged-5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:56:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1c5ad68f-f2aa-4494-83f2-2e031ae3eeb8 req-e978a85a-aa15-4810-acd0-8f49ce04d099 service nova] Acquiring lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:56:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1c5ad68f-f2aa-4494-83f2-2e031ae3eeb8 req-e978a85a-aa15-4810-acd0-8f49ce04d099 service nova] Lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:56:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1c5ad68f-f2aa-4494-83f2-2e031ae3eeb8 req-e978a85a-aa15-4810-acd0-8f49ce04d099 service nova] Lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:56:49 user nova-compute[75391]: DEBUG nova.compute.manager [req-1c5ad68f-f2aa-4494-83f2-2e031ae3eeb8 req-e978a85a-aa15-4810-acd0-8f49ce04d099 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] No waiting events found dispatching network-vif-plugged-5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:56:49 user nova-compute[75391]: WARNING nova.compute.manager [req-1c5ad68f-f2aa-4494-83f2-2e031ae3eeb8 req-e978a85a-aa15-4810-acd0-8f49ce04d099 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Received unexpected event network-vif-plugged-5af75008-fab4-4b58-b936-3d35fdcc8199 for instance with vm_state active and task_state shelving.
Nov 15 02:56:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:49 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[705ccba9-3a70-4e41-9115-3a9ffc5a5e69]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:49 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281, portal: 172.16.0.220,3260]
Nov 15 02:56:49 user nova-compute[75391]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281, portal: 172.16.0.220,3260] successful.
Nov 15 02:56:49 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:56:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:49 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[519498aa-bf5d-4b75-a6d4-0b76369d69b8]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:49 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:56:49 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:56:49 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] <== disconnect_volume: return (362ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:56:49 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:56:49 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Deleting instance files /opt/stack/data/nova/instances/991177b1-d6a7-41a7-b9fa-f08d04fa57c6_del
Nov 15 02:56:49 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Deletion of /opt/stack/data/nova/instances/991177b1-d6a7-41a7-b9fa-f08d04fa57c6_del complete
Nov 15 02:56:49 user nova-compute[75391]: DEBUG nova.network.neutron [req-91c2ab34-1c81-46f1-a255-dca07aef19ca req-5f509708-3a49-412b-810c-e845aacea673 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Updated VIF entry in instance network info cache for port 5af75008-fab4-4b58-b936-3d35fdcc8199. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:56:49 user nova-compute[75391]: DEBUG nova.network.neutron [req-91c2ab34-1c81-46f1-a255-dca07aef19ca req-5f509708-3a49-412b-810c-e845aacea673 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Updating instance_info_cache with network_info: [{"id": "5af75008-fab4-4b58-b936-3d35fdcc8199", "address": "fa:16:3e:20:f9:b0", "network": {"id": "525ff764-45a1-4e28-9a54-09f11b8e8a7d", "bridge": null, "label": "tempest-TestShelveInstance-931031505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3451824ac0cb4f32a4882218fa8e63ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5af75008-fa", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:56:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-91c2ab34-1c81-46f1-a255-dca07aef19ca req-5f509708-3a49-412b-810c-e845aacea673 service nova] Releasing lock "refresh_cache-991177b1-d6a7-41a7-b9fa-f08d04fa57c6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:56:50 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Deleted allocations for instance 991177b1-d6a7-41a7-b9fa-f08d04fa57c6
Nov 15 02:56:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:56:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:56:50 user nova-compute[75391]: DEBUG nova.objects.instance [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lazy-loading 'numa_topology' on Instance uuid 991177b1-d6a7-41a7-b9fa-f08d04fa57c6 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:56:50 user nova-compute[75391]: DEBUG nova.objects.base [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Object Instance<991177b1-d6a7-41a7-b9fa-f08d04fa57c6> lazy-loaded attributes: resources,numa_topology {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:56:50 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:56:50 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:56:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.387s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:56:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-84570592-9e53-41d1-8a8b-70cf8e6936c0 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.034s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:56:51 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:56:51 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:56:51 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:56:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-d36e2f64-11cb-4b35-8471-9a4df7f4c227" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:56:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-d36e2f64-11cb-4b35-8471-9a4df7f4c227" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:56:51 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 02:56:52 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Updating instance_info_cache with network_info: [{"id": "0a8cd0f0-6967-4cec-a752-5699a32298b1", "address": "fa:16:3e:6d:7a:4e", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a8cd0f0-69", "ovs_interfaceid": "0a8cd0f0-6967-4cec-a752-5699a32298b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:56:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-d36e2f64-11cb-4b35-8471-9a4df7f4c227" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:56:52 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 02:56:52 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:56:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:54 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:56:55 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 04dcd079-e89f-401c-a7ae-8af96beb3d6d is timed out.
Nov 15 02:56:55 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Successfully detached device vdb from instance 04dcd079-e89f-401c-a7ae-8af96beb3d6d from the live domain config.
Nov 15 02:56:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FIsuVazk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:56:55 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:56:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[16253a60-50ce-496d-a403-a6e00ae97640]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:56:55 user nova-compute[75391]: No targets found.
Nov 15 02:56:55 user nova-compute[75391]: iSNS:
Nov 15 02:56:55 user nova-compute[75391]: No targets found.
Nov 15 02:56:55 user nova-compute[75391]: STATIC:
Nov 15 02:56:55 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613
Nov 15 02:56:55 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:56:55 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:56:55 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a
Nov 15 02:56:55 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:56:55 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:56:55 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b
Nov 15 02:56:55 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:56:55 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:56:55 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:56:55 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:56:55 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:56:55 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39
Nov 15 02:56:55 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:56:55 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:56:55 user nova-compute[75391]: FIRMWARE:
Nov 15 02:56:55 user nova-compute[75391]: No targets found.
Nov 15 02:56:55 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:56:55 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:56:55 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[518fc1b9-7a16-4994-bbbf-c3c0703f1042]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[591ab7fa-258b-45c9-a891-420df7ffc809]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:56:55 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:56:55 user nova-compute[75391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)
Nov 15 02:56:55 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:56:55 user nova-compute[75391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)
Nov 15 02:56:55 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:56:55 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:56:55 user nova-compute[75391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 (non-flash)
Nov 15 02:56:55 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:56:55 user nova-compute[75391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)
Nov 15 02:56:55 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f623c139bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613'): ({'sdb'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Removing single pathed devices sdb {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58a250e-fb7a-4a9d-8e03-92019414152a]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f210182b-3473-4ae3-82e8-4b589b82cdad]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Flushing IO for device /dev/sdb {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[38979eb6-9e87-4307-953e-c64cc30becec]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[058d331a-b708-4d58-9153-8c1075c5c46f]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[688e986c-634f-4daa-99c0-4136741b6a2d]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cf6c5f-8946-4907-84a4-3157645f53aa]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613, portal: 172.16.0.220,3260]
Nov 15 02:56:55 user nova-compute[75391]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613, portal: 172.16.0.220,3260] successful.
Nov 15 02:56:55 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97e18e62-9827-49f7-8b9f-4180b53c2613 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8355e7a7-2401-4ab0-84d6-2dccbfff930d]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] <== disconnect_volume: return (313ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:56:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62a403f1-f50a-45dc-b194-4cd74570f2e9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62a403f1-f50a-45dc-b194-4cd74570f2e9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62a403f1-f50a-45dc-b194-4cd74570f2e9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62a403f1-f50a-45dc-b194-4cd74570f2e9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:56 user nova-compute[75391]: DEBUG nova.objects.instance [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lazy-loading 'flavor' on Instance uuid 04dcd079-e89f-401c-a7ae-8af96beb3d6d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:56:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d1fff564-e030-42e0-9d7d-477f5fe842d9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.825s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:56:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:56:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:56:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:56:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:56:57 user nova-compute[75391]: DEBUG nova.objects.instance [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lazy-loading 'flavor' on Instance uuid 28a1ec10-2748-4d0c-9b73-9636fc1cc237 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:56:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:56:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:56:58 user nova-compute[75391]: INFO nova.compute.manager [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Attaching volume dae4c60a-3131-4a20-a094-02fc3b33c345 to /dev/vdb
Nov 15 02:56:58 user nova-compute[75391]: DEBUG os_brick.utils [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[93033ca2-0a11-4061-996b-954776c53bad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[904a20c2-1605-46ba-a38f-6d5b2e5d3889]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[73386bbe-06a4-4580-a963-b10bc60d7d2a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da2ff05-a23a-4114-83ed-aaf6431f12fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:56:58 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:56:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee263e96-25bd-4c29-bc6e-949943452dd3]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG os_brick.utils [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Updating existing volume attachment record: 7798cbfd-bb68-4051-a729-de00166c4a09 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:56:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:56:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:56:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:57:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c767fb74-e57f-4ea0-bf4e-4034cf656a78/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c767fb74-e57f-4ea0-bf4e-4034cf656a78/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c767fb74-e57f-4ea0-bf4e-4034cf656a78/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c767fb74-e57f-4ea0-bf4e-4034cf656a78/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:01 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:57:01 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:57:01 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=7321MB free_disk=24.811115264892578GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:57:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:57:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:57:01 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Applying migration context for instance a0382af0-0509-4473-832f-1e5e6588be2e as it has an incoming, in-progress migration deec6e20-7b5f-4f09-8e17-9fbab60c8af8. Migration status is finished {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 02:57:01 user nova-compute[75391]: INFO nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Updating resource usage from migration deec6e20-7b5f-4f09-8e17-9fbab60c8af8
Nov 15 02:57:01 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9744c8a1-046e-4a00-92e0-92ebb3275ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:57:01 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance fc9484c0-9083-4797-8ab1-2ad392822ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:57:01 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6400a5f3-0ec9-4484-930c-1f5061ae5374 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:57:01 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance d36e2f64-11cb-4b35-8471-9a4df7f4c227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:57:01 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9909ae6b-7900-4f71-8900-2bf25185e436 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:57:01 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 7bd332f2-0f74-4a43-96a2-2322b6cbf982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:57:01 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:57:01 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance c767fb74-e57f-4ea0-bf4e-4034cf656a78 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:57:01 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 04dcd079-e89f-401c-a7ae-8af96beb3d6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:57:01 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Migration deec6e20-7b5f-4f09-8e17-9fbab60c8af8 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 02:57:01 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance a0382af0-0509-4473-832f-1e5e6588be2e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:57:01 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 341dfd0a-e264-4a6f-9537-35ba9ed980c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:57:01 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 62a403f1-f50a-45dc-b194-4cd74570f2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:57:01 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:57:01 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:57:01 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:57:01 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:57:01 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:57:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.662s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:57:02 user nova-compute[75391]: INFO nova.compute.manager [None req-1d400946-1f63-4e6d-9d51-d4983645dfc4 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Unrescuing
Nov 15 02:57:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1d400946-1f63-4e6d-9d51-d4983645dfc4 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "refresh_cache-9909ae6b-7900-4f71-8900-2bf25185e436" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:57:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1d400946-1f63-4e6d-9d51-d4983645dfc4 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquired lock "refresh_cache-9909ae6b-7900-4f71-8900-2bf25185e436" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:57:02 user nova-compute[75391]: DEBUG nova.network.neutron [None req-1d400946-1f63-4e6d-9d51-d4983645dfc4 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:57:02 user nova-compute[75391]: DEBUG nova.network.neutron [None req-1d400946-1f63-4e6d-9d51-d4983645dfc4 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Updating instance_info_cache with network_info: [{"id": "45919066-22c9-4df6-b411-e07851e743b6", "address": "fa:16:3e:86:62:a8", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45919066-22", "ovs_interfaceid": "45919066-22c9-4df6-b411-e07851e743b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:57:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1d400946-1f63-4e6d-9d51-d4983645dfc4 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Releasing lock "refresh_cache-9909ae6b-7900-4f71-8900-2bf25185e436" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:57:02 user nova-compute[75391]: DEBUG nova.objects.instance [None req-1d400946-1f63-4e6d-9d51-d4983645dfc4 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'flavor' on Instance uuid 9909ae6b-7900-4f71-8900-2bf25185e436 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:57:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:02 user nova-compute[75391]: INFO nova.compute.manager [None req-ebe68943-2134-4fc3-8e4d-574bc40686c0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Unrescuing
Nov 15 02:57:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ebe68943-2134-4fc3-8e4d-574bc40686c0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "refresh_cache-c767fb74-e57f-4ea0-bf4e-4034cf656a78" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:57:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ebe68943-2134-4fc3-8e4d-574bc40686c0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquired lock "refresh_cache-c767fb74-e57f-4ea0-bf4e-4034cf656a78" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:57:02 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ebe68943-2134-4fc3-8e4d-574bc40686c0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:57:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:03 user nova-compute[75391]: DEBUG nova.compute.manager [req-49f28460-946d-47c6-a34b-969494d3bed7 req-85e9b800-cade-4561-9365-bba803260c8b service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Received event network-vif-unplugged-45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:57:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-49f28460-946d-47c6-a34b-969494d3bed7 req-85e9b800-cade-4561-9365-bba803260c8b service nova] Acquiring lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:57:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-49f28460-946d-47c6-a34b-969494d3bed7 req-85e9b800-cade-4561-9365-bba803260c8b service nova] Lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:57:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-49f28460-946d-47c6-a34b-969494d3bed7 req-85e9b800-cade-4561-9365-bba803260c8b service nova] Lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:57:03 user nova-compute[75391]: DEBUG nova.compute.manager [req-49f28460-946d-47c6-a34b-969494d3bed7 req-85e9b800-cade-4561-9365-bba803260c8b service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] No waiting events found dispatching network-vif-unplugged-45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:57:03 user nova-compute[75391]: WARNING nova.compute.manager [req-49f28460-946d-47c6-a34b-969494d3bed7 req-85e9b800-cade-4561-9365-bba803260c8b service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Received unexpected event network-vif-unplugged-45919066-22c9-4df6-b411-e07851e743b6 for instance with vm_state rescued and task_state unrescuing.
Nov 15 02:57:03 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ebe68943-2134-4fc3-8e4d-574bc40686c0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Updating instance_info_cache with network_info: [{"id": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "address": "fa:16:3e:9e:b6:f5", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a80868d-8a", "ovs_interfaceid": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:57:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ebe68943-2134-4fc3-8e4d-574bc40686c0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Releasing lock "refresh_cache-c767fb74-e57f-4ea0-bf4e-4034cf656a78" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:57:03 user nova-compute[75391]: DEBUG nova.objects.instance [None req-ebe68943-2134-4fc3-8e4d-574bc40686c0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lazy-loading 'flavor' on Instance uuid c767fb74-e57f-4ea0-bf4e-4034cf656a78 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:57:03 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Instance destroyed successfully.
Nov 15 02:57:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:03 user nova-compute[75391]: DEBUG nova.compute.manager [req-b73ff432-38b7-41ab-9a6f-979220102918 req-aadafb57-0e57-45d3-aece-cb8a6410d7f4 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received event network-vif-unplugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:57:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b73ff432-38b7-41ab-9a6f-979220102918 req-aadafb57-0e57-45d3-aece-cb8a6410d7f4 service nova] Acquiring lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:57:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b73ff432-38b7-41ab-9a6f-979220102918 req-aadafb57-0e57-45d3-aece-cb8a6410d7f4 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:57:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b73ff432-38b7-41ab-9a6f-979220102918 req-aadafb57-0e57-45d3-aece-cb8a6410d7f4 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:57:03 user nova-compute[75391]: DEBUG nova.compute.manager [req-b73ff432-38b7-41ab-9a6f-979220102918 req-aadafb57-0e57-45d3-aece-cb8a6410d7f4 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] No waiting events found dispatching network-vif-unplugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:57:03 user nova-compute[75391]: WARNING nova.compute.manager [req-b73ff432-38b7-41ab-9a6f-979220102918 req-aadafb57-0e57-45d3-aece-cb8a6410d7f4 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received unexpected event network-vif-unplugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc for instance with vm_state rescued and task_state unrescuing.
Nov 15 02:57:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:57:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KbLzHgNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:57:03 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:57:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:57:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:57:03 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:57:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:57:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:57:03 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:57:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3416bb91-cf3b-4e18-9c11-4dfda1f5d870]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:57:04 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3be288-5a8c-467c-9e6f-6836a06b8a9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345] added
Nov 15 02:57:04 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d8a961-4010-4c67-b327-df67b64c4cbe]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab8bd88-5f0b-4e41-95ef-9d6718818b82]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KbLzHgNQ {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KbLzHgNQ" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebeeaf74-4662-4247-84d2-7a0cb79bb97e]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KbLzHgNQ'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d022d9-cbaa-441e-805a-bf4cae2d19dc]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cacf8c-8828-45ac-a4c9-dcb6f03c60c7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:57:04 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:57:04 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:57:04 user nova-compute[75391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)
Nov 15 02:57:04 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:57:04 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:57:04 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:57:04 user nova-compute[75391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)
Nov 15 02:57:04 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[33108578-d8d1-469a-80ec-d0b81a8ce4b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345, portal: 172.16.0.220,3260]
Nov 15 02:57:04 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345, portal: 172.16.0.220,3260] successful.
Nov 15 02:57:04 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ce793b-ac7b-4ede-9d14-de3c151fe587]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dda34ba-bb51-4e38-9164-2298cb82d849]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:57:04 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:57:04 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:57:04 user nova-compute[75391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)
Nov 15 02:57:04 user nova-compute[75391]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345 (non-flash)
Nov 15 02:57:04 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:57:04 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:57:04 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:57:04 user nova-compute[75391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)
Nov 15 02:57:04 user nova-compute[75391]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345 (non-flash)
Nov 15 02:57:04 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0609dc30-5ea9-40c3-8d88-c3e06c650a05]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KbLzHgNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:57:04 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Instance destroyed successfully.
Nov 15 02:57:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-194df00e-2426-47db-a958-5981a190f9dd req-4db2df53-478c-48eb-8ef0-060e8363b5f6 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Received event network-vif-plugged-45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-194df00e-2426-47db-a958-5981a190f9dd req-4db2df53-478c-48eb-8ef0-060e8363b5f6 service nova] Acquiring lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-194df00e-2426-47db-a958-5981a190f9dd req-4db2df53-478c-48eb-8ef0-060e8363b5f6 service nova] Lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-194df00e-2426-47db-a958-5981a190f9dd req-4db2df53-478c-48eb-8ef0-060e8363b5f6 service nova] Lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-194df00e-2426-47db-a958-5981a190f9dd req-4db2df53-478c-48eb-8ef0-060e8363b5f6 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] No waiting events found dispatching network-vif-plugged-45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:57:05 user nova-compute[75391]: WARNING nova.compute.manager [req-194df00e-2426-47db-a958-5981a190f9dd req-4db2df53-478c-48eb-8ef0-060e8363b5f6 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Received unexpected event network-vif-plugged-45919066-22c9-4df6-b411-e07851e743b6 for instance with vm_state rescued and task_state unrescuing.
Nov 15 02:57:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23462613338633966', 'path': '/dev/sdb'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462613338633966', 'path': '/dev/sdb'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG nova.objects.instance [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lazy-loading 'flavor' on Instance uuid 28a1ec10-2748-4d0c-9b73-9636fc1cc237 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 02:57:05 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:57:05 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 02:57:05 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:57:05 user nova-compute[75391]:   <serial>dae4c60a-3131-4a20-a094-02fc3b33c345</serial>
Nov 15 02:57:05 user nova-compute[75391]: </disk>
Nov 15 02:57:05 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] Acquiring lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] No waiting events found dispatching network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:57:05 user nova-compute[75391]: WARNING nova.compute.manager [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received unexpected event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc for instance with vm_state rescued and task_state unrescuing.
Nov 15 02:57:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] Acquiring lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] No waiting events found dispatching network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:57:05 user nova-compute[75391]: WARNING nova.compute.manager [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received unexpected event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc for instance with vm_state rescued and task_state unrescuing.
Nov 15 02:57:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] Acquiring lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] No waiting events found dispatching network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:57:05 user nova-compute[75391]: WARNING nova.compute.manager [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received unexpected event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc for instance with vm_state rescued and task_state unrescuing.
Nov 15 02:57:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received event network-vif-unplugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] Acquiring lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] No waiting events found dispatching network-vif-unplugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:57:05 user nova-compute[75391]: WARNING nova.compute.manager [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received unexpected event network-vif-unplugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc for instance with vm_state rescued and task_state unrescuing.
Nov 15 02:57:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] Acquiring lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] No waiting events found dispatching network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:57:05 user nova-compute[75391]: WARNING nova.compute.manager [req-62e2c782-3d70-4692-abcc-103435151e80 req-724bf29a-b25b-41d6-bd39-0560fb895507 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received unexpected event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc for instance with vm_state rescued and task_state unrescuing.
Nov 15 02:57:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:57:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] No VIF found with MAC fa:16:3e:ef:5f:d5, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:57:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6e43c4c8-6a31-4b22-ba1e-7759ed6c61b8 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.023s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:57:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0a4ec632-09f4-4f63-8eda-71aa227ad39c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "a0382af0-0509-4473-832f-1e5e6588be2e" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:57:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0a4ec632-09f4-4f63-8eda-71aa227ad39c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "a0382af0-0509-4473-832f-1e5e6588be2e" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:57:06 user nova-compute[75391]: DEBUG nova.compute.manager [None req-0a4ec632-09f4-4f63-8eda-71aa227ad39c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Going to confirm migration 2 {{(pid=75391) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 15 02:57:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0a4ec632-09f4-4f63-8eda-71aa227ad39c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "refresh_cache-a0382af0-0509-4473-832f-1e5e6588be2e" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:57:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0a4ec632-09f4-4f63-8eda-71aa227ad39c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquired lock "refresh_cache-a0382af0-0509-4473-832f-1e5e6588be2e" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:57:06 user nova-compute[75391]: DEBUG nova.network.neutron [None req-0a4ec632-09f4-4f63-8eda-71aa227ad39c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:57:06 user nova-compute[75391]: DEBUG nova.objects.instance [None req-0a4ec632-09f4-4f63-8eda-71aa227ad39c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lazy-loading 'info_cache' on Instance uuid a0382af0-0509-4473-832f-1e5e6588be2e {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:57:06 user nova-compute[75391]: DEBUG nova.network.neutron [None req-0a4ec632-09f4-4f63-8eda-71aa227ad39c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Updating instance_info_cache with network_info: [{"id": "f4cd02a6-d62a-435e-93fd-e5216134f788", "address": "fa:16:3e:af:ba:88", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd02a6-d6", "ovs_interfaceid": "f4cd02a6-d62a-435e-93fd-e5216134f788", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:57:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0a4ec632-09f4-4f63-8eda-71aa227ad39c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Releasing lock "refresh_cache-a0382af0-0509-4473-832f-1e5e6588be2e" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:57:06 user nova-compute[75391]: DEBUG nova.objects.instance [None req-0a4ec632-09f4-4f63-8eda-71aa227ad39c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lazy-loading 'migration_context' on Instance uuid a0382af0-0509-4473-832f-1e5e6588be2e {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:57:06 user nova-compute[75391]: DEBUG nova.objects.base [None req-0a4ec632-09f4-4f63-8eda-71aa227ad39c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Object Instance<a0382af0-0509-4473-832f-1e5e6588be2e> lazy-loaded attributes: info_cache,migration_context {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:57:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0a4ec632-09f4-4f63-8eda-71aa227ad39c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:57:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0a4ec632-09f4-4f63-8eda-71aa227ad39c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:57:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:07 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-0a4ec632-09f4-4f63-8eda-71aa227ad39c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:57:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:07 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-0a4ec632-09f4-4f63-8eda-71aa227ad39c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:57:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-83eb85d9-6a55-4d48-a6d4-a017723abe0d req-cef6da92-8a20-488b-bf4d-e1abccd057a0 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Received event network-vif-plugged-45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:57:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-83eb85d9-6a55-4d48-a6d4-a017723abe0d req-cef6da92-8a20-488b-bf4d-e1abccd057a0 service nova] Acquiring lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:57:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-83eb85d9-6a55-4d48-a6d4-a017723abe0d req-cef6da92-8a20-488b-bf4d-e1abccd057a0 service nova] Lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:57:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-83eb85d9-6a55-4d48-a6d4-a017723abe0d req-cef6da92-8a20-488b-bf4d-e1abccd057a0 service nova] Lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:57:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-83eb85d9-6a55-4d48-a6d4-a017723abe0d req-cef6da92-8a20-488b-bf4d-e1abccd057a0 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] No waiting events found dispatching network-vif-plugged-45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:57:07 user nova-compute[75391]: WARNING nova.compute.manager [req-83eb85d9-6a55-4d48-a6d4-a017723abe0d req-cef6da92-8a20-488b-bf4d-e1abccd057a0 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Received unexpected event network-vif-plugged-45919066-22c9-4df6-b411-e07851e743b6 for instance with vm_state rescued and task_state unrescuing.
Nov 15 02:57:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-83eb85d9-6a55-4d48-a6d4-a017723abe0d req-cef6da92-8a20-488b-bf4d-e1abccd057a0 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Received event network-vif-plugged-45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:57:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-83eb85d9-6a55-4d48-a6d4-a017723abe0d req-cef6da92-8a20-488b-bf4d-e1abccd057a0 service nova] Acquiring lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:57:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-83eb85d9-6a55-4d48-a6d4-a017723abe0d req-cef6da92-8a20-488b-bf4d-e1abccd057a0 service nova] Lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:57:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-83eb85d9-6a55-4d48-a6d4-a017723abe0d req-cef6da92-8a20-488b-bf4d-e1abccd057a0 service nova] Lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:57:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-83eb85d9-6a55-4d48-a6d4-a017723abe0d req-cef6da92-8a20-488b-bf4d-e1abccd057a0 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] No waiting events found dispatching network-vif-plugged-45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:57:07 user nova-compute[75391]: WARNING nova.compute.manager [req-83eb85d9-6a55-4d48-a6d4-a017723abe0d req-cef6da92-8a20-488b-bf4d-e1abccd057a0 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Received unexpected event network-vif-plugged-45919066-22c9-4df6-b411-e07851e743b6 for instance with vm_state rescued and task_state unrescuing.
Nov 15 02:57:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0a4ec632-09f4-4f63-8eda-71aa227ad39c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.489s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:57:07 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-0a4ec632-09f4-4f63-8eda-71aa227ad39c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Deleted allocation for migration deec6e20-7b5f-4f09-8e17-9fbab60c8af8
Nov 15 02:57:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0a4ec632-09f4-4f63-8eda-71aa227ad39c tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "a0382af0-0509-4473-832f-1e5e6588be2e" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.332s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:57:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-7135b332-cc24-4ff9-8726-844af784e036 req-ac736567-9a3c-40cc-86eb-e1babf27bf8d service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:57:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7135b332-cc24-4ff9-8726-844af784e036 req-ac736567-9a3c-40cc-86eb-e1babf27bf8d service nova] Acquiring lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:57:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7135b332-cc24-4ff9-8726-844af784e036 req-ac736567-9a3c-40cc-86eb-e1babf27bf8d service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:57:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7135b332-cc24-4ff9-8726-844af784e036 req-ac736567-9a3c-40cc-86eb-e1babf27bf8d service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:57:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-7135b332-cc24-4ff9-8726-844af784e036 req-ac736567-9a3c-40cc-86eb-e1babf27bf8d service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] No waiting events found dispatching network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:57:07 user nova-compute[75391]: WARNING nova.compute.manager [req-7135b332-cc24-4ff9-8726-844af784e036 req-ac736567-9a3c-40cc-86eb-e1babf27bf8d service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received unexpected event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc for instance with vm_state rescued and task_state unrescuing.
Nov 15 02:57:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-7135b332-cc24-4ff9-8726-844af784e036 req-ac736567-9a3c-40cc-86eb-e1babf27bf8d service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:57:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7135b332-cc24-4ff9-8726-844af784e036 req-ac736567-9a3c-40cc-86eb-e1babf27bf8d service nova] Acquiring lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:57:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7135b332-cc24-4ff9-8726-844af784e036 req-ac736567-9a3c-40cc-86eb-e1babf27bf8d service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:57:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7135b332-cc24-4ff9-8726-844af784e036 req-ac736567-9a3c-40cc-86eb-e1babf27bf8d service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:57:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-7135b332-cc24-4ff9-8726-844af784e036 req-ac736567-9a3c-40cc-86eb-e1babf27bf8d service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] No waiting events found dispatching network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:57:07 user nova-compute[75391]: WARNING nova.compute.manager [req-7135b332-cc24-4ff9-8726-844af784e036 req-ac736567-9a3c-40cc-86eb-e1babf27bf8d service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received unexpected event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc for instance with vm_state rescued and task_state unrescuing.
Nov 15 02:57:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:57:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:57:08 user nova-compute[75391]: INFO nova.compute.manager [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Detaching volume dae4c60a-3131-4a20-a094-02fc3b33c345
Nov 15 02:57:08 user nova-compute[75391]: INFO nova.virt.block_device [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Attempting to driver detach volume dae4c60a-3131-4a20-a094-02fc3b33c345 from mountpoint /dev/vdb
Nov 15 02:57:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Attempting to detach device vdb from instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:57:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:57:08 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:57:08 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 02:57:08 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:57:08 user nova-compute[75391]:   <serial>dae4c60a-3131-4a20-a094-02fc3b33c345</serial>
Nov 15 02:57:08 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:57:08 user nova-compute[75391]: </disk>
Nov 15 02:57:08 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:57:08 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Successfully detached device vdb from instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 from the persistent domain config.
Nov 15 02:57:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 02:57:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:57:08 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:57:08 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 02:57:08 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:57:08 user nova-compute[75391]:   <serial>dae4c60a-3131-4a20-a094-02fc3b33c345</serial>
Nov 15 02:57:08 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:57:08 user nova-compute[75391]: </disk>
Nov 15 02:57:08 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:57:08 user nova-compute[75391]: DEBUG nova.compute.manager [None req-1d400946-1f63-4e6d-9d51-d4983645dfc4 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:57:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 02:57:08 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ebe68943-2134-4fc3-8e4d-574bc40686c0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:57:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:57:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:57:14 user nova-compute[75391]: INFO nova.compute.manager [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Detaching volume 9be06d7a-a1d3-4f22-aa37-0e469ee3008a
Nov 15 02:57:14 user nova-compute[75391]: INFO nova.virt.block_device [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Attempting to driver detach volume 9be06d7a-a1d3-4f22-aa37-0e469ee3008a from mountpoint /dev/vdc
Nov 15 02:57:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Attempting to detach device vdc from instance 341dfd0a-e264-4a6f-9537-35ba9ed980c4 from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:57:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:57:14 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:57:14 user nova-compute[75391]:   <source dev="/dev/sdg"/>
Nov 15 02:57:14 user nova-compute[75391]:   <target dev="vdc" bus="virtio"/>
Nov 15 02:57:14 user nova-compute[75391]:   <serial>9be06d7a-a1d3-4f22-aa37-0e469ee3008a</serial>
Nov 15 02:57:14 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 02:57:14 user nova-compute[75391]: </disk>
Nov 15 02:57:14 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:57:14 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Successfully detached device vdc from instance 341dfd0a-e264-4a6f-9537-35ba9ed980c4 from the persistent domain config.
Nov 15 02:57:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 341dfd0a-e264-4a6f-9537-35ba9ed980c4 from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 02:57:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:57:14 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:57:14 user nova-compute[75391]:   <source dev="/dev/sdg"/>
Nov 15 02:57:14 user nova-compute[75391]:   <target dev="vdc" bus="virtio"/>
Nov 15 02:57:14 user nova-compute[75391]:   <serial>9be06d7a-a1d3-4f22-aa37-0e469ee3008a</serial>
Nov 15 02:57:14 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 02:57:14 user nova-compute[75391]: </disk>
Nov 15 02:57:14 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:57:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 341dfd0a-e264-4a6f-9537-35ba9ed980c4 {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 02:57:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:25 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-12f2027c-ce60-4042-9707-747f4ae5eef9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Acquiring lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:57:25 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-12f2027c-ce60-4042-9707-747f4ae5eef9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:57:25 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-12f2027c-ce60-4042-9707-747f4ae5eef9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Acquiring lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:57:25 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-12f2027c-ce60-4042-9707-747f4ae5eef9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:57:25 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-12f2027c-ce60-4042-9707-747f4ae5eef9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:57:25 user nova-compute[75391]: INFO nova.compute.manager [None req-12f2027c-ce60-4042-9707-747f4ae5eef9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Terminating instance
Nov 15 02:57:25 user nova-compute[75391]: DEBUG nova.compute.manager [None req-12f2027c-ce60-4042-9707-747f4ae5eef9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:57:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:25 user nova-compute[75391]: DEBUG nova.compute.manager [req-54beca1f-b6ad-4cb8-8a7f-dffde8dd51a4 req-08b1e1c8-3843-41c8-8a57-c2e864a9da1d service nova] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Received event network-vif-unplugged-285df593-2636-40a8-a8e8-1e01e84d0c0b {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:57:25 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-54beca1f-b6ad-4cb8-8a7f-dffde8dd51a4 req-08b1e1c8-3843-41c8-8a57-c2e864a9da1d service nova] Acquiring lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:57:25 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-54beca1f-b6ad-4cb8-8a7f-dffde8dd51a4 req-08b1e1c8-3843-41c8-8a57-c2e864a9da1d service nova] Lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:57:25 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-54beca1f-b6ad-4cb8-8a7f-dffde8dd51a4 req-08b1e1c8-3843-41c8-8a57-c2e864a9da1d service nova] Lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:57:25 user nova-compute[75391]: DEBUG nova.compute.manager [req-54beca1f-b6ad-4cb8-8a7f-dffde8dd51a4 req-08b1e1c8-3843-41c8-8a57-c2e864a9da1d service nova] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] No waiting events found dispatching network-vif-unplugged-285df593-2636-40a8-a8e8-1e01e84d0c0b {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:57:25 user nova-compute[75391]: DEBUG nova.compute.manager [req-54beca1f-b6ad-4cb8-8a7f-dffde8dd51a4 req-08b1e1c8-3843-41c8-8a57-c2e864a9da1d service nova] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Received event network-vif-unplugged-285df593-2636-40a8-a8e8-1e01e84d0c0b for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:57:26 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Instance destroyed successfully.
Nov 15 02:57:26 user nova-compute[75391]: DEBUG nova.objects.instance [None req-12f2027c-ce60-4042-9707-747f4ae5eef9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lazy-loading 'resources' on Instance uuid 04dcd079-e89f-401c-a7ae-8af96beb3d6d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:57:26 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-12f2027c-ce60-4042-9707-747f4ae5eef9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:53:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1365258568',display_name='tempest-TestServerVolumeAttachmentScenario-server-1365258568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1365258568',id=33,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6A5pg0RsKEV6XMaGP6LOF1vsDU3VFzTD0LtR24Aa7sLrPs6xC12QkuElfCTEnInkaWfn2SElhRDMc1/0hujZhVM9FVQi8D0b/lRin9PVq0nx6Lctczyq2BTThrDeKa7g==',key_name='tempest-keypair-1854765738',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:53:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='592f722752cf4cc48a70b3227d2ff3ea',ramdisk_id='',reservation_id='r-qtndhl3h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-976815340',owner_user_name='tempest-TestServerVolumeAttachmentScenario-976815340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:53:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f51f562108e4e0a9c2e61d0a0198bd3',uuid=04dcd079-e89f-401c-a7ae-8af96beb3d6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "285df593-2636-40a8-a8e8-1e01e84d0c0b", "address": "fa:16:3e:a9:37:1c", "network": {"id": "b93bc3bd-6927-4924-a435-7d5199e553ad", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-840530940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "592f722752cf4cc48a70b3227d2ff3ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap285df593-26", "ovs_interfaceid": "285df593-2636-40a8-a8e8-1e01e84d0c0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:57:26 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-12f2027c-ce60-4042-9707-747f4ae5eef9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Converting VIF {"id": "285df593-2636-40a8-a8e8-1e01e84d0c0b", "address": "fa:16:3e:a9:37:1c", "network": {"id": "b93bc3bd-6927-4924-a435-7d5199e553ad", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-840530940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "592f722752cf4cc48a70b3227d2ff3ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap285df593-26", "ovs_interfaceid": "285df593-2636-40a8-a8e8-1e01e84d0c0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:57:26 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-12f2027c-ce60-4042-9707-747f4ae5eef9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:37:1c,bridge_name='br-int',has_traffic_filtering=True,id=285df593-2636-40a8-a8e8-1e01e84d0c0b,network=Network(b93bc3bd-6927-4924-a435-7d5199e553ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap285df593-26') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:57:26 user nova-compute[75391]: DEBUG os_vif [None req-12f2027c-ce60-4042-9707-747f4ae5eef9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:37:1c,bridge_name='br-int',has_traffic_filtering=True,id=285df593-2636-40a8-a8e8-1e01e84d0c0b,network=Network(b93bc3bd-6927-4924-a435-7d5199e553ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap285df593-26') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:57:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap285df593-26, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:57:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a2d4f79-3367-43a1-831f-a27177314ace) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:57:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:26 user nova-compute[75391]: INFO os_vif [None req-12f2027c-ce60-4042-9707-747f4ae5eef9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:37:1c,bridge_name='br-int',has_traffic_filtering=True,id=285df593-2636-40a8-a8e8-1e01e84d0c0b,network=Network(b93bc3bd-6927-4924-a435-7d5199e553ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap285df593-26')
Nov 15 02:57:26 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-12f2027c-ce60-4042-9707-747f4ae5eef9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Deleting instance files /opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d_del
Nov 15 02:57:26 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-12f2027c-ce60-4042-9707-747f4ae5eef9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Deletion of /opt/stack/data/nova/instances/04dcd079-e89f-401c-a7ae-8af96beb3d6d_del complete
Nov 15 02:57:26 user nova-compute[75391]: INFO nova.compute.manager [None req-12f2027c-ce60-4042-9707-747f4ae5eef9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 15 02:57:26 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-12f2027c-ce60-4042-9707-747f4ae5eef9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:57:26 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:57:26 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:57:27 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:57:27 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Took 0.83 seconds to deallocate network for instance.
Nov 15 02:57:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-d4cd6572-adfe-43e1-b7cc-48ee3d5d87b6 req-c7b7c2bf-c84a-4d98-aad4-5e535b3962b1 service nova] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Received event network-vif-deleted-285df593-2636-40a8-a8e8-1e01e84d0c0b {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:57:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-12f2027c-ce60-4042-9707-747f4ae5eef9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:57:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-12f2027c-ce60-4042-9707-747f4ae5eef9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:57:27 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-12f2027c-ce60-4042-9707-747f4ae5eef9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:57:27 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-12f2027c-ce60-4042-9707-747f4ae5eef9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:57:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-12f2027c-ce60-4042-9707-747f4ae5eef9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:57:27 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-12f2027c-ce60-4042-9707-747f4ae5eef9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Deleted allocations for instance 04dcd079-e89f-401c-a7ae-8af96beb3d6d
Nov 15 02:57:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-12f2027c-ce60-4042-9707-747f4ae5eef9 tempest-TestServerVolumeAttachmentScenario-976815340 tempest-TestServerVolumeAttachmentScenario-976815340-project-member] Lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.474s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:57:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-fb151b0c-a8b1-48ca-8353-07068addfd1c req-e0a1fc99-4aa2-480d-8b74-a71102696b60 service nova] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Received event network-vif-plugged-285df593-2636-40a8-a8e8-1e01e84d0c0b {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:57:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-fb151b0c-a8b1-48ca-8353-07068addfd1c req-e0a1fc99-4aa2-480d-8b74-a71102696b60 service nova] Acquiring lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:57:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-fb151b0c-a8b1-48ca-8353-07068addfd1c req-e0a1fc99-4aa2-480d-8b74-a71102696b60 service nova] Lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:57:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-fb151b0c-a8b1-48ca-8353-07068addfd1c req-e0a1fc99-4aa2-480d-8b74-a71102696b60 service nova] Lock "04dcd079-e89f-401c-a7ae-8af96beb3d6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:57:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-fb151b0c-a8b1-48ca-8353-07068addfd1c req-e0a1fc99-4aa2-480d-8b74-a71102696b60 service nova] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] No waiting events found dispatching network-vif-plugged-285df593-2636-40a8-a8e8-1e01e84d0c0b {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:57:27 user nova-compute[75391]: WARNING nova.compute.manager [req-fb151b0c-a8b1-48ca-8353-07068addfd1c req-e0a1fc99-4aa2-480d-8b74-a71102696b60 service nova] [instance: 04dcd079-e89f-401c-a7ae-8af96beb3d6d] Received unexpected event network-vif-plugged-285df593-2636-40a8-a8e8-1e01e84d0c0b for instance with vm_state deleted and task_state None.
Nov 15 02:57:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:28 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 is timed out.
Nov 15 02:57:28 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Successfully detached device vdb from instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 from the live domain config.
Nov 15 02:57:28 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:57:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KbLzHgNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:57:28 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:57:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:57:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:57:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45b7542-e3f7-48de-bb6f-728e21b30e75]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:57:29 user nova-compute[75391]: No targets found.
Nov 15 02:57:29 user nova-compute[75391]: iSNS:
Nov 15 02:57:29 user nova-compute[75391]: No targets found.
Nov 15 02:57:29 user nova-compute[75391]: STATIC:
Nov 15 02:57:29 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345
Nov 15 02:57:29 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:57:29 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:57:29 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a
Nov 15 02:57:29 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:57:29 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:57:29 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b
Nov 15 02:57:29 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:57:29 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:57:29 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:57:29 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:57:29 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:57:29 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39
Nov 15 02:57:29 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:57:29 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:57:29 user nova-compute[75391]: FIRMWARE:
Nov 15 02:57:29 user nova-compute[75391]: No targets found.
Nov 15 02:57:29 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:57:29 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:57:29 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a2f7eb-f3bb-446a-855d-247a087c3999]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9cfe76-323b-4b4e-887a-59cd4baecdd0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:57:29 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:57:29 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:57:29 user nova-compute[75391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)
Nov 15 02:57:29 user nova-compute[75391]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345 (non-flash)
Nov 15 02:57:29 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:57:29 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:57:29 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:57:29 user nova-compute[75391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)
Nov 15 02:57:29 user nova-compute[75391]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345 (non-flash)
Nov 15 02:57:29 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f624475b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345'): ({'sdb'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Removing single pathed devices sdb {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6876fa74-8f87-41b3-8722-7abb56cff977]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc122165-87dc-4d58-9a64-2dfbc5679007]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Flushing IO for device /dev/sdb {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a66206-2125-463b-825d-90f1f1897301]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[821cf82f-7763-43bd-a75f-93c0102b667d]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da721b4-8bd5-4710-86e4-cd1e01540f62]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[37819a0c-1238-4b77-aafb-1a3b0342debb]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345, portal: 172.16.0.220,3260]
Nov 15 02:57:29 user nova-compute[75391]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345, portal: 172.16.0.220,3260] successful.
Nov 15 02:57:29 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dae4c60a-3131-4a20-a094-02fc3b33c345 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f212dc-8cc8-4efa-87c8-67eee79c270a]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] <== disconnect_volume: return (312ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:57:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:57:30 user nova-compute[75391]: DEBUG nova.objects.instance [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lazy-loading 'flavor' on Instance uuid 28a1ec10-2748-4d0c-9b73-9636fc1cc237 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:57:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7e93ebb7-7b91-4d1e-abce-022336bd03ef tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.615s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:57:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:34 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 341dfd0a-e264-4a6f-9537-35ba9ed980c4 is timed out.
Nov 15 02:57:34 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Successfully detached device vdc from instance 341dfd0a-e264-4a6f-9537-35ba9ed980c4 from the live domain config.
Nov 15 02:57:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRoeVGBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:57:34 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:57:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[934bd2f2-f6b8-4d29-9f91-78207c313f8d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:57:34 user nova-compute[75391]: No targets found.
Nov 15 02:57:34 user nova-compute[75391]: iSNS:
Nov 15 02:57:34 user nova-compute[75391]: No targets found.
Nov 15 02:57:34 user nova-compute[75391]: STATIC:
Nov 15 02:57:34 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a
Nov 15 02:57:34 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:57:34 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:57:34 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b
Nov 15 02:57:34 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:57:34 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:57:34 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:57:34 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:57:34 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:57:34 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39
Nov 15 02:57:34 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:57:34 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:57:34 user nova-compute[75391]: FIRMWARE:
Nov 15 02:57:34 user nova-compute[75391]: No targets found.
Nov 15 02:57:34 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:57:34 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:57:34 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[de137053-0977-43de-8abd-2db71143e57d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a052ce2-ce5b-4e27-afcf-88041c7559b2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:57:34 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:57:34 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:57:34 user nova-compute[75391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)
Nov 15 02:57:34 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:57:34 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:57:34 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:57:34 user nova-compute[75391]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a (non-flash)
Nov 15 02:57:34 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f622446f760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a'): ({'sdg'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Removing single pathed devices sdg {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ece9f0-208e-436e-bdce-0e1412015872]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e30409-bccd-4b76-95ad-08b4e54ca450]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Flushing IO for device /dev/sdg {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae4a435-357f-4d15-8d09-2360937541a2]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62dbeea-a951-423a-bd31-1ae232a227d9]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] SCSI volumes sdg have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4243e02b-a5a9-412d-930d-aabbfc8ab160]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[734d5cac-5bc3-4bda-809c-26e665d75670]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a, portal: 172.16.0.220,3260]
Nov 15 02:57:34 user nova-compute[75391]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a, portal: 172.16.0.220,3260] successful.
Nov 15 02:57:34 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be06d7a-a1d3-4f22-aa37-0e469ee3008a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d9a9b5-553f-4022-8d80-b278d0899eff]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] <== disconnect_volume: return (308ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:57:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:57:35 user nova-compute[75391]: DEBUG nova.objects.instance [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lazy-loading 'flavor' on Instance uuid 341dfd0a-e264-4a6f-9537-35ba9ed980c4 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:57:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-d09979f3-dfc8-49dc-8778-f5f8068a9bd6 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.669s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:57:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:42 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:57:42 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 02:57:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:57:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 02:57:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:57:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:57:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:52 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:57:52 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:57:53 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:57:53 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:57:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-9909ae6b-7900-4f71-8900-2bf25185e436" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:57:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-9909ae6b-7900-4f71-8900-2bf25185e436" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:57:53 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 02:57:54 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Updating instance_info_cache with network_info: [{"id": "45919066-22c9-4df6-b411-e07851e743b6", "address": "fa:16:3e:86:62:a8", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45919066-22", "ovs_interfaceid": "45919066-22c9-4df6-b411-e07851e743b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:57:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-9909ae6b-7900-4f71-8900-2bf25185e436" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:57:54 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 02:57:55 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:57:55 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:57:55 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Cleaning up deleted instances {{(pid=75391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 02:57:55 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] There are 0 instances to clean {{(pid=75391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 02:57:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:57:56 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:57:56 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:57:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:57:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:57:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:57:56 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:57:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62a403f1-f50a-45dc-b194-4cd74570f2e9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62a403f1-f50a-45dc-b194-4cd74570f2e9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62a403f1-f50a-45dc-b194-4cd74570f2e9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62a403f1-f50a-45dc-b194-4cd74570f2e9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:57:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:57:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:57:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:57:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:58:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:00 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:58:00 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:58:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=7443MB free_disk=24.835887908935547GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:58:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:00 user nova-compute[75391]: DEBUG nova.objects.instance [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lazy-loading 'flavor' on Instance uuid 28a1ec10-2748-4d0c-9b73-9636fc1cc237 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:58:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9744c8a1-046e-4a00-92e0-92ebb3275ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:58:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance fc9484c0-9083-4797-8ab1-2ad392822ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:58:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6400a5f3-0ec9-4484-930c-1f5061ae5374 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:58:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance d36e2f64-11cb-4b35-8471-9a4df7f4c227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:58:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9909ae6b-7900-4f71-8900-2bf25185e436 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:58:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 7bd332f2-0f74-4a43-96a2-2322b6cbf982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:58:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:58:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance c767fb74-e57f-4ea0-bf4e-4034cf656a78 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:58:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance a0382af0-0509-4473-832f-1e5e6588be2e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:58:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 341dfd0a-e264-4a6f-9537-35ba9ed980c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:58:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 62a403f1-f50a-45dc-b194-4cd74570f2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:58:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:58:00 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:58:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:00 user nova-compute[75391]: INFO nova.compute.manager [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Attaching volume 93d337cc-75bb-4c7c-8295-dc59d147103b to /dev/vdb
Nov 15 02:58:01 user nova-compute[75391]: DEBUG os_brick.utils [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:58:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1f70e9-82a4-4349-90c8-eba9646523c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28bde42-b319-43cc-abbf-a5e5d618eb34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[921ed566-e847-4090-aa6b-e04281f3c2e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0275358b-2aa8-4d85-99d8-9c694e2c2bb6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:58:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:58:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:58:01 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:58:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1622a82f-3897-4db7-ad98-80a6db878d12]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:58:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:58:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:58:01 user nova-compute[75391]: DEBUG os_brick.utils [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:58:01 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Updating existing volume attachment record: dc2097c1-3046-4298-a8ef-844434100fcc {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:58:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:58:01 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:58:01 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:58:01 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:58:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.545s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:04 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:58:04 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:58:04 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:58:04 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:58:04 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:58:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:04 user nova-compute[75391]: INFO nova.compute.manager [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Terminating instance
Nov 15 02:58:04 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:58:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-ecdb8d71-ce00-46ab-ab5a-a24412e85610 req-1a3d12a8-9b85-4708-be02-7d91e2f3a597 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Received event network-vif-unplugged-f81de438-c24a-4cc9-93ab-508fea76d915 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:58:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ecdb8d71-ce00-46ab-ab5a-a24412e85610 req-1a3d12a8-9b85-4708-be02-7d91e2f3a597 service nova] Acquiring lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ecdb8d71-ce00-46ab-ab5a-a24412e85610 req-1a3d12a8-9b85-4708-be02-7d91e2f3a597 service nova] Lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ecdb8d71-ce00-46ab-ab5a-a24412e85610 req-1a3d12a8-9b85-4708-be02-7d91e2f3a597 service nova] Lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-ecdb8d71-ce00-46ab-ab5a-a24412e85610 req-1a3d12a8-9b85-4708-be02-7d91e2f3a597 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] No waiting events found dispatching network-vif-unplugged-f81de438-c24a-4cc9-93ab-508fea76d915 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:58:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-ecdb8d71-ce00-46ab-ab5a-a24412e85610 req-1a3d12a8-9b85-4708-be02-7d91e2f3a597 service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Received event network-vif-unplugged-f81de438-c24a-4cc9-93ab-508fea76d915 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:58:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:05 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Instance destroyed successfully.
Nov 15 02:58:05 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lazy-loading 'resources' on Instance uuid 341dfd0a-e264-4a6f-9537-35ba9ed980c4 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T02:51:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1537643616',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1537643616',id=29,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCu4IfiOZPm3KyuOaYSN4M4+7uOjK/OnaZ7mhQIa6lz/tRN9r5cdTcBKJ4tzvISaaZiS/s0sLlyzlSseEUIXJd+JaUm/xpbxsb+yeAKpEvDCq1oFjmVIJOgsVJAbcyB/w==',key_name='tempest-keypair-1968484645',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:55:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1ec3021653b4209a509852c7a28bf46',ramdisk_id='',reservation_id='r-mwaawx6j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1315675398',owner_user_name='tempest-AttachVolumeShelveTestJSON-1315675398-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:55:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e55cae841f994756843bc97a063ebe86',uuid=341dfd0a-e264-4a6f-9537-35ba9ed980c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f81de438-c24a-4cc9-93ab-508fea76d915", "address": "fa:16:3e:47:1f:19", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81de438-c2", "ovs_interfaceid": "f81de438-c24a-4cc9-93ab-508fea76d915", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Converting VIF {"id": "f81de438-c24a-4cc9-93ab-508fea76d915", "address": "fa:16:3e:47:1f:19", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81de438-c2", "ovs_interfaceid": "f81de438-c24a-4cc9-93ab-508fea76d915", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:1f:19,bridge_name='br-int',has_traffic_filtering=True,id=f81de438-c24a-4cc9-93ab-508fea76d915,network=Network(64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf81de438-c2') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG os_vif [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:1f:19,bridge_name='br-int',has_traffic_filtering=True,id=f81de438-c24a-4cc9-93ab-508fea76d915,network=Network(64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf81de438-c2') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf81de438-c2, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0568f547-2c82-41e2-b408-3856ba0008e8) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:05 user nova-compute[75391]: INFO os_vif [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:1f:19,bridge_name='br-int',has_traffic_filtering=True,id=f81de438-c24a-4cc9-93ab-508fea76d915,network=Network(64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf81de438-c2')
Nov 15 02:58:05 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Deleting instance files /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4_del
Nov 15 02:58:05 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Deletion of /opt/stack/data/nova/instances/341dfd0a-e264-4a6f-9537-35ba9ed980c4_del complete
Nov 15 02:58:05 user nova-compute[75391]: INFO nova.compute.manager [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 02:58:05 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FUXKjCsr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:58:05 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:58:05 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:58:05 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:58:05 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:58:05 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:58:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[368650d9-06b8-4f90-b03d-6e4551d68a08]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:58:05 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d566c181-152a-481b-901a-c01ce475ef07]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b] added
Nov 15 02:58:05 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7ccb64-7969-4a6e-8a4d-d76f74aad29b]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:05 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Took 0.65 seconds to deallocate network for instance.
Nov 15 02:58:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d1903c-6b8a-4fde-946c-9f1e82b99523]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:05 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FUXKjCsr {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FUXKjCsr" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6b79fb-aee7-493f-a8b7-e7c7cdbc6698]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FUXKjCsr'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae1eeb1-6093-4103-863c-2b8872a644b2]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51d5a73-c8b7-433f-ad90-436d57df0596]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:58:06 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:58:06 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:58:06 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:58:06 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:58:06 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:58:06 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b512da-aed7-416f-a551-4ee358b079d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b, portal: 172.16.0.220,3260]
Nov 15 02:58:06 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b, portal: 172.16.0.220,3260] successful.
Nov 15 02:58:06 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ce1fb2-31f9-434f-9229-55402a9ab1a8]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e2ae07-67c6-412c-b52b-446683c37d5c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:58:06 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:58:06 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:58:06 user nova-compute[75391]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b (non-flash)
Nov 15 02:58:06 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:58:06 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:58:06 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:58:06 user nova-compute[75391]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b (non-flash)
Nov 15 02:58:06 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Refreshing inventories for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab9ac4b-0205-43cc-a261-1e27d89cae14]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FUXKjCsr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Updating ProviderTree inventory for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Updating inventory in ProviderTree for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Refreshing aggregate associations for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e, aggregates: None {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Refreshing trait associations for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.621s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:06 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Deleted allocations for instance 341dfd0a-e264-4a6f-9537-35ba9ed980c4
Nov 15 02:58:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9500bb98-062e-45bf-86a9-d96723152b72 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.335s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG nova.compute.manager [req-b5960f8e-a9ae-492b-8337-4ab608c621aa req-d0180b7d-01ce-4e01-acf8-83e8fdb7589c service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Received event network-vif-plugged-f81de438-c24a-4cc9-93ab-508fea76d915 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b5960f8e-a9ae-492b-8337-4ab608c621aa req-d0180b7d-01ce-4e01-acf8-83e8fdb7589c service nova] Acquiring lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b5960f8e-a9ae-492b-8337-4ab608c621aa req-d0180b7d-01ce-4e01-acf8-83e8fdb7589c service nova] Lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b5960f8e-a9ae-492b-8337-4ab608c621aa req-d0180b7d-01ce-4e01-acf8-83e8fdb7589c service nova] Lock "341dfd0a-e264-4a6f-9537-35ba9ed980c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:06 user nova-compute[75391]: DEBUG nova.compute.manager [req-b5960f8e-a9ae-492b-8337-4ab608c621aa req-d0180b7d-01ce-4e01-acf8-83e8fdb7589c service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] No waiting events found dispatching network-vif-plugged-f81de438-c24a-4cc9-93ab-508fea76d915 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:58:06 user nova-compute[75391]: WARNING nova.compute.manager [req-b5960f8e-a9ae-492b-8337-4ab608c621aa req-d0180b7d-01ce-4e01-acf8-83e8fdb7589c service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Received unexpected event network-vif-plugged-f81de438-c24a-4cc9-93ab-508fea76d915 for instance with vm_state deleted and task_state None.
Nov 15 02:58:06 user nova-compute[75391]: DEBUG nova.compute.manager [req-b5960f8e-a9ae-492b-8337-4ab608c621aa req-d0180b7d-01ce-4e01-acf8-83e8fdb7589c service nova] [instance: 341dfd0a-e264-4a6f-9537-35ba9ed980c4] Received event network-vif-deleted-f81de438-c24a-4cc9-93ab-508fea76d915 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:58:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:58:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23236356438626164', 'path': '/dev/sdb'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:58:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236356438626164', 'path': '/dev/sdb'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:58:07 user nova-compute[75391]: DEBUG nova.objects.instance [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lazy-loading 'flavor' on Instance uuid 28a1ec10-2748-4d0c-9b73-9636fc1cc237 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:58:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 02:58:07 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:58:07 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 02:58:07 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:58:07 user nova-compute[75391]:   <serial>93d337cc-75bb-4c7c-8295-dc59d147103b</serial>
Nov 15 02:58:07 user nova-compute[75391]: </disk>
Nov 15 02:58:07 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:58:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:58:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:58:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] No VIF found with MAC fa:16:3e:ef:5f:d5, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:58:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-23529d56-c091-42f6-b468-a2f0004765bc tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.846s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:09 user nova-compute[75391]: INFO nova.compute.manager [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Detaching volume 93d337cc-75bb-4c7c-8295-dc59d147103b
Nov 15 02:58:10 user nova-compute[75391]: INFO nova.virt.block_device [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Attempting to driver detach volume 93d337cc-75bb-4c7c-8295-dc59d147103b from mountpoint /dev/vdb
Nov 15 02:58:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Attempting to detach device vdb from instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:58:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:58:10 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:58:10 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 02:58:10 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:58:10 user nova-compute[75391]:   <serial>93d337cc-75bb-4c7c-8295-dc59d147103b</serial>
Nov 15 02:58:10 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:58:10 user nova-compute[75391]: </disk>
Nov 15 02:58:10 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:58:10 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Successfully detached device vdb from instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 from the persistent domain config.
Nov 15 02:58:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 02:58:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:58:10 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:58:10 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 02:58:10 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:58:10 user nova-compute[75391]:   <serial>93d337cc-75bb-4c7c-8295-dc59d147103b</serial>
Nov 15 02:58:10 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:58:10 user nova-compute[75391]: </disk>
Nov 15 02:58:10 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:58:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 02:58:11 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:58:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:58:21 user nova-compute[75391]: DEBUG nova.compute.manager [req-e3f85956-14bb-47fe-a10f-467d5f12beb4 req-591c14e1-a0cb-495a-9b8e-f0cab772d834 service nova] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Received event network-changed-fc4d7e54-3e1e-4439-b78a-a542d743cbc6 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:58:21 user nova-compute[75391]: DEBUG nova.compute.manager [req-e3f85956-14bb-47fe-a10f-467d5f12beb4 req-591c14e1-a0cb-495a-9b8e-f0cab772d834 service nova] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Refreshing instance network info cache due to event network-changed-fc4d7e54-3e1e-4439-b78a-a542d743cbc6. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:58:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e3f85956-14bb-47fe-a10f-467d5f12beb4 req-591c14e1-a0cb-495a-9b8e-f0cab772d834 service nova] Acquiring lock "refresh_cache-62a403f1-f50a-45dc-b194-4cd74570f2e9" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:58:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e3f85956-14bb-47fe-a10f-467d5f12beb4 req-591c14e1-a0cb-495a-9b8e-f0cab772d834 service nova] Acquired lock "refresh_cache-62a403f1-f50a-45dc-b194-4cd74570f2e9" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:58:21 user nova-compute[75391]: DEBUG nova.network.neutron [req-e3f85956-14bb-47fe-a10f-467d5f12beb4 req-591c14e1-a0cb-495a-9b8e-f0cab772d834 service nova] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Refreshing network info cache for port fc4d7e54-3e1e-4439-b78a-a542d743cbc6 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:58:22 user nova-compute[75391]: DEBUG nova.network.neutron [req-e3f85956-14bb-47fe-a10f-467d5f12beb4 req-591c14e1-a0cb-495a-9b8e-f0cab772d834 service nova] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Updated VIF entry in instance network info cache for port fc4d7e54-3e1e-4439-b78a-a542d743cbc6. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:58:22 user nova-compute[75391]: DEBUG nova.network.neutron [req-e3f85956-14bb-47fe-a10f-467d5f12beb4 req-591c14e1-a0cb-495a-9b8e-f0cab772d834 service nova] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Updating instance_info_cache with network_info: [{"id": "fc4d7e54-3e1e-4439-b78a-a542d743cbc6", "address": "fa:16:3e:bd:e8:68", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4d7e54-3e", "ovs_interfaceid": "fc4d7e54-3e1e-4439-b78a-a542d743cbc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:58:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e3f85956-14bb-47fe-a10f-467d5f12beb4 req-591c14e1-a0cb-495a-9b8e-f0cab772d834 service nova] Releasing lock "refresh_cache-62a403f1-f50a-45dc-b194-4cd74570f2e9" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:58:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "62a403f1-f50a-45dc-b194-4cd74570f2e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "62a403f1-f50a-45dc-b194-4cd74570f2e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:22 user nova-compute[75391]: DEBUG nova.objects.instance [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'flavor' on Instance uuid 62a403f1-f50a-45dc-b194-4cd74570f2e9 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:58:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "62a403f1-f50a-45dc-b194-4cd74570f2e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "62a403f1-f50a-45dc-b194-4cd74570f2e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "62a403f1-f50a-45dc-b194-4cd74570f2e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:23 user nova-compute[75391]: INFO nova.compute.manager [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Attaching volume 62dd09ab-b036-44b8-9427-9871379fa019 to /dev/vdb
Nov 15 02:58:23 user nova-compute[75391]: DEBUG os_brick.utils [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:58:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[62211479-efeb-4b6e-a2fa-3e1631d3225d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5faf523a-be20-4a55-bbfe-23562793049d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fa9376-dc72-4cc8-8b9b-409a3bdac2f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1e66f9-1527-4571-bf24-66d9fb2a5b3d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:58:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:58:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:58:23 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:58:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcba390-66cc-4e08-969d-a9474af25559]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:58:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:58:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:58:23 user nova-compute[75391]: DEBUG os_brick.utils [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:58:23 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Updating existing volume attachment record: e2eeccc6-d6b5-4375-b4ce-086be9e0db21 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:58:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jbVwdalv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:58:28 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:58:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:58:28 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:58:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:58:28 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d52936-87b9-43dc-8d57-ad0274b9bb0e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:58:28 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8fd42b-5e64-47de-9072-b7b03b766ec1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019] added
Nov 15 02:58:28 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdf4064-cec6-49aa-b69a-d56f9a6b4a08]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[961a6efb-6637-4b8e-8d1c-5679d0b0f715]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jbVwdalv {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jbVwdalv" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[216bf40a-2ca1-4a7d-a01e-6d63be4f0669]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jbVwdalv'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[366b5656-98fc-4326-bf44-1e8f52b2bc29]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3708839c-a1c0-4cf9-9a67-6d74992c90f2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:58:28 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:58:28 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:58:28 user nova-compute[75391]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b (non-flash)
Nov 15 02:58:28 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:58:28 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:58:28 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:58:28 user nova-compute[75391]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b (non-flash)
Nov 15 02:58:28 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4529b45f-c5c1-41fc-8122-b91aee13ea1c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019, portal: 172.16.0.220,3260]
Nov 15 02:58:28 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019, portal: 172.16.0.220,3260] successful.
Nov 15 02:58:28 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7ecc35-c771-42db-871b-55054d0d37a4]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab8653a-9777-4255-aec1-df0616bcbff8]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:58:28 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:58:28 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:58:28 user nova-compute[75391]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b (non-flash)
Nov 15 02:58:28 user nova-compute[75391]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 (non-flash)
Nov 15 02:58:28 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:58:28 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:58:28 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:58:28 user nova-compute[75391]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b (non-flash)
Nov 15 02:58:28 user nova-compute[75391]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 (non-flash)
Nov 15 02:58:28 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] HCTL ('36', '-', '-', 0) found on session 48 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b938e423-4ed2-470f-8318-6ebd6b5fd0f5]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jbVwdalv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:58:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:58:29 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '26439323835633138', 'path': '/dev/sde'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:58:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439323835633138', 'path': '/dev/sde'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:58:29 user nova-compute[75391]: DEBUG nova.objects.instance [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'flavor' on Instance uuid 62a403f1-f50a-45dc-b194-4cd74570f2e9 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:58:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 02:58:29 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:58:29 user nova-compute[75391]:   <source dev="/dev/sde"/>
Nov 15 02:58:29 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:58:29 user nova-compute[75391]:   <serial>62dd09ab-b036-44b8-9427-9871379fa019</serial>
Nov 15 02:58:29 user nova-compute[75391]: </disk>
Nov 15 02:58:29 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:58:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:58:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:58:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] No VIF found with MAC fa:16:3e:bd:e8:68, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-17b98b41-7c67-426d-b07f-d34c42c82763 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "62a403f1-f50a-45dc-b194-4cd74570f2e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.972s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:30 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 is timed out.
Nov 15 02:58:30 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Successfully detached device vdb from instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 from the live domain config.
Nov 15 02:58:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FUXKjCsr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:58:30 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:58:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[503c6fea-fdbf-4713-9b7c-ea7c8dfd0ab2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:58:30 user nova-compute[75391]: No targets found.
Nov 15 02:58:30 user nova-compute[75391]: iSNS:
Nov 15 02:58:30 user nova-compute[75391]: No targets found.
Nov 15 02:58:30 user nova-compute[75391]: STATIC:
Nov 15 02:58:30 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b
Nov 15 02:58:30 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:58:30 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:58:30 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b
Nov 15 02:58:30 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:58:30 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:58:30 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:58:30 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:58:30 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:58:30 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019
Nov 15 02:58:30 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:58:30 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:58:30 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39
Nov 15 02:58:30 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:58:30 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:58:30 user nova-compute[75391]: FIRMWARE:
Nov 15 02:58:30 user nova-compute[75391]: No targets found.
Nov 15 02:58:30 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:58:30 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:58:30 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[341580cf-73ce-4a09-b758-22190fa5dcd2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4be07ce-f140-43b9-ba72-640d29e04b71]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:58:30 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:58:30 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:58:30 user nova-compute[75391]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b (non-flash)
Nov 15 02:58:30 user nova-compute[75391]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 (non-flash)
Nov 15 02:58:30 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:58:30 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:58:30 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:58:30 user nova-compute[75391]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b (non-flash)
Nov 15 02:58:30 user nova-compute[75391]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 (non-flash)
Nov 15 02:58:30 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f623c13a3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b'): ({'sdb'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Removing single pathed devices sdb {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8301243-c1d9-48ed-8e73-4fbf9a814feb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[496e36be-2130-4627-bc27-150f1490e90e]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Flushing IO for device /dev/sdb {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a99ff97-3fc4-4876-bf6e-65e8dd11acf8]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[75527094-b3f2-425a-bccb-a5da5af21f9e]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4c3980-86a8-4871-8141-b172b0676fb9]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ade6426-4602-43bf-bd13-1f342912921d]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b, portal: 172.16.0.220,3260]
Nov 15 02:58:30 user nova-compute[75391]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b, portal: 172.16.0.220,3260] successful.
Nov 15 02:58:30 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d337cc-75bb-4c7c-8295-dc59d147103b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d22e7d-addf-41c3-81c7-7b898956d7be]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] <== disconnect_volume: return (329ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:58:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:58:31 user nova-compute[75391]: DEBUG nova.objects.instance [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lazy-loading 'flavor' on Instance uuid 28a1ec10-2748-4d0c-9b73-9636fc1cc237 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:58:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a023a359-acfd-426b-8b50-4223d9ab6f34 tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.749s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "62a403f1-f50a-45dc-b194-4cd74570f2e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "62a403f1-f50a-45dc-b194-4cd74570f2e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:32 user nova-compute[75391]: DEBUG nova.objects.instance [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'flavor' on Instance uuid 62a403f1-f50a-45dc-b194-4cd74570f2e9 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:58:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "62a403f1-f50a-45dc-b194-4cd74570f2e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "62a403f1-f50a-45dc-b194-4cd74570f2e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "62a403f1-f50a-45dc-b194-4cd74570f2e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:32 user nova-compute[75391]: INFO nova.compute.manager [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Attaching volume 853bae87-d0c3-4e8f-b2c9-6b0890555da2 to /dev/vdc
Nov 15 02:58:32 user nova-compute[75391]: DEBUG os_brick.utils [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:58:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:32 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[36df66fd-889d-4a86-beee-c17ed3b2922a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:32 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[576504fb-799e-4e0f-8305-17dda6453bed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:32 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc74c2dd-667a-4ddd-865a-a5c2061c3d52]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:32 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f25966-2707-40cf-bc6e-7fe0a998382b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:58:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:58:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:58:32 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:58:32 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2c227d-a4a8-4e0f-ba3f-fb05adecb9d5]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:58:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:58:32 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:58:32 user nova-compute[75391]: DEBUG os_brick.utils [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:58:32 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Updating existing volume attachment record: 5e1db865-bf69-4463-a41f-596062361ef1 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:58:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:37 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:58:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CewUvgdY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:58:37 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:58:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:58:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:58:37 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:58:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:58:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:58:37 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:58:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:37 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[47036384-80ea-4a60-b28b-bfb264bd6589]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:58:37 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:37 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e80ece5-9cba-4793-8941-195001f41880]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2] added
Nov 15 02:58:37 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:37 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff10be3-4713-4b35-a925-1c7c8e8b6f32]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:37 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1290dcf5-9eee-4efb-b42a-589bcbf0893e]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CewUvgdY {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CewUvgdY" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:37 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b345c00-231d-4fd1-b3d8-35e598f0dde5]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CewUvgdY'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:37 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bd30eb-ae6d-4d55-9937-d72ccc0da3b8]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3684f38d-0277-4214-9c6d-63ef5cbe7850]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:58:38 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:58:38 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:58:38 user nova-compute[75391]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 (non-flash)
Nov 15 02:58:38 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:58:38 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:58:38 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:58:38 user nova-compute[75391]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 (non-flash)
Nov 15 02:58:38 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d90b98-f2fa-4262-98ff-41e9815c1a06]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2, portal: 172.16.0.220,3260]
Nov 15 02:58:38 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2, portal: 172.16.0.220,3260] successful.
Nov 15 02:58:38 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0160025b-cd35-43ad-b663-79af7b880524]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[270014e0-abdd-4382-8f19-4f2e56576575]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:58:38 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:58:38 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:58:38 user nova-compute[75391]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 (non-flash)
Nov 15 02:58:38 user nova-compute[75391]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 (non-flash)
Nov 15 02:58:38 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:58:38 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:58:38 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:58:38 user nova-compute[75391]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 (non-flash)
Nov 15 02:58:38 user nova-compute[75391]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 (non-flash)
Nov 15 02:58:38 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d20ae2-9e58-4e80-a391-a08d98190771]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CewUvgdY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Acquiring lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:38 user nova-compute[75391]: INFO nova.compute.manager [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Unshelving
Nov 15 02:58:38 user nova-compute[75391]: INFO nova.virt.block_device [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Booting with volume b3d6140d-7f68-4811-a988-350366cf0281 at /dev/vda
Nov 15 02:58:38 user nova-compute[75391]: DEBUG os_brick.utils [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d888afa3-cd14-4381-97a3-cd05d6b57f1d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[675bc1b5-bf44-4e12-bde7-c8f35f134c87]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[072bbec2-f5b3-4637-bbee-64a3ae71e30c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ff7a66-d874-4453-9d12-1c5e867963e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:58:38 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:58:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6204da-2749-45f1-a069-ba5123da9820]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG os_brick.utils [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Updating existing volume attachment record: 946a37b0-f544-47a9-ba41-13267cb17177 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:58:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:58:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26538383134663038', 'path': '/dev/sdb'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:58:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538383134663038', 'path': '/dev/sdb'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:58:39 user nova-compute[75391]: DEBUG nova.objects.instance [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'flavor' on Instance uuid 62a403f1-f50a-45dc-b194-4cd74570f2e9 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:58:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 02:58:39 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:58:39 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 02:58:39 user nova-compute[75391]:   <target dev="vdc" bus="virtio"/>
Nov 15 02:58:39 user nova-compute[75391]:   <serial>853bae87-d0c3-4e8f-b2c9-6b0890555da2</serial>
Nov 15 02:58:39 user nova-compute[75391]: </disk>
Nov 15 02:58:39 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:58:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:58:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:58:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:58:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] No VIF found with MAC fa:16:3e:bd:e8:68, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:58:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-11354ccd-75cd-4a7b-b6a8-8266288e7f24 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "62a403f1-f50a-45dc-b194-4cd74570f2e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.318s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:40 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "62a403f1-f50a-45dc-b194-4cd74570f2e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "62a403f1-f50a-45dc-b194-4cd74570f2e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:40 user nova-compute[75391]: INFO nova.compute.manager [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Detaching volume 62dd09ab-b036-44b8-9427-9871379fa019
Nov 15 02:58:40 user nova-compute[75391]: INFO nova.virt.block_device [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Attempting to driver detach volume 62dd09ab-b036-44b8-9427-9871379fa019 from mountpoint /dev/vdb
Nov 15 02:58:40 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Attempting to detach device vdb from instance 62a403f1-f50a-45dc-b194-4cd74570f2e9 from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:58:40 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:58:40 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:58:40 user nova-compute[75391]:   <source dev="/dev/sde"/>
Nov 15 02:58:40 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:58:40 user nova-compute[75391]:   <serial>62dd09ab-b036-44b8-9427-9871379fa019</serial>
Nov 15 02:58:40 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:58:40 user nova-compute[75391]: </disk>
Nov 15 02:58:40 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:58:40 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Successfully detached device vdb from instance 62a403f1-f50a-45dc-b194-4cd74570f2e9 from the persistent domain config.
Nov 15 02:58:40 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 62a403f1-f50a-45dc-b194-4cd74570f2e9 from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 02:58:40 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:58:40 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:58:40 user nova-compute[75391]:   <source dev="/dev/sde"/>
Nov 15 02:58:40 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:58:40 user nova-compute[75391]:   <serial>62dd09ab-b036-44b8-9427-9871379fa019</serial>
Nov 15 02:58:40 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:58:40 user nova-compute[75391]: </disk>
Nov 15 02:58:40 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:58:41 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 62a403f1-f50a-45dc-b194-4cd74570f2e9 {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 02:58:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:43 user nova-compute[75391]: DEBUG nova.objects.instance [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lazy-loading 'pci_requests' on Instance uuid 991177b1-d6a7-41a7-b9fa-f08d04fa57c6 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:58:43 user nova-compute[75391]: DEBUG nova.objects.instance [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lazy-loading 'numa_topology' on Instance uuid 991177b1-d6a7-41a7-b9fa-f08d04fa57c6 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:58:43 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:58:43 user nova-compute[75391]: INFO nova.compute.claims [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Claim successful on node user
Nov 15 02:58:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:44 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:58:44 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:58:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:44 user nova-compute[75391]: INFO nova.network.neutron [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Updating port 5af75008-fab4-4b58-b936-3d35fdcc8199 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 02:58:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Acquiring lock "refresh_cache-991177b1-d6a7-41a7-b9fa-f08d04fa57c6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:58:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Acquired lock "refresh_cache-991177b1-d6a7-41a7-b9fa-f08d04fa57c6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:58:44 user nova-compute[75391]: DEBUG nova.network.neutron [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:58:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-9b29656d-5205-4510-adaf-e2abc1bc9be8 req-f2eed7ac-00e0-4c83-bf53-0727334bd5bf service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Received event network-changed-5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:58:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-9b29656d-5205-4510-adaf-e2abc1bc9be8 req-f2eed7ac-00e0-4c83-bf53-0727334bd5bf service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Refreshing instance network info cache due to event network-changed-5af75008-fab4-4b58-b936-3d35fdcc8199. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:58:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9b29656d-5205-4510-adaf-e2abc1bc9be8 req-f2eed7ac-00e0-4c83-bf53-0727334bd5bf service nova] Acquiring lock "refresh_cache-991177b1-d6a7-41a7-b9fa-f08d04fa57c6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG nova.network.neutron [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Updating instance_info_cache with network_info: [{"id": "5af75008-fab4-4b58-b936-3d35fdcc8199", "address": "fa:16:3e:20:f9:b0", "network": {"id": "525ff764-45a1-4e28-9a54-09f11b8e8a7d", "bridge": "br-int", "label": "tempest-TestShelveInstance-931031505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3451824ac0cb4f32a4882218fa8e63ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af75008-fa", "ovs_interfaceid": "5af75008-fab4-4b58-b936-3d35fdcc8199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Releasing lock "refresh_cache-991177b1-d6a7-41a7-b9fa-f08d04fa57c6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:58:45 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Creating image(s)
Nov 15 02:58:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Did not create local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Ensure instance console log exists: /opt/stack/data/nova/instances/991177b1-d6a7-41a7-b9fa-f08d04fa57c6/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Start _get_guest_xml network_info=[{"id": "5af75008-fab4-4b58-b936-3d35fdcc8199", "address": "fa:16:3e:20:f9:b0", "network": {"id": "525ff764-45a1-4e28-9a54-09f11b8e8a7d", "bridge": "br-int", "label": "tempest-TestShelveInstance-931031505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3451824ac0cb4f32a4882218fa8e63ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af75008-fa", "ovs_interfaceid": "5af75008-fab4-4b58-b936-3d35fdcc8199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '946a37b0-f544-47a9-ba41-13267cb17177', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnptVkFb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '991177b1-d6a7-41a7-b9fa-f08d04fa57c6', 'attached_at': '', 'detached_at': '', 'volume_id': 'b3d6140d-7f68-4811-a988-350366cf0281', 'serial': 'b3d6140d-7f68-4811-a988-350366cf0281'}, 'volume_type': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9b29656d-5205-4510-adaf-e2abc1bc9be8 req-f2eed7ac-00e0-4c83-bf53-0727334bd5bf service nova] Acquired lock "refresh_cache-991177b1-d6a7-41a7-b9fa-f08d04fa57c6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG nova.network.neutron [req-9b29656d-5205-4510-adaf-e2abc1bc9be8 req-f2eed7ac-00e0-4c83-bf53-0727334bd5bf service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Refreshing network info cache for port 5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:58:45 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:58:45 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:58:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG nova.objects.instance [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lazy-loading 'vcpu_model' on Instance uuid 991177b1-d6a7-41a7-b9fa-f08d04fa57c6 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG nova.objects.base [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Object Instance<991177b1-d6a7-41a7-b9fa-f08d04fa57c6> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnptVkFb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:58:45 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:58:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:58:45 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:58:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:58:45 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f41081-d55f-4966-9081-edd87981844f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:58:45 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6cded2-e477-4825-b804-3b171677ff44]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281] added
Nov 15 02:58:45 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a46a094-127f-46e7-b1ad-c686f3007fef]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42fa4df-e8ad-4952-9602-f80e0822c664]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UnptVkFb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UnptVkFb" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c36c10-8e0f-48b7-9cd3-d638fca91ce8]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UnptVkFb'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0884ba10-7a0d-4e60-b950-cf050d075b9f]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f6e8e4-f125-405d-9694-f07db192ff0c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:58:45 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:58:45 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:58:45 user nova-compute[75391]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 (non-flash)
Nov 15 02:58:45 user nova-compute[75391]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 (non-flash)
Nov 15 02:58:45 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:58:45 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:58:45 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:58:45 user nova-compute[75391]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 (non-flash)
Nov 15 02:58:45 user nova-compute[75391]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 (non-flash)
Nov 15 02:58:45 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c6e9b2-d47b-4ac4-a7c4-51100328cf53]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281, portal: 172.16.0.220,3260]
Nov 15 02:58:45 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281, portal: 172.16.0.220,3260] successful.
Nov 15 02:58:45 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a978930-1867-4ff6-96e7-de3c656be637]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a706ca3-bfe6-441f-8235-3a016d2401b5]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:58:45 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:58:45 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:58:45 user nova-compute[75391]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 (non-flash)
Nov 15 02:58:45 user nova-compute[75391]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 (non-flash)
Nov 15 02:58:45 user nova-compute[75391]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:58:45 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:58:45 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:58:45 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:58:45 user nova-compute[75391]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 (non-flash)
Nov 15 02:58:45 user nova-compute[75391]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 (non-flash)
Nov 15 02:58:45 user nova-compute[75391]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:58:45 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] HCTL ('38', '-', '-', 0) found on session 50 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG nova.network.neutron [req-9b29656d-5205-4510-adaf-e2abc1bc9be8 req-f2eed7ac-00e0-4c83-bf53-0727334bd5bf service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Updated VIF entry in instance network info cache for port 5af75008-fab4-4b58-b936-3d35fdcc8199. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG nova.network.neutron [req-9b29656d-5205-4510-adaf-e2abc1bc9be8 req-f2eed7ac-00e0-4c83-bf53-0727334bd5bf service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Updating instance_info_cache with network_info: [{"id": "5af75008-fab4-4b58-b936-3d35fdcc8199", "address": "fa:16:3e:20:f9:b0", "network": {"id": "525ff764-45a1-4e28-9a54-09f11b8e8a7d", "bridge": "br-int", "label": "tempest-TestShelveInstance-931031505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3451824ac0cb4f32a4882218fa8e63ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af75008-fa", "ovs_interfaceid": "5af75008-fab4-4b58-b936-3d35fdcc8199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79dd8f3-17dc-40ed-8932-ca21d509ee84]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Searching for a device in session 50 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnptVkFb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:58:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9b29656d-5205-4510-adaf-e2abc1bc9be8 req-f2eed7ac-00e0-4c83-bf53-0727334bd5bf service nova] Releasing lock "refresh_cache-991177b1-d6a7-41a7-b9fa-f08d04fa57c6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:58:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:58:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23633663764316334', 'path': '/dev/sdg'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:58:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633663764316334', 'path': '/dev/sdg'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:58:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T02:54:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-88510188',display_name='tempest-TestShelveInstance-server-88510188',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-88510188',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-469278701',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:55:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3451824ac0cb4f32a4882218fa8e63ae',ramdisk_id='',reservation_id='r-zi0hjw2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-93691503',owner_user_name='tempest-TestShelveInstance-93691503-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:58:38Z,user_data=None,user_id='a687d6f2859d498492cecd3d7f366618',uuid=991177b1-d6a7-41a7-b9fa-f08d04fa57c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5af75008-fab4-4b58-b936-3d35fdcc8199", "address": "fa:16:3e:20:f9:b0", "network": {"id": "525ff764-45a1-4e28-9a54-09f11b8e8a7d", "bridge": "br-int", "label": "tempest-TestShelveInstance-931031505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3451824ac0cb4f32a4882218fa8e63ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af75008-fa", "ovs_interfaceid": "5af75008-fab4-4b58-b936-3d35fdcc8199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:58:46 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Converting VIF {"id": "5af75008-fab4-4b58-b936-3d35fdcc8199", "address": "fa:16:3e:20:f9:b0", "network": {"id": "525ff764-45a1-4e28-9a54-09f11b8e8a7d", "bridge": "br-int", "label": "tempest-TestShelveInstance-931031505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3451824ac0cb4f32a4882218fa8e63ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af75008-fa", "ovs_interfaceid": "5af75008-fab4-4b58-b936-3d35fdcc8199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:58:46 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:f9:b0,bridge_name='br-int',has_traffic_filtering=True,id=5af75008-fab4-4b58-b936-3d35fdcc8199,network=Network(525ff764-45a1-4e28-9a54-09f11b8e8a7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5af75008-fa') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:58:46 user nova-compute[75391]: DEBUG nova.objects.instance [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lazy-loading 'pci_devices' on Instance uuid 991177b1-d6a7-41a7-b9fa-f08d04fa57c6 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:58:46 user nova-compute[75391]: DEBUG nova.objects.base [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Object Instance<991177b1-d6a7-41a7-b9fa-f08d04fa57c6> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 02:58:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:58:46 user nova-compute[75391]:   <uuid>991177b1-d6a7-41a7-b9fa-f08d04fa57c6</uuid>
Nov 15 02:58:46 user nova-compute[75391]:   <name>instance-00000022</name>
Nov 15 02:58:46 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:58:46 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:58:46 user nova-compute[75391]:   <metadata>
Nov 15 02:58:46 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:58:46 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:58:46 user nova-compute[75391]:       <nova:name>tempest-TestShelveInstance-server-88510188</nova:name>
Nov 15 02:58:46 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:58:45</nova:creationTime>
Nov 15 02:58:46 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:58:46 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:58:46 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:58:46 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:58:46 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:58:46 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:58:46 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:58:46 user nova-compute[75391]:       <nova:owner>
Nov 15 02:58:46 user nova-compute[75391]:         <nova:user uuid="a687d6f2859d498492cecd3d7f366618">tempest-TestShelveInstance-93691503-project-member</nova:user>
Nov 15 02:58:46 user nova-compute[75391]:         <nova:project uuid="3451824ac0cb4f32a4882218fa8e63ae">tempest-TestShelveInstance-93691503</nova:project>
Nov 15 02:58:46 user nova-compute[75391]:       </nova:owner>
Nov 15 02:58:46 user nova-compute[75391]:       <nova:ports>
Nov 15 02:58:46 user nova-compute[75391]:         <nova:port uuid="5af75008-fab4-4b58-b936-3d35fdcc8199">
Nov 15 02:58:46 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 02:58:46 user nova-compute[75391]:         </nova:port>
Nov 15 02:58:46 user nova-compute[75391]:       </nova:ports>
Nov 15 02:58:46 user nova-compute[75391]:     </nova:instance>
Nov 15 02:58:46 user nova-compute[75391]:   </metadata>
Nov 15 02:58:46 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:58:46 user nova-compute[75391]:     <system>
Nov 15 02:58:46 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:58:46 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:58:46 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:58:46 user nova-compute[75391]:       <entry name="serial">991177b1-d6a7-41a7-b9fa-f08d04fa57c6</entry>
Nov 15 02:58:46 user nova-compute[75391]:       <entry name="uuid">991177b1-d6a7-41a7-b9fa-f08d04fa57c6</entry>
Nov 15 02:58:46 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:58:46 user nova-compute[75391]:     </system>
Nov 15 02:58:46 user nova-compute[75391]:   </sysinfo>
Nov 15 02:58:46 user nova-compute[75391]:   <os>
Nov 15 02:58:46 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:58:46 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:58:46 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:58:46 user nova-compute[75391]:   </os>
Nov 15 02:58:46 user nova-compute[75391]:   <features>
Nov 15 02:58:46 user nova-compute[75391]:     <acpi/>
Nov 15 02:58:46 user nova-compute[75391]:     <apic/>
Nov 15 02:58:46 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:58:46 user nova-compute[75391]:   </features>
Nov 15 02:58:46 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:58:46 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:58:46 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:58:46 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:58:46 user nova-compute[75391]:   </clock>
Nov 15 02:58:46 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:58:46 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:58:46 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:58:46 user nova-compute[75391]:   </cpu>
Nov 15 02:58:46 user nova-compute[75391]:   <devices>
Nov 15 02:58:46 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 02:58:46 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:58:46 user nova-compute[75391]:       <source dev="/dev/sdg"/>
Nov 15 02:58:46 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:58:46 user nova-compute[75391]:       <serial>b3d6140d-7f68-4811-a988-350366cf0281</serial>
Nov 15 02:58:46 user nova-compute[75391]:     </disk>
Nov 15 02:58:46 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:58:46 user nova-compute[75391]:       <mac address="fa:16:3e:20:f9:b0"/>
Nov 15 02:58:46 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:58:46 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:58:46 user nova-compute[75391]:       <target dev="tap5af75008-fa"/>
Nov 15 02:58:46 user nova-compute[75391]:     </interface>
Nov 15 02:58:46 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:58:46 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/991177b1-d6a7-41a7-b9fa-f08d04fa57c6/console.log" append="off"/>
Nov 15 02:58:46 user nova-compute[75391]:     </serial>
Nov 15 02:58:46 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:58:46 user nova-compute[75391]:     <video>
Nov 15 02:58:46 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:58:46 user nova-compute[75391]:     </video>
Nov 15 02:58:46 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:58:46 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:58:46 user nova-compute[75391]:     </rng>
Nov 15 02:58:46 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:58:46 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:58:46 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:58:46 user nova-compute[75391]:     </memballoon>
Nov 15 02:58:46 user nova-compute[75391]:   </devices>
Nov 15 02:58:46 user nova-compute[75391]: </domain>
Nov 15 02:58:46 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:58:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T02:54:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-88510188',display_name='tempest-TestShelveInstance-server-88510188',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-88510188',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-469278701',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:55:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3451824ac0cb4f32a4882218fa8e63ae',ramdisk_id='',reservation_id='r-zi0hjw2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-93691503',owner_user_name='tempest-TestShelveInstance-93691503-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:58:38Z,user_data=None,user_id='a687d6f2859d498492cecd3d7f366618',uuid=991177b1-d6a7-41a7-b9fa-f08d04fa57c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5af75008-fab4-4b58-b936-3d35fdcc8199", "address": "fa:16:3e:20:f9:b0", "network": {"id": "525ff764-45a1-4e28-9a54-09f11b8e8a7d", "bridge": "br-int", "label": "tempest-TestShelveInstance-931031505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3451824ac0cb4f32a4882218fa8e63ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af75008-fa", "ovs_interfaceid": "5af75008-fab4-4b58-b936-3d35fdcc8199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:58:46 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Converting VIF {"id": "5af75008-fab4-4b58-b936-3d35fdcc8199", "address": "fa:16:3e:20:f9:b0", "network": {"id": "525ff764-45a1-4e28-9a54-09f11b8e8a7d", "bridge": "br-int", "label": "tempest-TestShelveInstance-931031505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3451824ac0cb4f32a4882218fa8e63ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af75008-fa", "ovs_interfaceid": "5af75008-fab4-4b58-b936-3d35fdcc8199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:58:46 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:f9:b0,bridge_name='br-int',has_traffic_filtering=True,id=5af75008-fab4-4b58-b936-3d35fdcc8199,network=Network(525ff764-45a1-4e28-9a54-09f11b8e8a7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5af75008-fa') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:58:46 user nova-compute[75391]: DEBUG os_vif [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:f9:b0,bridge_name='br-int',has_traffic_filtering=True,id=5af75008-fab4-4b58-b936-3d35fdcc8199,network=Network(525ff764-45a1-4e28-9a54-09f11b8e8a7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5af75008-fa') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:58:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:58:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:58:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1110639-c8f4-5b9c-abba-00af97db9e8a', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:58:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5af75008-fa, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:58:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5af75008-fa, col_values=(('qos', UUID('35a76956-b87b-473e-8185-10d10499b42b')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:58:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5af75008-fa, col_values=(('external_ids', {'iface-id': '5af75008-fab4-4b58-b936-3d35fdcc8199', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:f9:b0', 'vm-uuid': '991177b1-d6a7-41a7-b9fa-f08d04fa57c6'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:58:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:58:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:46 user nova-compute[75391]: INFO os_vif [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:f9:b0,bridge_name='br-int',has_traffic_filtering=True,id=5af75008-fab4-4b58-b936-3d35fdcc8199,network=Network(525ff764-45a1-4e28-9a54-09f11b8e8a7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5af75008-fa')
Nov 15 02:58:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:58:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] No VIF found with MAC fa:16:3e:20:f9:b0, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:58:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:48 user nova-compute[75391]: DEBUG nova.compute.manager [req-b0b0e287-a648-4eeb-8392-c33158e5da2b req-4f68845e-11be-450a-8921-91d501d487be service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Received event network-vif-plugged-5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:58:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b0b0e287-a648-4eeb-8392-c33158e5da2b req-4f68845e-11be-450a-8921-91d501d487be service nova] Acquiring lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b0b0e287-a648-4eeb-8392-c33158e5da2b req-4f68845e-11be-450a-8921-91d501d487be service nova] Lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b0b0e287-a648-4eeb-8392-c33158e5da2b req-4f68845e-11be-450a-8921-91d501d487be service nova] Lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:48 user nova-compute[75391]: DEBUG nova.compute.manager [req-b0b0e287-a648-4eeb-8392-c33158e5da2b req-4f68845e-11be-450a-8921-91d501d487be service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] No waiting events found dispatching network-vif-plugged-5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:58:48 user nova-compute[75391]: WARNING nova.compute.manager [req-b0b0e287-a648-4eeb-8392-c33158e5da2b req-4f68845e-11be-450a-8921-91d501d487be service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Received unexpected event network-vif-plugged-5af75008-fab4-4b58-b936-3d35fdcc8199 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 02:58:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:50 user nova-compute[75391]: DEBUG nova.compute.manager [req-5a24507e-6e57-4103-82f6-f2c1cdd758e4 req-d2a9124d-7770-4078-98ad-48acf941b2a2 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Received event network-vif-plugged-5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:58:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a24507e-6e57-4103-82f6-f2c1cdd758e4 req-d2a9124d-7770-4078-98ad-48acf941b2a2 service nova] Acquiring lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a24507e-6e57-4103-82f6-f2c1cdd758e4 req-d2a9124d-7770-4078-98ad-48acf941b2a2 service nova] Lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a24507e-6e57-4103-82f6-f2c1cdd758e4 req-d2a9124d-7770-4078-98ad-48acf941b2a2 service nova] Lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:50 user nova-compute[75391]: DEBUG nova.compute.manager [req-5a24507e-6e57-4103-82f6-f2c1cdd758e4 req-d2a9124d-7770-4078-98ad-48acf941b2a2 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] No waiting events found dispatching network-vif-plugged-5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:58:50 user nova-compute[75391]: WARNING nova.compute.manager [req-5a24507e-6e57-4103-82f6-f2c1cdd758e4 req-d2a9124d-7770-4078-98ad-48acf941b2a2 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Received unexpected event network-vif-plugged-5af75008-fab4-4b58-b936-3d35fdcc8199 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 02:58:50 user nova-compute[75391]: DEBUG nova.compute.manager [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:58:50 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:58:50 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Instance spawned successfully.
Nov 15 02:58:50 user nova-compute[75391]: DEBUG nova.compute.manager [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:58:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-528d4500-c00d-408f-95bd-adf6f815e387 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.436s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_power_states {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid 9744c8a1-046e-4a00-92e0-92ebb3275ea9 {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid fc9484c0-9083-4797-8ab1-2ad392822ce8 {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid 6400a5f3-0ec9-4484-930c-1f5061ae5374 {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid d36e2f64-11cb-4b35-8471-9a4df7f4c227 {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid 9909ae6b-7900-4f71-8900-2bf25185e436 {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid 7bd332f2-0f74-4a43-96a2-2322b6cbf982 {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid 28a1ec10-2748-4d0c-9b73-9636fc1cc237 {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid c767fb74-e57f-4ea0-bf4e-4034cf656a78 {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid a0382af0-0509-4473-832f-1e5e6588be2e {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid 62a403f1-f50a-45dc-b194-4cd74570f2e9 {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid 991177b1-d6a7-41a7-b9fa-f08d04fa57c6 {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "9744c8a1-046e-4a00-92e0-92ebb3275ea9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "9744c8a1-046e-4a00-92e0-92ebb3275ea9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "fc9484c0-9083-4797-8ab1-2ad392822ce8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "fc9484c0-9083-4797-8ab1-2ad392822ce8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "6400a5f3-0ec9-4484-930c-1f5061ae5374" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "d36e2f64-11cb-4b35-8471-9a4df7f4c227" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "d36e2f64-11cb-4b35-8471-9a4df7f4c227" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "9909ae6b-7900-4f71-8900-2bf25185e436" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "9909ae6b-7900-4f71-8900-2bf25185e436" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "a0382af0-0509-4473-832f-1e5e6588be2e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "a0382af0-0509-4473-832f-1e5e6588be2e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "62a403f1-f50a-45dc-b194-4cd74570f2e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "fc9484c0-9083-4797-8ab1-2ad392822ce8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "a0382af0-0509-4473-832f-1e5e6588be2e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "9744c8a1-046e-4a00-92e0-92ebb3275ea9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "9909ae6b-7900-4f71-8900-2bf25185e436" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.134s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.136s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "d36e2f64-11cb-4b35-8471-9a4df7f4c227" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.161s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.160s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:53 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:58:53 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:58:53 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:58:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:53 user nova-compute[75391]: INFO nova.compute.manager [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Terminating instance
Nov 15 02:58:53 user nova-compute[75391]: DEBUG nova.compute.manager [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:58:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG nova.compute.manager [req-1b5f2870-c0a8-4990-995d-f0168814b02b req-024e8a1a-9213-4fc7-8bad-27155af5dd41 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received event network-vif-unplugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1b5f2870-c0a8-4990-995d-f0168814b02b req-024e8a1a-9213-4fc7-8bad-27155af5dd41 service nova] Acquiring lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1b5f2870-c0a8-4990-995d-f0168814b02b req-024e8a1a-9213-4fc7-8bad-27155af5dd41 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1b5f2870-c0a8-4990-995d-f0168814b02b req-024e8a1a-9213-4fc7-8bad-27155af5dd41 service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG nova.compute.manager [req-1b5f2870-c0a8-4990-995d-f0168814b02b req-024e8a1a-9213-4fc7-8bad-27155af5dd41 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] No waiting events found dispatching network-vif-unplugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG nova.compute.manager [req-1b5f2870-c0a8-4990-995d-f0168814b02b req-024e8a1a-9213-4fc7-8bad-27155af5dd41 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received event network-vif-unplugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-7bd332f2-0f74-4a43-96a2-2322b6cbf982" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-7bd332f2-0f74-4a43-96a2-2322b6cbf982" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 02:58:54 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Instance destroyed successfully.
Nov 15 02:58:54 user nova-compute[75391]: DEBUG nova.objects.instance [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lazy-loading 'resources' on Instance uuid c767fb74-e57f-4ea0-bf4e-4034cf656a78 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:53:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1960364305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1960364305',id=31,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:55:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e63a88a9fe824c3e9c0807a50b569d54',ramdisk_id='',reservation_id='r-zgxz855s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-141063167',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:57:09Z,user_data=None,user_id='0aa106a59c374dde99b7697f94407339',uuid=c767fb74-e57f-4ea0-bf4e-4034cf656a78,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "address": "fa:16:3e:9e:b6:f5", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a80868d-8a", "ovs_interfaceid": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Converting VIF {"id": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "address": "fa:16:3e:9e:b6:f5", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a80868d-8a", "ovs_interfaceid": "5a80868d-8a1f-4a83-8c22-d3f504963bbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:b6:f5,bridge_name='br-int',has_traffic_filtering=True,id=5a80868d-8a1f-4a83-8c22-d3f504963bbc,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a80868d-8a') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG os_vif [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:b6:f5,bridge_name='br-int',has_traffic_filtering=True,id=5a80868d-8a1f-4a83-8c22-d3f504963bbc,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a80868d-8a') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a80868d-8a, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3841c2d6-184f-4efb-abfc-431d30f50fc2) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:54 user nova-compute[75391]: INFO os_vif [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:b6:f5,bridge_name='br-int',has_traffic_filtering=True,id=5a80868d-8a1f-4a83-8c22-d3f504963bbc,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a80868d-8a')
Nov 15 02:58:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AlBTRFWf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:58:54 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:58:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[da514e26-e5c0-4b4d-8d12-ad88b2ece58c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:58:54 user nova-compute[75391]: No targets found.
Nov 15 02:58:54 user nova-compute[75391]: iSNS:
Nov 15 02:58:54 user nova-compute[75391]: No targets found.
Nov 15 02:58:54 user nova-compute[75391]: STATIC:
Nov 15 02:58:54 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281
Nov 15 02:58:54 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:58:54 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:58:54 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2
Nov 15 02:58:54 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:58:54 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:58:54 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b
Nov 15 02:58:54 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:58:54 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:58:54 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:58:54 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:58:54 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:58:54 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019
Nov 15 02:58:54 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:58:54 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:58:54 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39
Nov 15 02:58:54 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:58:54 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:58:54 user nova-compute[75391]: FIRMWARE:
Nov 15 02:58:54 user nova-compute[75391]: No targets found.
Nov 15 02:58:54 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:58:54 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:58:54 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df18572-53d8-45f7-816e-fbbffa6fe3f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1382fb4a-760d-43f9-b9a4-26c6f1c61347]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:58:54 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:58:54 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:58:54 user nova-compute[75391]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 (non-flash)
Nov 15 02:58:54 user nova-compute[75391]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 (non-flash)
Nov 15 02:58:54 user nova-compute[75391]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:58:54 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:58:54 user nova-compute[75391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 (non-flash)
Nov 15 02:58:54 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:58:54 user nova-compute[75391]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 (non-flash)
Nov 15 02:58:54 user nova-compute[75391]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 (non-flash)
Nov 15 02:58:54 user nova-compute[75391]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:58:54 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f622457bd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39'): ({'sdd'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Removing single pathed devices sdd {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6635378-99c2-4db8-8560-946a2abf3fe7]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3625fb-22ae-4236-8b4f-fe5a77978efe]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Flushing IO for device /dev/sdd {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[18701b07-6554-4d42-abde-b43550d6adb3]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[432a7075-8b78-482d-9375-d0b20a617741]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] SCSI volumes sdd have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO199ce1aa-af0892a4a37d8c4d', '/dev/disk/by-id/scsi-26166303839326134', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_199ce1aa') {{(pid=85237) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75714d5-7bfb-4554-ab3f-ec5f1c4bc35a]: (4, None) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef7245d-d9ba-474c-ac20-531d8d07115c]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a6fe1b-4c2d-4617-816e-01966bd2a255]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39, portal: 172.16.0.220,3260]
Nov 15 02:58:55 user nova-compute[75391]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39, portal: 172.16.0.220,3260] successful.
Nov 15 02:58:55 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aadee61-9526-4ff0-9a9b-16861d006d39 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e267cc10-a110-4462-bada-c303413e034b]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:58:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:58:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:58:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] <== disconnect_volume: return (414ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:58:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:58:55 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Deleting instance files /opt/stack/data/nova/instances/c767fb74-e57f-4ea0-bf4e-4034cf656a78_del
Nov 15 02:58:55 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Deletion of /opt/stack/data/nova/instances/c767fb74-e57f-4ea0-bf4e-4034cf656a78_del complete
Nov 15 02:58:55 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Updating instance_info_cache with network_info: [{"id": "5ef68714-0fbe-470d-b208-7d482f023640", "address": "fa:16:3e:0f:8e:b7", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef68714-0f", "ovs_interfaceid": "5ef68714-0fbe-470d-b208-7d482f023640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:58:55 user nova-compute[75391]: INFO nova.compute.manager [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Took 1.39 seconds to destroy the instance on the hypervisor.
Nov 15 02:58:55 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:58:55 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:58:55 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:58:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-7bd332f2-0f74-4a43-96a2-2322b6cbf982" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:58:55 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 02:58:55 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:58:55 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:58:55 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:58:55 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Took 0.59 seconds to deallocate network for instance.
Nov 15 02:58:55 user nova-compute[75391]: DEBUG nova.compute.manager [req-c334aac0-adf2-448b-bd21-20c1e841a8dc req-67423b3e-758e-4176-b9b5-af0004bb72a3 service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received event network-vif-deleted-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:58:56 user nova-compute[75391]: DEBUG nova.compute.manager [req-68a6b309-a9df-4ea6-a9b7-adbfc912f0b9 req-02bd8c31-ecb8-439f-8dea-76ee481497fa service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:58:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-68a6b309-a9df-4ea6-a9b7-adbfc912f0b9 req-02bd8c31-ecb8-439f-8dea-76ee481497fa service nova] Acquiring lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-68a6b309-a9df-4ea6-a9b7-adbfc912f0b9 req-02bd8c31-ecb8-439f-8dea-76ee481497fa service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-68a6b309-a9df-4ea6-a9b7-adbfc912f0b9 req-02bd8c31-ecb8-439f-8dea-76ee481497fa service nova] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:56 user nova-compute[75391]: DEBUG nova.compute.manager [req-68a6b309-a9df-4ea6-a9b7-adbfc912f0b9 req-02bd8c31-ecb8-439f-8dea-76ee481497fa service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] No waiting events found dispatching network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:58:56 user nova-compute[75391]: WARNING nova.compute.manager [req-68a6b309-a9df-4ea6-a9b7-adbfc912f0b9 req-02bd8c31-ecb8-439f-8dea-76ee481497fa service nova] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Received unexpected event network-vif-plugged-5a80868d-8a1f-4a83-8c22-d3f504963bbc for instance with vm_state active and task_state deleting.
Nov 15 02:58:56 user nova-compute[75391]: INFO nova.compute.manager [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: c767fb74-e57f-4ea0-bf4e-4034cf656a78] Took 0.96 seconds to detach 1 volumes for instance.
Nov 15 02:58:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:57 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:58:57 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:58:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:57 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Deleted allocations for instance c767fb74-e57f-4ea0-bf4e-4034cf656a78
Nov 15 02:58:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-df7aa0d9-88a3-40d7-8f50-ddfa53d58b10 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "c767fb74-e57f-4ea0-bf4e-4034cf656a78" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.575s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:57 user nova-compute[75391]: INFO nova.compute.manager [None req-c9b6a115-2400-4943-a1b6-69deb4874a6d tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Get console output
Nov 15 02:58:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "2a8d7b01-d19e-4484-aa06-272de268e376" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "2a8d7b01-d19e-4484-aa06-272de268e376" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:57 user nova-compute[75391]: DEBUG nova.compute.manager [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:58:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:57 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:58:57 user nova-compute[75391]: INFO nova.compute.claims [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Claim successful on node user
Nov 15 02:58:57 user nova-compute[75391]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 15 02:58:57 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG nova.compute.manager [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG nova.compute.manager [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG nova.network.neutron [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:58:58 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:58:58 user nova-compute[75391]: DEBUG nova.compute.manager [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG nova.policy [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b3fc7a83f6c4c5baa7621163e9f62aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfe79a4e16f4fa89437bcc50fc4b356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG nova.compute.manager [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:58:58 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Creating image(s)
Nov 15 02:58:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "/opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "/opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "2316b79b-8366-4f90-b12f-4407db67ba64" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "2316b79b-8366-4f90-b12f-4407db67ba64" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.194s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG nova.compute.manager [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:58:58 user nova-compute[75391]: INFO nova.compute.claims [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Claim successful on node user
Nov 15 02:58:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.190s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:58 user nova-compute[75391]: DEBUG nova.network.neutron [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Successfully created port: 90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk 1073741824" returned: 0 in 0.088s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62a403f1-f50a-45dc-b194-4cd74570f2e9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.189s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62a403f1-f50a-45dc-b194-4cd74570f2e9/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62a403f1-f50a-45dc-b194-4cd74570f2e9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Cannot resize image /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Ensure instance console log exists: /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62a403f1-f50a-45dc-b194-4cd74570f2e9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG nova.network.neutron [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Successfully updated port: 90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.718s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG nova.compute.manager [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "refresh_cache-2a8d7b01-d19e-4484-aa06-272de268e376" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquired lock "refresh_cache-2a8d7b01-d19e-4484-aa06-272de268e376" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG nova.network.neutron [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG nova.compute.manager [req-2c2a80d6-b1e5-42c4-949f-b19b27d946f4 req-fa618f67-1f62-4a7f-90bd-5cf5c5d37e49 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received event network-changed-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG nova.compute.manager [req-2c2a80d6-b1e5-42c4-949f-b19b27d946f4 req-fa618f67-1f62-4a7f-90bd-5cf5c5d37e49 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Refreshing instance network info cache due to event network-changed-90ba99bb-115f-4726-9944-9409490db504. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2c2a80d6-b1e5-42c4-949f-b19b27d946f4 req-fa618f67-1f62-4a7f-90bd-5cf5c5d37e49 service nova] Acquiring lock "refresh_cache-2a8d7b01-d19e-4484-aa06-272de268e376" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG nova.compute.manager [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG nova.network.neutron [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG nova.network.neutron [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:58:59 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:58:59 user nova-compute[75391]: DEBUG nova.compute.manager [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG nova.policy [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e55cae841f994756843bc97a063ebe86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ec3021653b4209a509852c7a28bf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG nova.compute.manager [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:58:59 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Creating image(s)
Nov 15 02:58:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "/opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "/opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "/opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:58:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.network.neutron [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Updating instance_info_cache with network_info: [{"id": "90ba99bb-115f-4726-9944-9409490db504", "address": "fa:16:3e:31:51:9b", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ba99bb-11", "ovs_interfaceid": "90ba99bb-115f-4726-9944-9409490db504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.183s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Releasing lock "refresh_cache-2a8d7b01-d19e-4484-aa06-272de268e376" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.compute.manager [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Instance network_info: |[{"id": "90ba99bb-115f-4726-9944-9409490db504", "address": "fa:16:3e:31:51:9b", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ba99bb-11", "ovs_interfaceid": "90ba99bb-115f-4726-9944-9409490db504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2c2a80d6-b1e5-42c4-949f-b19b27d946f4 req-fa618f67-1f62-4a7f-90bd-5cf5c5d37e49 service nova] Acquired lock "refresh_cache-2a8d7b01-d19e-4484-aa06-272de268e376" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.network.neutron [req-2c2a80d6-b1e5-42c4-949f-b19b27d946f4 req-fa618f67-1f62-4a7f-90bd-5cf5c5d37e49 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Refreshing network info cache for port 90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Start _get_guest_xml network_info=[{"id": "90ba99bb-115f-4726-9944-9409490db504", "address": "fa:16:3e:31:51:9b", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ba99bb-11", "ovs_interfaceid": "90ba99bb-115f-4726-9944-9409490db504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:59:00 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:59:00 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:58:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-76853416',display_name='tempest-ServerRescueNegativeTestJSON-server-76853416',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-76853416',id=36,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKhaSGqkAzqoum9cargZcVScRKDn1aseIr3GdLRDApyAQ9Xe9xaDmZe3UVdGEeCJjSw59lcw42052OFJbiRx2gsQ9lF8J0h8H1P4kefig/DmS2Avx4QZkI5VTKZo+/Bnw==',key_name='tempest-keypair-660591234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bfe79a4e16f4fa89437bcc50fc4b356',ramdisk_id='',reservation_id='r-13eb6cmf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-388649299',owner_user_name='tempest-ServerRescueNegativeTestJSON-388649299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:58:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b3fc7a83f6c4c5baa7621163e9f62aa',uuid=2a8d7b01-d19e-4484-aa06-272de268e376,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90ba99bb-115f-4726-9944-9409490db504", "address": "fa:16:3e:31:51:9b", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ba99bb-11", "ovs_interfaceid": "90ba99bb-115f-4726-9944-9409490db504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Converting VIF {"id": "90ba99bb-115f-4726-9944-9409490db504", "address": "fa:16:3e:31:51:9b", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ba99bb-11", "ovs_interfaceid": "90ba99bb-115f-4726-9944-9409490db504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:51:9b,bridge_name='br-int',has_traffic_filtering=True,id=90ba99bb-115f-4726-9944-9409490db504,network=Network(079437cd-2e7d-40ea-98c0-24a1c9091aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ba99bb-11') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.objects.instance [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a8d7b01-d19e-4484-aa06-272de268e376 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:59:00 user nova-compute[75391]:   <uuid>2a8d7b01-d19e-4484-aa06-272de268e376</uuid>
Nov 15 02:59:00 user nova-compute[75391]:   <name>instance-00000024</name>
Nov 15 02:59:00 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:59:00 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:59:00 user nova-compute[75391]:   <metadata>
Nov 15 02:59:00 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:59:00 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:59:00 user nova-compute[75391]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-76853416</nova:name>
Nov 15 02:59:00 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:59:00</nova:creationTime>
Nov 15 02:59:00 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:59:00 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:59:00 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:59:00 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:59:00 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:59:00 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:59:00 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:59:00 user nova-compute[75391]:       <nova:owner>
Nov 15 02:59:00 user nova-compute[75391]:         <nova:user uuid="9b3fc7a83f6c4c5baa7621163e9f62aa">tempest-ServerRescueNegativeTestJSON-388649299-project-member</nova:user>
Nov 15 02:59:00 user nova-compute[75391]:         <nova:project uuid="8bfe79a4e16f4fa89437bcc50fc4b356">tempest-ServerRescueNegativeTestJSON-388649299</nova:project>
Nov 15 02:59:00 user nova-compute[75391]:       </nova:owner>
Nov 15 02:59:00 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:59:00 user nova-compute[75391]:       <nova:ports>
Nov 15 02:59:00 user nova-compute[75391]:         <nova:port uuid="90ba99bb-115f-4726-9944-9409490db504">
Nov 15 02:59:00 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 02:59:00 user nova-compute[75391]:         </nova:port>
Nov 15 02:59:00 user nova-compute[75391]:       </nova:ports>
Nov 15 02:59:00 user nova-compute[75391]:     </nova:instance>
Nov 15 02:59:00 user nova-compute[75391]:   </metadata>
Nov 15 02:59:00 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:59:00 user nova-compute[75391]:     <system>
Nov 15 02:59:00 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:59:00 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:59:00 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:59:00 user nova-compute[75391]:       <entry name="serial">2a8d7b01-d19e-4484-aa06-272de268e376</entry>
Nov 15 02:59:00 user nova-compute[75391]:       <entry name="uuid">2a8d7b01-d19e-4484-aa06-272de268e376</entry>
Nov 15 02:59:00 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:59:00 user nova-compute[75391]:     </system>
Nov 15 02:59:00 user nova-compute[75391]:   </sysinfo>
Nov 15 02:59:00 user nova-compute[75391]:   <os>
Nov 15 02:59:00 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:59:00 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:59:00 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:59:00 user nova-compute[75391]:   </os>
Nov 15 02:59:00 user nova-compute[75391]:   <features>
Nov 15 02:59:00 user nova-compute[75391]:     <acpi/>
Nov 15 02:59:00 user nova-compute[75391]:     <apic/>
Nov 15 02:59:00 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:59:00 user nova-compute[75391]:   </features>
Nov 15 02:59:00 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:59:00 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:59:00 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:59:00 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:59:00 user nova-compute[75391]:   </clock>
Nov 15 02:59:00 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:59:00 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:59:00 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:59:00 user nova-compute[75391]:   </cpu>
Nov 15 02:59:00 user nova-compute[75391]:   <devices>
Nov 15 02:59:00 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:59:00 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:59:00 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk"/>
Nov 15 02:59:00 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:59:00 user nova-compute[75391]:     </disk>
Nov 15 02:59:00 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:59:00 user nova-compute[75391]:       <mac address="fa:16:3e:31:51:9b"/>
Nov 15 02:59:00 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:59:00 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:59:00 user nova-compute[75391]:       <target dev="tap90ba99bb-11"/>
Nov 15 02:59:00 user nova-compute[75391]:     </interface>
Nov 15 02:59:00 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:59:00 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/console.log" append="off"/>
Nov 15 02:59:00 user nova-compute[75391]:     </serial>
Nov 15 02:59:00 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:59:00 user nova-compute[75391]:     <video>
Nov 15 02:59:00 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:59:00 user nova-compute[75391]:     </video>
Nov 15 02:59:00 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:59:00 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:59:00 user nova-compute[75391]:     </rng>
Nov 15 02:59:00 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:59:00 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:59:00 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:59:00 user nova-compute[75391]:     </memballoon>
Nov 15 02:59:00 user nova-compute[75391]:   </devices>
Nov 15 02:59:00 user nova-compute[75391]: </domain>
Nov 15 02:59:00 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:58:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-76853416',display_name='tempest-ServerRescueNegativeTestJSON-server-76853416',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-76853416',id=36,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKhaSGqkAzqoum9cargZcVScRKDn1aseIr3GdLRDApyAQ9Xe9xaDmZe3UVdGEeCJjSw59lcw42052OFJbiRx2gsQ9lF8J0h8H1P4kefig/DmS2Avx4QZkI5VTKZo+/Bnw==',key_name='tempest-keypair-660591234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bfe79a4e16f4fa89437bcc50fc4b356',ramdisk_id='',reservation_id='r-13eb6cmf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-388649299',owner_user_name='tempest-ServerRescueNegativeTestJSON-388649299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:58:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b3fc7a83f6c4c5baa7621163e9f62aa',uuid=2a8d7b01-d19e-4484-aa06-272de268e376,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90ba99bb-115f-4726-9944-9409490db504", "address": "fa:16:3e:31:51:9b", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ba99bb-11", "ovs_interfaceid": "90ba99bb-115f-4726-9944-9409490db504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Converting VIF {"id": "90ba99bb-115f-4726-9944-9409490db504", "address": "fa:16:3e:31:51:9b", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ba99bb-11", "ovs_interfaceid": "90ba99bb-115f-4726-9944-9409490db504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:51:9b,bridge_name='br-int',has_traffic_filtering=True,id=90ba99bb-115f-4726-9944-9409490db504,network=Network(079437cd-2e7d-40ea-98c0-24a1c9091aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ba99bb-11') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG os_vif [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:51:9b,bridge_name='br-int',has_traffic_filtering=True,id=90ba99bb-115f-4726-9944-9409490db504,network=Network(079437cd-2e7d-40ea-98c0-24a1c9091aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ba99bb-11') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76074277-9a43-5122-8f7b-091b6240acbb', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90ba99bb-11, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90ba99bb-11, col_values=(('qos', UUID('e9774074-fa71-4ffc-b237-6fe33cb192a2')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90ba99bb-11, col_values=(('external_ids', {'iface-id': '90ba99bb-115f-4726-9944-9409490db504', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:51:9b', 'vm-uuid': '2a8d7b01-d19e-4484-aa06-272de268e376'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.181s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:00 user nova-compute[75391]: INFO os_vif [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:51:9b,bridge_name='br-int',has_traffic_filtering=True,id=90ba99bb-115f-4726-9944-9409490db504,network=Network(079437cd-2e7d-40ea-98c0-24a1c9091aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ba99bb-11')
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk 1073741824" returned: 0 in 0.204s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.416s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] No VIF found with MAC fa:16:3e:31:51:9b, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.195s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG nova.network.neutron [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Successfully created port: a35cf440-e574-46d9-acb0-9602b9da7f02 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Cannot resize image /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Ensure instance console log exists: /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:01 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 62a403f1-f50a-45dc-b194-4cd74570f2e9 is timed out.
Nov 15 02:59:01 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Successfully detached device vdb from instance 62a403f1-f50a-45dc-b194-4cd74570f2e9 from the live domain config.
Nov 15 02:59:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jbVwdalv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:59:01 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:59:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf5b791-8daf-47ef-bec6-2820dc976172]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:59:01 user nova-compute[75391]: No targets found.
Nov 15 02:59:01 user nova-compute[75391]: iSNS:
Nov 15 02:59:01 user nova-compute[75391]: No targets found.
Nov 15 02:59:01 user nova-compute[75391]: STATIC:
Nov 15 02:59:01 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281
Nov 15 02:59:01 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:59:01 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:59:01 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2
Nov 15 02:59:01 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:59:01 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:59:01 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b
Nov 15 02:59:01 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:59:01 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:59:01 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:59:01 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:59:01 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:59:01 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019
Nov 15 02:59:01 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:59:01 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:59:01 user nova-compute[75391]: FIRMWARE:
Nov 15 02:59:01 user nova-compute[75391]: No targets found.
Nov 15 02:59:01 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:59:01 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:59:01 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[48197e71-1767-4339-9cfe-678236313041]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG nova.network.neutron [req-2c2a80d6-b1e5-42c4-949f-b19b27d946f4 req-fa618f67-1f62-4a7f-90bd-5cf5c5d37e49 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Updated VIF entry in instance network info cache for port 90ba99bb-115f-4726-9944-9409490db504. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG nova.network.neutron [req-2c2a80d6-b1e5-42c4-949f-b19b27d946f4 req-fa618f67-1f62-4a7f-90bd-5cf5c5d37e49 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Updating instance_info_cache with network_info: [{"id": "90ba99bb-115f-4726-9944-9409490db504", "address": "fa:16:3e:31:51:9b", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ba99bb-11", "ovs_interfaceid": "90ba99bb-115f-4726-9944-9409490db504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c5c18b-3309-41d9-9cb5-ca0d8a50f233]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:59:01 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:59:01 user nova-compute[75391]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 (non-flash)
Nov 15 02:59:01 user nova-compute[75391]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 (non-flash)
Nov 15 02:59:01 user nova-compute[75391]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:59:01 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:59:01 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:59:01 user nova-compute[75391]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 (non-flash)
Nov 15 02:59:01 user nova-compute[75391]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 (non-flash)
Nov 15 02:59:01 user nova-compute[75391]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:59:01 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6247befe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019'): ({'sde'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Removing single pathed devices sde {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1761fbce-63da-4356-b87a-1aade6f4ee45]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2c2a80d6-b1e5-42c4-949f-b19b27d946f4 req-fa618f67-1f62-4a7f-90bd-5cf5c5d37e49 service nova] Releasing lock "refresh_cache-2a8d7b01-d19e-4484-aa06-272de268e376" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9096de-b1b6-4c4a-abe8-40646d01d183]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Flushing IO for device /dev/sde {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1891d5b4-a9ae-4e43-b468-41ea6b2b43dd]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cae5aed-0f24-4467-8cef-f41e1bf5e72d]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] SCSI volumes sde have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ae2675-522e-49b1-8e90-48bd0875ab25]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[85038d68-0757-45d7-997c-394b692ea93f]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019, portal: 172.16.0.220,3260]
Nov 15 02:59:01 user nova-compute[75391]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019, portal: 172.16.0.220,3260] successful.
Nov 15 02:59:01 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62dd09ab-b036-44b8-9427-9871379fa019 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1357c9ff-7a84-4014-8bef-1d2d14a4b038]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.434s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] <== disconnect_volume: return (436ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG nova.network.neutron [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Successfully updated port: a35cf440-e574-46d9-acb0-9602b9da7f02 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "refresh_cache-2316b79b-8366-4f90-b12f-4407db67ba64" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquired lock "refresh_cache-2316b79b-8366-4f90-b12f-4407db67ba64" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG nova.network.neutron [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG nova.compute.manager [req-5bb10e1e-7251-4352-a73a-6c30e5b40a94 req-8e4e20ad-b9c7-48b3-8564-c6c5487f0160 service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Received event network-changed-a35cf440-e574-46d9-acb0-9602b9da7f02 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG nova.compute.manager [req-5bb10e1e-7251-4352-a73a-6c30e5b40a94 req-8e4e20ad-b9c7-48b3-8564-c6c5487f0160 service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Refreshing instance network info cache due to event network-changed-a35cf440-e574-46d9-acb0-9602b9da7f02. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5bb10e1e-7251-4352-a73a-6c30e5b40a94 req-8e4e20ad-b9c7-48b3-8564-c6c5487f0160 service nova] Acquiring lock "refresh_cache-2316b79b-8366-4f90-b12f-4407db67ba64" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG nova.network.neutron [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.network.neutron [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Updating instance_info_cache with network_info: [{"id": "a35cf440-e574-46d9-acb0-9602b9da7f02", "address": "fa:16:3e:85:6f:38", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa35cf440-e5", "ovs_interfaceid": "a35cf440-e574-46d9-acb0-9602b9da7f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Releasing lock "refresh_cache-2316b79b-8366-4f90-b12f-4407db67ba64" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.compute.manager [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Instance network_info: |[{"id": "a35cf440-e574-46d9-acb0-9602b9da7f02", "address": "fa:16:3e:85:6f:38", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa35cf440-e5", "ovs_interfaceid": "a35cf440-e574-46d9-acb0-9602b9da7f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5bb10e1e-7251-4352-a73a-6c30e5b40a94 req-8e4e20ad-b9c7-48b3-8564-c6c5487f0160 service nova] Acquired lock "refresh_cache-2316b79b-8366-4f90-b12f-4407db67ba64" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.network.neutron [req-5bb10e1e-7251-4352-a73a-6c30e5b40a94 req-8e4e20ad-b9c7-48b3-8564-c6c5487f0160 service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Refreshing network info cache for port a35cf440-e574-46d9-acb0-9602b9da7f02 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Start _get_guest_xml network_info=[{"id": "a35cf440-e574-46d9-acb0-9602b9da7f02", "address": "fa:16:3e:85:6f:38", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa35cf440-e5", "ovs_interfaceid": "a35cf440-e574-46d9-acb0-9602b9da7f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:59:02 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:59:02 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:58:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1482534692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1482534692',id=37,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvMjjliJ566FQMHT1T/lDX3ih1jNIg/g/cs9dRru8ZvLLPpfmeNWYvht71keBrnz0Xw5g478KgMc9qZ3ErTIzYsmP8nzQ4ZT4TxL+SXFtSe+FueqF2smBhVIQUjkyVetw==',key_name='tempest-keypair-29219381',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1ec3021653b4209a509852c7a28bf46',ramdisk_id='',reservation_id='r-rksnk0uu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1315675398',owner_user_name='tempest-AttachVolumeShelveTestJSON-1315675398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:59:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e55cae841f994756843bc97a063ebe86',uuid=2316b79b-8366-4f90-b12f-4407db67ba64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a35cf440-e574-46d9-acb0-9602b9da7f02", "address": "fa:16:3e:85:6f:38", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa35cf440-e5", "ovs_interfaceid": "a35cf440-e574-46d9-acb0-9602b9da7f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Converting VIF {"id": "a35cf440-e574-46d9-acb0-9602b9da7f02", "address": "fa:16:3e:85:6f:38", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa35cf440-e5", "ovs_interfaceid": "a35cf440-e574-46d9-acb0-9602b9da7f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:6f:38,bridge_name='br-int',has_traffic_filtering=True,id=a35cf440-e574-46d9-acb0-9602b9da7f02,network=Network(64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa35cf440-e5') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.objects.instance [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lazy-loading 'pci_devices' on Instance uuid 2316b79b-8366-4f90-b12f-4407db67ba64 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json" returned: 0 in 0.273s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-211b28ae-23af-44e4-a0a0-d138b67e0094 req-1b175764-e661-4391-b728-79bdc67e61b6 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received event network-vif-plugged-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-211b28ae-23af-44e4-a0a0-d138b67e0094 req-1b175764-e661-4391-b728-79bdc67e61b6 service nova] Acquiring lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-211b28ae-23af-44e4-a0a0-d138b67e0094 req-1b175764-e661-4391-b728-79bdc67e61b6 service nova] Lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-211b28ae-23af-44e4-a0a0-d138b67e0094 req-1b175764-e661-4391-b728-79bdc67e61b6 service nova] Lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-211b28ae-23af-44e4-a0a0-d138b67e0094 req-1b175764-e661-4391-b728-79bdc67e61b6 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] No waiting events found dispatching network-vif-plugged-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:59:02 user nova-compute[75391]: WARNING nova.compute.manager [req-211b28ae-23af-44e4-a0a0-d138b67e0094 req-1b175764-e661-4391-b728-79bdc67e61b6 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received unexpected event network-vif-plugged-90ba99bb-115f-4726-9944-9409490db504 for instance with vm_state building and task_state spawning.
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:59:02 user nova-compute[75391]:   <uuid>2316b79b-8366-4f90-b12f-4407db67ba64</uuid>
Nov 15 02:59:02 user nova-compute[75391]:   <name>instance-00000025</name>
Nov 15 02:59:02 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 02:59:02 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 02:59:02 user nova-compute[75391]:   <metadata>
Nov 15 02:59:02 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:59:02 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 02:59:02 user nova-compute[75391]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1482534692</nova:name>
Nov 15 02:59:02 user nova-compute[75391]:       <nova:creationTime>2023-11-15 02:59:02</nova:creationTime>
Nov 15 02:59:02 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 02:59:02 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 02:59:02 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 02:59:02 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 02:59:02 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:59:02 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:59:02 user nova-compute[75391]:       </nova:flavor>
Nov 15 02:59:02 user nova-compute[75391]:       <nova:owner>
Nov 15 02:59:02 user nova-compute[75391]:         <nova:user uuid="e55cae841f994756843bc97a063ebe86">tempest-AttachVolumeShelveTestJSON-1315675398-project-member</nova:user>
Nov 15 02:59:02 user nova-compute[75391]:         <nova:project uuid="f1ec3021653b4209a509852c7a28bf46">tempest-AttachVolumeShelveTestJSON-1315675398</nova:project>
Nov 15 02:59:02 user nova-compute[75391]:       </nova:owner>
Nov 15 02:59:02 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 02:59:02 user nova-compute[75391]:       <nova:ports>
Nov 15 02:59:02 user nova-compute[75391]:         <nova:port uuid="a35cf440-e574-46d9-acb0-9602b9da7f02">
Nov 15 02:59:02 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 02:59:02 user nova-compute[75391]:         </nova:port>
Nov 15 02:59:02 user nova-compute[75391]:       </nova:ports>
Nov 15 02:59:02 user nova-compute[75391]:     </nova:instance>
Nov 15 02:59:02 user nova-compute[75391]:   </metadata>
Nov 15 02:59:02 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 02:59:02 user nova-compute[75391]:     <system>
Nov 15 02:59:02 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:59:02 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:59:02 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 02:59:02 user nova-compute[75391]:       <entry name="serial">2316b79b-8366-4f90-b12f-4407db67ba64</entry>
Nov 15 02:59:02 user nova-compute[75391]:       <entry name="uuid">2316b79b-8366-4f90-b12f-4407db67ba64</entry>
Nov 15 02:59:02 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:59:02 user nova-compute[75391]:     </system>
Nov 15 02:59:02 user nova-compute[75391]:   </sysinfo>
Nov 15 02:59:02 user nova-compute[75391]:   <os>
Nov 15 02:59:02 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:59:02 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 02:59:02 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 02:59:02 user nova-compute[75391]:   </os>
Nov 15 02:59:02 user nova-compute[75391]:   <features>
Nov 15 02:59:02 user nova-compute[75391]:     <acpi/>
Nov 15 02:59:02 user nova-compute[75391]:     <apic/>
Nov 15 02:59:02 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 02:59:02 user nova-compute[75391]:   </features>
Nov 15 02:59:02 user nova-compute[75391]:   <clock offset="utc">
Nov 15 02:59:02 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:59:02 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:59:02 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 02:59:02 user nova-compute[75391]:   </clock>
Nov 15 02:59:02 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 02:59:02 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 02:59:02 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:59:02 user nova-compute[75391]:   </cpu>
Nov 15 02:59:02 user nova-compute[75391]:   <devices>
Nov 15 02:59:02 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 02:59:02 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:59:02 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk"/>
Nov 15 02:59:02 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 02:59:02 user nova-compute[75391]:     </disk>
Nov 15 02:59:02 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 02:59:02 user nova-compute[75391]:       <mac address="fa:16:3e:85:6f:38"/>
Nov 15 02:59:02 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:59:02 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 02:59:02 user nova-compute[75391]:       <target dev="tapa35cf440-e5"/>
Nov 15 02:59:02 user nova-compute[75391]:     </interface>
Nov 15 02:59:02 user nova-compute[75391]:     <serial type="pty">
Nov 15 02:59:02 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/console.log" append="off"/>
Nov 15 02:59:02 user nova-compute[75391]:     </serial>
Nov 15 02:59:02 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:59:02 user nova-compute[75391]:     <video>
Nov 15 02:59:02 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 02:59:02 user nova-compute[75391]:     </video>
Nov 15 02:59:02 user nova-compute[75391]:     <rng model="virtio">
Nov 15 02:59:02 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:59:02 user nova-compute[75391]:     </rng>
Nov 15 02:59:02 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:59:02 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 02:59:02 user nova-compute[75391]:       <stats period="10"/>
Nov 15 02:59:02 user nova-compute[75391]:     </memballoon>
Nov 15 02:59:02 user nova-compute[75391]:   </devices>
Nov 15 02:59:02 user nova-compute[75391]: </domain>
Nov 15 02:59:02 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:58:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1482534692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1482534692',id=37,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvMjjliJ566FQMHT1T/lDX3ih1jNIg/g/cs9dRru8ZvLLPpfmeNWYvht71keBrnz0Xw5g478KgMc9qZ3ErTIzYsmP8nzQ4ZT4TxL+SXFtSe+FueqF2smBhVIQUjkyVetw==',key_name='tempest-keypair-29219381',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1ec3021653b4209a509852c7a28bf46',ramdisk_id='',reservation_id='r-rksnk0uu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1315675398',owner_user_name='tempest-AttachVolumeShelveTestJSON-1315675398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:59:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e55cae841f994756843bc97a063ebe86',uuid=2316b79b-8366-4f90-b12f-4407db67ba64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a35cf440-e574-46d9-acb0-9602b9da7f02", "address": "fa:16:3e:85:6f:38", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa35cf440-e5", "ovs_interfaceid": "a35cf440-e574-46d9-acb0-9602b9da7f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Converting VIF {"id": "a35cf440-e574-46d9-acb0-9602b9da7f02", "address": "fa:16:3e:85:6f:38", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa35cf440-e5", "ovs_interfaceid": "a35cf440-e574-46d9-acb0-9602b9da7f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:6f:38,bridge_name='br-int',has_traffic_filtering=True,id=a35cf440-e574-46d9-acb0-9602b9da7f02,network=Network(64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa35cf440-e5') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG os_vif [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:6f:38,bridge_name='br-int',has_traffic_filtering=True,id=a35cf440-e574-46d9-acb0-9602b9da7f02,network=Network(64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa35cf440-e5') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48ee46df-6d51-55b0-9d4f-31ba4efd985e', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa35cf440-e5, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa35cf440-e5, col_values=(('qos', UUID('18a7d7eb-1d7c-4c6d-8c6e-b358b680f33d')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa35cf440-e5, col_values=(('external_ids', {'iface-id': 'a35cf440-e574-46d9-acb0-9602b9da7f02', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:6f:38', 'vm-uuid': '2316b79b-8366-4f90-b12f-4407db67ba64'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.objects.instance [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'flavor' on Instance uuid 62a403f1-f50a-45dc-b194-4cd74570f2e9 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:02 user nova-compute[75391]: INFO os_vif [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:6f:38,bridge_name='br-int',has_traffic_filtering=True,id=a35cf440-e574-46d9-acb0-9602b9da7f02,network=Network(64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa35cf440-e5')
Nov 15 02:59:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-cbc6c50e-8728-43df-aa15-671c386fdb76 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "62a403f1-f50a-45dc-b194-4cd74570f2e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.988s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "62a403f1-f50a-45dc-b194-4cd74570f2e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 11.350s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] No VIF found with MAC fa:16:3e:85:6f:38, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "62a403f1-f50a-45dc-b194-4cd74570f2e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.network.neutron [req-5bb10e1e-7251-4352-a73a-6c30e5b40a94 req-8e4e20ad-b9c7-48b3-8564-c6c5487f0160 service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Updated VIF entry in instance network info cache for port a35cf440-e574-46d9-acb0-9602b9da7f02. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG nova.network.neutron [req-5bb10e1e-7251-4352-a73a-6c30e5b40a94 req-8e4e20ad-b9c7-48b3-8564-c6c5487f0160 service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Updating instance_info_cache with network_info: [{"id": "a35cf440-e574-46d9-acb0-9602b9da7f02", "address": "fa:16:3e:85:6f:38", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa35cf440-e5", "ovs_interfaceid": "a35cf440-e574-46d9-acb0-9602b9da7f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5bb10e1e-7251-4352-a73a-6c30e5b40a94 req-8e4e20ad-b9c7-48b3-8564-c6c5487f0160 service nova] Releasing lock "refresh_cache-2316b79b-8366-4f90-b12f-4407db67ba64" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:59:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:03 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:59:03 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:59:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=7724MB free_disk=24.84264373779297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:59:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:59:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:59:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9744c8a1-046e-4a00-92e0-92ebb3275ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:59:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance fc9484c0-9083-4797-8ab1-2ad392822ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:59:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6400a5f3-0ec9-4484-930c-1f5061ae5374 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:59:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance d36e2f64-11cb-4b35-8471-9a4df7f4c227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:59:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9909ae6b-7900-4f71-8900-2bf25185e436 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:59:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 7bd332f2-0f74-4a43-96a2-2322b6cbf982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:59:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:59:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance a0382af0-0509-4473-832f-1e5e6588be2e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:59:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 62a403f1-f50a-45dc-b194-4cd74570f2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:59:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 991177b1-d6a7-41a7-b9fa-f08d04fa57c6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:59:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 2a8d7b01-d19e-4484-aa06-272de268e376 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:59:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 2316b79b-8366-4f90-b12f-4407db67ba64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:59:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:59:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:59:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "62a403f1-f50a-45dc-b194-4cd74570f2e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:59:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "62a403f1-f50a-45dc-b194-4cd74570f2e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:59:03 user nova-compute[75391]: INFO nova.compute.manager [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Detaching volume 853bae87-d0c3-4e8f-b2c9-6b0890555da2
Nov 15 02:59:03 user nova-compute[75391]: INFO nova.virt.block_device [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Attempting to driver detach volume 853bae87-d0c3-4e8f-b2c9-6b0890555da2 from mountpoint /dev/vdc
Nov 15 02:59:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Attempting to detach device vdc from instance 62a403f1-f50a-45dc-b194-4cd74570f2e9 from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:59:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:59:03 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:59:03 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 02:59:03 user nova-compute[75391]:   <target dev="vdc" bus="virtio"/>
Nov 15 02:59:03 user nova-compute[75391]:   <serial>853bae87-d0c3-4e8f-b2c9-6b0890555da2</serial>
Nov 15 02:59:03 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 02:59:03 user nova-compute[75391]: </disk>
Nov 15 02:59:03 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:59:03 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Successfully detached device vdc from instance 62a403f1-f50a-45dc-b194-4cd74570f2e9 from the persistent domain config.
Nov 15 02:59:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 62a403f1-f50a-45dc-b194-4cd74570f2e9 from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 02:59:03 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:59:03 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:59:03 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 02:59:03 user nova-compute[75391]:   <target dev="vdc" bus="virtio"/>
Nov 15 02:59:03 user nova-compute[75391]:   <serial>853bae87-d0c3-4e8f-b2c9-6b0890555da2</serial>
Nov 15 02:59:03 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 02:59:03 user nova-compute[75391]: </disk>
Nov 15 02:59:03 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:59:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:04 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:59:04 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:59:04 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:59:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.696s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-6e4f9cd1-38d3-4954-9c4f-3ea9a71b66a6 req-4c85fb37-84f9-4eb1-a4a9-063978345f68 service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Received event network-vif-plugged-a35cf440-e574-46d9-acb0-9602b9da7f02 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:59:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6e4f9cd1-38d3-4954-9c4f-3ea9a71b66a6 req-4c85fb37-84f9-4eb1-a4a9-063978345f68 service nova] Acquiring lock "2316b79b-8366-4f90-b12f-4407db67ba64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:59:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6e4f9cd1-38d3-4954-9c4f-3ea9a71b66a6 req-4c85fb37-84f9-4eb1-a4a9-063978345f68 service nova] Lock "2316b79b-8366-4f90-b12f-4407db67ba64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:59:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6e4f9cd1-38d3-4954-9c4f-3ea9a71b66a6 req-4c85fb37-84f9-4eb1-a4a9-063978345f68 service nova] Lock "2316b79b-8366-4f90-b12f-4407db67ba64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-6e4f9cd1-38d3-4954-9c4f-3ea9a71b66a6 req-4c85fb37-84f9-4eb1-a4a9-063978345f68 service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] No waiting events found dispatching network-vif-plugged-a35cf440-e574-46d9-acb0-9602b9da7f02 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:59:04 user nova-compute[75391]: WARNING nova.compute.manager [req-6e4f9cd1-38d3-4954-9c4f-3ea9a71b66a6 req-4c85fb37-84f9-4eb1-a4a9-063978345f68 service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Received unexpected event network-vif-plugged-a35cf440-e574-46d9-acb0-9602b9da7f02 for instance with vm_state building and task_state spawning.
Nov 15 02:59:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-e0ccc801-cc4a-4b38-8d97-7a016139ccf3 req-f1e61365-f410-41fc-b5c9-2294a6793d4d service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received event network-vif-plugged-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:59:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e0ccc801-cc4a-4b38-8d97-7a016139ccf3 req-f1e61365-f410-41fc-b5c9-2294a6793d4d service nova] Acquiring lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:59:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e0ccc801-cc4a-4b38-8d97-7a016139ccf3 req-f1e61365-f410-41fc-b5c9-2294a6793d4d service nova] Lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:59:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e0ccc801-cc4a-4b38-8d97-7a016139ccf3 req-f1e61365-f410-41fc-b5c9-2294a6793d4d service nova] Lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-e0ccc801-cc4a-4b38-8d97-7a016139ccf3 req-f1e61365-f410-41fc-b5c9-2294a6793d4d service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] No waiting events found dispatching network-vif-plugged-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:59:04 user nova-compute[75391]: WARNING nova.compute.manager [req-e0ccc801-cc4a-4b38-8d97-7a016139ccf3 req-f1e61365-f410-41fc-b5c9-2294a6793d4d service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received unexpected event network-vif-plugged-90ba99bb-115f-4726-9944-9409490db504 for instance with vm_state building and task_state spawning.
Nov 15 02:59:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 62a403f1-f50a-45dc-b194-4cd74570f2e9 {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 02:59:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:05 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:59:05 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:59:05 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:59:05 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:59:05 user nova-compute[75391]: DEBUG nova.compute.manager [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:59:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:59:05 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Instance spawned successfully.
Nov 15 02:59:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:59:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:59:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:59:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:59:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:59:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:59:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:59:05 user nova-compute[75391]: INFO nova.compute.manager [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Took 7.25 seconds to spawn the instance on the hypervisor.
Nov 15 02:59:05 user nova-compute[75391]: DEBUG nova.compute.manager [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:59:05 user nova-compute[75391]: INFO nova.compute.manager [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Took 8.31 seconds to build instance.
Nov 15 02:59:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-3ac1501d-8fa3-4ed0-8e46-5d6d2da08ed2 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "2a8d7b01-d19e-4484-aa06-272de268e376" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.421s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:06 user nova-compute[75391]: DEBUG nova.compute.manager [req-21bb7398-8abf-4569-a85e-744b77b96fec req-cf1060bc-5677-4ce4-8fe8-b9444e3573ab service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Received event network-vif-plugged-a35cf440-e574-46d9-acb0-9602b9da7f02 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:59:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-21bb7398-8abf-4569-a85e-744b77b96fec req-cf1060bc-5677-4ce4-8fe8-b9444e3573ab service nova] Acquiring lock "2316b79b-8366-4f90-b12f-4407db67ba64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:59:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-21bb7398-8abf-4569-a85e-744b77b96fec req-cf1060bc-5677-4ce4-8fe8-b9444e3573ab service nova] Lock "2316b79b-8366-4f90-b12f-4407db67ba64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:59:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-21bb7398-8abf-4569-a85e-744b77b96fec req-cf1060bc-5677-4ce4-8fe8-b9444e3573ab service nova] Lock "2316b79b-8366-4f90-b12f-4407db67ba64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:06 user nova-compute[75391]: DEBUG nova.compute.manager [req-21bb7398-8abf-4569-a85e-744b77b96fec req-cf1060bc-5677-4ce4-8fe8-b9444e3573ab service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] No waiting events found dispatching network-vif-plugged-a35cf440-e574-46d9-acb0-9602b9da7f02 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:59:06 user nova-compute[75391]: WARNING nova.compute.manager [req-21bb7398-8abf-4569-a85e-744b77b96fec req-cf1060bc-5677-4ce4-8fe8-b9444e3573ab service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Received unexpected event network-vif-plugged-a35cf440-e574-46d9-acb0-9602b9da7f02 for instance with vm_state building and task_state spawning.
Nov 15 02:59:07 user nova-compute[75391]: DEBUG nova.compute.manager [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:59:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:59:07 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Instance spawned successfully.
Nov 15 02:59:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:59:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:59:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:59:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:59:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:59:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:59:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:59:07 user nova-compute[75391]: INFO nova.compute.manager [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Took 7.21 seconds to spawn the instance on the hypervisor.
Nov 15 02:59:07 user nova-compute[75391]: DEBUG nova.compute.manager [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:59:07 user nova-compute[75391]: INFO nova.compute.manager [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Took 8.43 seconds to build instance.
Nov 15 02:59:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a964027a-9b67-4b17-8a2d-ad853eeea3d7 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "2316b79b-8366-4f90-b12f-4407db67ba64" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.590s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0213ac06-5b37-4381-8dc7-f18277103a9b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:59:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0213ac06-5b37-4381-8dc7-f18277103a9b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:59:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0213ac06-5b37-4381-8dc7-f18277103a9b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:59:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0213ac06-5b37-4381-8dc7-f18277103a9b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:59:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0213ac06-5b37-4381-8dc7-f18277103a9b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:15 user nova-compute[75391]: INFO nova.compute.manager [None req-0213ac06-5b37-4381-8dc7-f18277103a9b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Terminating instance
Nov 15 02:59:15 user nova-compute[75391]: DEBUG nova.compute.manager [None req-0213ac06-5b37-4381-8dc7-f18277103a9b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:59:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:15 user nova-compute[75391]: DEBUG nova.compute.manager [req-ade0baf6-64cd-4bf7-8034-fcbb7320fa5d req-2482d84b-70fb-4259-b6d3-acccbecb21b7 service nova] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Received event network-vif-unplugged-84041b89-25ff-4498-87ba-c2ab0b5aa876 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:59:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ade0baf6-64cd-4bf7-8034-fcbb7320fa5d req-2482d84b-70fb-4259-b6d3-acccbecb21b7 service nova] Acquiring lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:59:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ade0baf6-64cd-4bf7-8034-fcbb7320fa5d req-2482d84b-70fb-4259-b6d3-acccbecb21b7 service nova] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:59:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ade0baf6-64cd-4bf7-8034-fcbb7320fa5d req-2482d84b-70fb-4259-b6d3-acccbecb21b7 service nova] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:15 user nova-compute[75391]: DEBUG nova.compute.manager [req-ade0baf6-64cd-4bf7-8034-fcbb7320fa5d req-2482d84b-70fb-4259-b6d3-acccbecb21b7 service nova] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] No waiting events found dispatching network-vif-unplugged-84041b89-25ff-4498-87ba-c2ab0b5aa876 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:59:15 user nova-compute[75391]: DEBUG nova.compute.manager [req-ade0baf6-64cd-4bf7-8034-fcbb7320fa5d req-2482d84b-70fb-4259-b6d3-acccbecb21b7 service nova] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Received event network-vif-unplugged-84041b89-25ff-4498-87ba-c2ab0b5aa876 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:59:16 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Instance destroyed successfully.
Nov 15 02:59:16 user nova-compute[75391]: DEBUG nova.objects.instance [None req-0213ac06-5b37-4381-8dc7-f18277103a9b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lazy-loading 'resources' on Instance uuid 28a1ec10-2748-4d0c-9b73-9636fc1cc237 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:59:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-0213ac06-5b37-4381-8dc7-f18277103a9b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:52:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1814824863',display_name='tempest-SnapshotDataIntegrityTests-server-1814824863',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1814824863',id=30,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGxfNId9FgLzesVJTVh5N4e63Gop0293MujlvTdShQk9T5aVtuAVYLP6jBa/sLNrcnCiBLzgcMJcYAwtNraeoI9385lirSvS1Rjud61AlPQ7H/aq20IvIB1Eq0n0U4+vA==',key_name='tempest-keypair-1667336127',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:52:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='342f25269fc44ec2bb9f07a38aa70cd8',ramdisk_id='',reservation_id='r-ysdmpt9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-361766298',owner_user_name='tempest-SnapshotDataIntegrityTests-361766298-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:52:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e16cdc87db540ef820be3233d3e3595',uuid=28a1ec10-2748-4d0c-9b73-9636fc1cc237,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84041b89-25ff-4498-87ba-c2ab0b5aa876", "address": "fa:16:3e:ef:5f:d5", "network": {"id": "ad0220e2-671c-40cc-8b2f-bda8d6f6fca5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-319455103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "342f25269fc44ec2bb9f07a38aa70cd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84041b89-25", "ovs_interfaceid": "84041b89-25ff-4498-87ba-c2ab0b5aa876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:59:16 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-0213ac06-5b37-4381-8dc7-f18277103a9b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Converting VIF {"id": "84041b89-25ff-4498-87ba-c2ab0b5aa876", "address": "fa:16:3e:ef:5f:d5", "network": {"id": "ad0220e2-671c-40cc-8b2f-bda8d6f6fca5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-319455103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "342f25269fc44ec2bb9f07a38aa70cd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84041b89-25", "ovs_interfaceid": "84041b89-25ff-4498-87ba-c2ab0b5aa876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:59:16 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-0213ac06-5b37-4381-8dc7-f18277103a9b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:5f:d5,bridge_name='br-int',has_traffic_filtering=True,id=84041b89-25ff-4498-87ba-c2ab0b5aa876,network=Network(ad0220e2-671c-40cc-8b2f-bda8d6f6fca5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84041b89-25') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:59:16 user nova-compute[75391]: DEBUG os_vif [None req-0213ac06-5b37-4381-8dc7-f18277103a9b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:5f:d5,bridge_name='br-int',has_traffic_filtering=True,id=84041b89-25ff-4498-87ba-c2ab0b5aa876,network=Network(ad0220e2-671c-40cc-8b2f-bda8d6f6fca5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84041b89-25') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:59:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84041b89-25, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:59:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8167e56-c2db-478f-9c01-06eea8455279) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:59:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:16 user nova-compute[75391]: INFO os_vif [None req-0213ac06-5b37-4381-8dc7-f18277103a9b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:5f:d5,bridge_name='br-int',has_traffic_filtering=True,id=84041b89-25ff-4498-87ba-c2ab0b5aa876,network=Network(ad0220e2-671c-40cc-8b2f-bda8d6f6fca5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84041b89-25')
Nov 15 02:59:16 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-0213ac06-5b37-4381-8dc7-f18277103a9b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Deleting instance files /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237_del
Nov 15 02:59:16 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-0213ac06-5b37-4381-8dc7-f18277103a9b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Deletion of /opt/stack/data/nova/instances/28a1ec10-2748-4d0c-9b73-9636fc1cc237_del complete
Nov 15 02:59:16 user nova-compute[75391]: INFO nova.compute.manager [None req-0213ac06-5b37-4381-8dc7-f18277103a9b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 15 02:59:16 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-0213ac06-5b37-4381-8dc7-f18277103a9b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:59:16 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:59:16 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:59:17 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:17 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:59:17 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Took 1.11 seconds to deallocate network for instance.
Nov 15 02:59:17 user nova-compute[75391]: DEBUG nova.compute.manager [req-47f14da4-66ee-4cbf-9600-f6c9df6d7d00 req-a6cd1fc4-d53f-4a4f-a491-f77d444ae258 service nova] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Received event network-vif-deleted-84041b89-25ff-4498-87ba-c2ab0b5aa876 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:59:17 user nova-compute[75391]: INFO nova.compute.manager [req-47f14da4-66ee-4cbf-9600-f6c9df6d7d00 req-a6cd1fc4-d53f-4a4f-a491-f77d444ae258 service nova] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Neutron deleted interface 84041b89-25ff-4498-87ba-c2ab0b5aa876; detaching it from the instance and deleting it from the info cache
Nov 15 02:59:17 user nova-compute[75391]: DEBUG nova.network.neutron [req-47f14da4-66ee-4cbf-9600-f6c9df6d7d00 req-a6cd1fc4-d53f-4a4f-a491-f77d444ae258 service nova] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:59:17 user nova-compute[75391]: DEBUG nova.compute.manager [req-47f14da4-66ee-4cbf-9600-f6c9df6d7d00 req-a6cd1fc4-d53f-4a4f-a491-f77d444ae258 service nova] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Detach interface failed, port_id=84041b89-25ff-4498-87ba-c2ab0b5aa876, reason: Instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237 could not be found. {{(pid=75391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 02:59:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0213ac06-5b37-4381-8dc7-f18277103a9b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:59:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0213ac06-5b37-4381-8dc7-f18277103a9b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:59:17 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-0213ac06-5b37-4381-8dc7-f18277103a9b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:59:17 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-0213ac06-5b37-4381-8dc7-f18277103a9b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:59:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0213ac06-5b37-4381-8dc7-f18277103a9b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:17 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-0213ac06-5b37-4381-8dc7-f18277103a9b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Deleted allocations for instance 28a1ec10-2748-4d0c-9b73-9636fc1cc237
Nov 15 02:59:17 user nova-compute[75391]: DEBUG nova.compute.manager [req-5d0e33f9-f890-45b6-82e3-8369869bb117 req-d6e93609-bcd2-4ef7-969b-c76b6c1a0a2a service nova] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Received event network-vif-plugged-84041b89-25ff-4498-87ba-c2ab0b5aa876 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:59:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5d0e33f9-f890-45b6-82e3-8369869bb117 req-d6e93609-bcd2-4ef7-969b-c76b6c1a0a2a service nova] Acquiring lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:59:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5d0e33f9-f890-45b6-82e3-8369869bb117 req-d6e93609-bcd2-4ef7-969b-c76b6c1a0a2a service nova] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:59:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5d0e33f9-f890-45b6-82e3-8369869bb117 req-d6e93609-bcd2-4ef7-969b-c76b6c1a0a2a service nova] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:17 user nova-compute[75391]: DEBUG nova.compute.manager [req-5d0e33f9-f890-45b6-82e3-8369869bb117 req-d6e93609-bcd2-4ef7-969b-c76b6c1a0a2a service nova] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] No waiting events found dispatching network-vif-plugged-84041b89-25ff-4498-87ba-c2ab0b5aa876 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:59:17 user nova-compute[75391]: WARNING nova.compute.manager [req-5d0e33f9-f890-45b6-82e3-8369869bb117 req-d6e93609-bcd2-4ef7-969b-c76b6c1a0a2a service nova] [instance: 28a1ec10-2748-4d0c-9b73-9636fc1cc237] Received unexpected event network-vif-plugged-84041b89-25ff-4498-87ba-c2ab0b5aa876 for instance with vm_state deleted and task_state None.
Nov 15 02:59:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0213ac06-5b37-4381-8dc7-f18277103a9b tempest-SnapshotDataIntegrityTests-361766298 tempest-SnapshotDataIntegrityTests-361766298-project-member] Lock "28a1ec10-2748-4d0c-9b73-9636fc1cc237" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.587s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:21 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:24 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 62a403f1-f50a-45dc-b194-4cd74570f2e9 is timed out.
Nov 15 02:59:24 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Successfully detached device vdc from instance 62a403f1-f50a-45dc-b194-4cd74570f2e9 from the live domain config.
Nov 15 02:59:24 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CewUvgdY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:59:24 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:59:24 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3384768-c742-43ef-b187-a77108483ef4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:59:24 user nova-compute[75391]: No targets found.
Nov 15 02:59:24 user nova-compute[75391]: iSNS:
Nov 15 02:59:24 user nova-compute[75391]: No targets found.
Nov 15 02:59:24 user nova-compute[75391]: STATIC:
Nov 15 02:59:24 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281
Nov 15 02:59:24 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:59:24 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:59:24 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2
Nov 15 02:59:24 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:59:24 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:59:24 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b
Nov 15 02:59:24 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:59:24 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:59:24 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:59:24 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:59:24 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:59:24 user nova-compute[75391]: FIRMWARE:
Nov 15 02:59:24 user nova-compute[75391]: No targets found.
Nov 15 02:59:24 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:59:24 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:59:24 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0066c00a-bdb2-4160-a974-1ff8267826ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a91fede-0152-43e2-9c09-f8ad95bc46e0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:59:24 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:59:24 user nova-compute[75391]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 (non-flash)
Nov 15 02:59:24 user nova-compute[75391]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:59:24 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:59:24 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:59:24 user nova-compute[75391]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 (non-flash)
Nov 15 02:59:24 user nova-compute[75391]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:59:24 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6247bee830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2'): ({'sdb'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Removing single pathed devices sdb {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3537f91f-16e1-4aac-9e46-f34a2243a3c0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e340b9c8-1d82-40a6-86f4-3f6a7da08e8e]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Flushing IO for device /dev/sdb {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b31918-f15b-414b-a507-29f5a0a1d64b]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1411efe1-d013-4963-927f-f8372f1ac1a3]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[915f80c0-f4a5-4fc1-9e50-8af3e0088355]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ea8553-d472-4292-8a5b-dd6df69dedff]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2, portal: 172.16.0.220,3260]
Nov 15 02:59:24 user nova-compute[75391]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2, portal: 172.16.0.220,3260] successful.
Nov 15 02:59:24 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853bae87-d0c3-4e8f-b2c9-6b0890555da2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[457f40d1-f34a-406e-9b59-6788c6c3029d]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] <== disconnect_volume: return (322ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:59:24 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:59:25 user nova-compute[75391]: DEBUG nova.objects.instance [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'flavor' on Instance uuid 62a403f1-f50a-45dc-b194-4cd74570f2e9 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:59:25 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c559e12a-58a9-4915-bebf-66199affc132 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "62a403f1-f50a-45dc-b194-4cd74570f2e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.821s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2ee8f9d4-bff2-4bec-8a12-66b069d5e883 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "62a403f1-f50a-45dc-b194-4cd74570f2e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:59:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2ee8f9d4-bff2-4bec-8a12-66b069d5e883 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "62a403f1-f50a-45dc-b194-4cd74570f2e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:59:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2ee8f9d4-bff2-4bec-8a12-66b069d5e883 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "62a403f1-f50a-45dc-b194-4cd74570f2e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:59:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2ee8f9d4-bff2-4bec-8a12-66b069d5e883 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "62a403f1-f50a-45dc-b194-4cd74570f2e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:59:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2ee8f9d4-bff2-4bec-8a12-66b069d5e883 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "62a403f1-f50a-45dc-b194-4cd74570f2e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:26 user nova-compute[75391]: INFO nova.compute.manager [None req-2ee8f9d4-bff2-4bec-8a12-66b069d5e883 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Terminating instance
Nov 15 02:59:26 user nova-compute[75391]: DEBUG nova.compute.manager [None req-2ee8f9d4-bff2-4bec-8a12-66b069d5e883 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:59:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-e727c628-4204-449d-be91-a984604a0e6c req-42e5feca-ed93-4cd7-ab86-ae7b8714a2c9 service nova] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Received event network-vif-unplugged-fc4d7e54-3e1e-4439-b78a-a542d743cbc6 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:59:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e727c628-4204-449d-be91-a984604a0e6c req-42e5feca-ed93-4cd7-ab86-ae7b8714a2c9 service nova] Acquiring lock "62a403f1-f50a-45dc-b194-4cd74570f2e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:59:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e727c628-4204-449d-be91-a984604a0e6c req-42e5feca-ed93-4cd7-ab86-ae7b8714a2c9 service nova] Lock "62a403f1-f50a-45dc-b194-4cd74570f2e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:59:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e727c628-4204-449d-be91-a984604a0e6c req-42e5feca-ed93-4cd7-ab86-ae7b8714a2c9 service nova] Lock "62a403f1-f50a-45dc-b194-4cd74570f2e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-e727c628-4204-449d-be91-a984604a0e6c req-42e5feca-ed93-4cd7-ab86-ae7b8714a2c9 service nova] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] No waiting events found dispatching network-vif-unplugged-fc4d7e54-3e1e-4439-b78a-a542d743cbc6 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:59:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-e727c628-4204-449d-be91-a984604a0e6c req-42e5feca-ed93-4cd7-ab86-ae7b8714a2c9 service nova] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Received event network-vif-unplugged-fc4d7e54-3e1e-4439-b78a-a542d743cbc6 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:59:27 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Instance destroyed successfully.
Nov 15 02:59:27 user nova-compute[75391]: DEBUG nova.objects.instance [None req-2ee8f9d4-bff2-4bec-8a12-66b069d5e883 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lazy-loading 'resources' on Instance uuid 62a403f1-f50a-45dc-b194-4cd74570f2e9 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:59:27 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-2ee8f9d4-bff2-4bec-8a12-66b069d5e883 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2077648366',display_name='tempest-AttachVolumeTestJSON-server-2077648366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2077648366',id=35,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk6igpjvau4+imFaTS5sCRgwYeZCwRtqolELPwrrgYugVf4Ne2t5WkuG4KntUeSOcfNVsANlF76V5rmQ19gwueRyjMkITosgfv32ruHER6TS54snZB0AS/oLiKI7KaIew==',key_name='tempest-keypair-1037573230',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:56:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ae33412d3944fbcb20520ae0b5d5d17',ramdisk_id='',reservation_id='r-36ay192f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-452422979',owner_user_name='tempest-AttachVolumeTestJSON-452422979-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:56:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa67273822f247b2ae2d34ec9cd8c8b4',uuid=62a403f1-f50a-45dc-b194-4cd74570f2e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc4d7e54-3e1e-4439-b78a-a542d743cbc6", "address": "fa:16:3e:bd:e8:68", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4d7e54-3e", "ovs_interfaceid": "fc4d7e54-3e1e-4439-b78a-a542d743cbc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:59:27 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-2ee8f9d4-bff2-4bec-8a12-66b069d5e883 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Converting VIF {"id": "fc4d7e54-3e1e-4439-b78a-a542d743cbc6", "address": "fa:16:3e:bd:e8:68", "network": {"id": "4866e9c3-d16f-4496-b56a-1f100ea5622a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1787421477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ae33412d3944fbcb20520ae0b5d5d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4d7e54-3e", "ovs_interfaceid": "fc4d7e54-3e1e-4439-b78a-a542d743cbc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:59:27 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-2ee8f9d4-bff2-4bec-8a12-66b069d5e883 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:e8:68,bridge_name='br-int',has_traffic_filtering=True,id=fc4d7e54-3e1e-4439-b78a-a542d743cbc6,network=Network(4866e9c3-d16f-4496-b56a-1f100ea5622a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4d7e54-3e') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:59:27 user nova-compute[75391]: DEBUG os_vif [None req-2ee8f9d4-bff2-4bec-8a12-66b069d5e883 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:e8:68,bridge_name='br-int',has_traffic_filtering=True,id=fc4d7e54-3e1e-4439-b78a-a542d743cbc6,network=Network(4866e9c3-d16f-4496-b56a-1f100ea5622a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4d7e54-3e') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:59:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc4d7e54-3e, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:59:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:59:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cddc4c38-a21f-4bd8-9b22-c919c40a1b6d) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:59:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:27 user nova-compute[75391]: INFO os_vif [None req-2ee8f9d4-bff2-4bec-8a12-66b069d5e883 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:e8:68,bridge_name='br-int',has_traffic_filtering=True,id=fc4d7e54-3e1e-4439-b78a-a542d743cbc6,network=Network(4866e9c3-d16f-4496-b56a-1f100ea5622a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4d7e54-3e')
Nov 15 02:59:27 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-2ee8f9d4-bff2-4bec-8a12-66b069d5e883 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Deleting instance files /opt/stack/data/nova/instances/62a403f1-f50a-45dc-b194-4cd74570f2e9_del
Nov 15 02:59:27 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-2ee8f9d4-bff2-4bec-8a12-66b069d5e883 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Deletion of /opt/stack/data/nova/instances/62a403f1-f50a-45dc-b194-4cd74570f2e9_del complete
Nov 15 02:59:27 user nova-compute[75391]: INFO nova.compute.manager [None req-2ee8f9d4-bff2-4bec-8a12-66b069d5e883 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 02:59:27 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-2ee8f9d4-bff2-4bec-8a12-66b069d5e883 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:59:27 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:59:27 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:59:28 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:59:28 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Took 0.78 seconds to deallocate network for instance.
Nov 15 02:59:28 user nova-compute[75391]: DEBUG nova.compute.manager [req-d17da3d6-ce56-467a-be74-f099f7d52d8a req-e0b696b5-6925-4cb3-97d8-d13d469da502 service nova] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Received event network-vif-deleted-fc4d7e54-3e1e-4439-b78a-a542d743cbc6 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:59:28 user nova-compute[75391]: INFO nova.compute.manager [req-d17da3d6-ce56-467a-be74-f099f7d52d8a req-e0b696b5-6925-4cb3-97d8-d13d469da502 service nova] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Neutron deleted interface fc4d7e54-3e1e-4439-b78a-a542d743cbc6; detaching it from the instance and deleting it from the info cache
Nov 15 02:59:28 user nova-compute[75391]: DEBUG nova.network.neutron [req-d17da3d6-ce56-467a-be74-f099f7d52d8a req-e0b696b5-6925-4cb3-97d8-d13d469da502 service nova] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:59:28 user nova-compute[75391]: DEBUG nova.compute.manager [req-d17da3d6-ce56-467a-be74-f099f7d52d8a req-e0b696b5-6925-4cb3-97d8-d13d469da502 service nova] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Detach interface failed, port_id=fc4d7e54-3e1e-4439-b78a-a542d743cbc6, reason: Instance 62a403f1-f50a-45dc-b194-4cd74570f2e9 could not be found. {{(pid=75391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 02:59:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2ee8f9d4-bff2-4bec-8a12-66b069d5e883 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:59:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2ee8f9d4-bff2-4bec-8a12-66b069d5e883 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:59:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:28 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-2ee8f9d4-bff2-4bec-8a12-66b069d5e883 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:59:28 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-2ee8f9d4-bff2-4bec-8a12-66b069d5e883 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:59:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2ee8f9d4-bff2-4bec-8a12-66b069d5e883 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:29 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-2ee8f9d4-bff2-4bec-8a12-66b069d5e883 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Deleted allocations for instance 62a403f1-f50a-45dc-b194-4cd74570f2e9
Nov 15 02:59:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2ee8f9d4-bff2-4bec-8a12-66b069d5e883 tempest-AttachVolumeTestJSON-452422979 tempest-AttachVolumeTestJSON-452422979-project-member] Lock "62a403f1-f50a-45dc-b194-4cd74570f2e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.178s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:29 user nova-compute[75391]: DEBUG nova.compute.manager [req-e3401f4c-9a38-421c-b04d-c751931ecdbc req-c64b7c3d-7329-46b3-8a04-ca63d84012e5 service nova] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Received event network-vif-plugged-fc4d7e54-3e1e-4439-b78a-a542d743cbc6 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:59:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e3401f4c-9a38-421c-b04d-c751931ecdbc req-c64b7c3d-7329-46b3-8a04-ca63d84012e5 service nova] Acquiring lock "62a403f1-f50a-45dc-b194-4cd74570f2e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:59:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e3401f4c-9a38-421c-b04d-c751931ecdbc req-c64b7c3d-7329-46b3-8a04-ca63d84012e5 service nova] Lock "62a403f1-f50a-45dc-b194-4cd74570f2e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:59:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e3401f4c-9a38-421c-b04d-c751931ecdbc req-c64b7c3d-7329-46b3-8a04-ca63d84012e5 service nova] Lock "62a403f1-f50a-45dc-b194-4cd74570f2e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:29 user nova-compute[75391]: DEBUG nova.compute.manager [req-e3401f4c-9a38-421c-b04d-c751931ecdbc req-c64b7c3d-7329-46b3-8a04-ca63d84012e5 service nova] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] No waiting events found dispatching network-vif-plugged-fc4d7e54-3e1e-4439-b78a-a542d743cbc6 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:59:29 user nova-compute[75391]: WARNING nova.compute.manager [req-e3401f4c-9a38-421c-b04d-c751931ecdbc req-c64b7c3d-7329-46b3-8a04-ca63d84012e5 service nova] [instance: 62a403f1-f50a-45dc-b194-4cd74570f2e9] Received unexpected event network-vif-plugged-fc4d7e54-3e1e-4439-b78a-a542d743cbc6 for instance with vm_state deleted and task_state None.
Nov 15 02:59:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c78387e6-89b1-4b31-b1ea-2978b783dbe0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "d36e2f64-11cb-4b35-8471-9a4df7f4c227" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:59:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c78387e6-89b1-4b31-b1ea-2978b783dbe0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "d36e2f64-11cb-4b35-8471-9a4df7f4c227" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:59:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c78387e6-89b1-4b31-b1ea-2978b783dbe0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "d36e2f64-11cb-4b35-8471-9a4df7f4c227-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:59:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c78387e6-89b1-4b31-b1ea-2978b783dbe0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "d36e2f64-11cb-4b35-8471-9a4df7f4c227-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:59:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c78387e6-89b1-4b31-b1ea-2978b783dbe0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "d36e2f64-11cb-4b35-8471-9a4df7f4c227-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:44 user nova-compute[75391]: INFO nova.compute.manager [None req-c78387e6-89b1-4b31-b1ea-2978b783dbe0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Terminating instance
Nov 15 02:59:44 user nova-compute[75391]: DEBUG nova.compute.manager [None req-c78387e6-89b1-4b31-b1ea-2978b783dbe0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:59:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:45 user nova-compute[75391]: DEBUG nova.compute.manager [req-34d317e2-5bd1-4a05-9687-8dd68bc9fb68 req-00dea692-5618-41f1-ac8f-02ad1c537357 service nova] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Received event network-vif-unplugged-0a8cd0f0-6967-4cec-a752-5699a32298b1 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:59:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-34d317e2-5bd1-4a05-9687-8dd68bc9fb68 req-00dea692-5618-41f1-ac8f-02ad1c537357 service nova] Acquiring lock "d36e2f64-11cb-4b35-8471-9a4df7f4c227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:59:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-34d317e2-5bd1-4a05-9687-8dd68bc9fb68 req-00dea692-5618-41f1-ac8f-02ad1c537357 service nova] Lock "d36e2f64-11cb-4b35-8471-9a4df7f4c227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:59:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-34d317e2-5bd1-4a05-9687-8dd68bc9fb68 req-00dea692-5618-41f1-ac8f-02ad1c537357 service nova] Lock "d36e2f64-11cb-4b35-8471-9a4df7f4c227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:45 user nova-compute[75391]: DEBUG nova.compute.manager [req-34d317e2-5bd1-4a05-9687-8dd68bc9fb68 req-00dea692-5618-41f1-ac8f-02ad1c537357 service nova] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] No waiting events found dispatching network-vif-unplugged-0a8cd0f0-6967-4cec-a752-5699a32298b1 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:59:45 user nova-compute[75391]: DEBUG nova.compute.manager [req-34d317e2-5bd1-4a05-9687-8dd68bc9fb68 req-00dea692-5618-41f1-ac8f-02ad1c537357 service nova] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Received event network-vif-unplugged-0a8cd0f0-6967-4cec-a752-5699a32298b1 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:59:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:45 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Instance destroyed successfully.
Nov 15 02:59:45 user nova-compute[75391]: DEBUG nova.objects.instance [None req-c78387e6-89b1-4b31-b1ea-2978b783dbe0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lazy-loading 'resources' on Instance uuid d36e2f64-11cb-4b35-8471-9a4df7f4c227 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:59:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-c78387e6-89b1-4b31-b1ea-2978b783dbe0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1234907394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1234907394',id=25,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:50:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e63a88a9fe824c3e9c0807a50b569d54',ramdisk_id='',reservation_id='r-grnkznr9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-141063167',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:52:18Z,user_data=None,user_id='0aa106a59c374dde99b7697f94407339',uuid=d36e2f64-11cb-4b35-8471-9a4df7f4c227,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a8cd0f0-6967-4cec-a752-5699a32298b1", "address": "fa:16:3e:6d:7a:4e", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a8cd0f0-69", "ovs_interfaceid": "0a8cd0f0-6967-4cec-a752-5699a32298b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:59:45 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-c78387e6-89b1-4b31-b1ea-2978b783dbe0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Converting VIF {"id": "0a8cd0f0-6967-4cec-a752-5699a32298b1", "address": "fa:16:3e:6d:7a:4e", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a8cd0f0-69", "ovs_interfaceid": "0a8cd0f0-6967-4cec-a752-5699a32298b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:59:45 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-c78387e6-89b1-4b31-b1ea-2978b783dbe0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:7a:4e,bridge_name='br-int',has_traffic_filtering=True,id=0a8cd0f0-6967-4cec-a752-5699a32298b1,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a8cd0f0-69') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:59:45 user nova-compute[75391]: DEBUG os_vif [None req-c78387e6-89b1-4b31-b1ea-2978b783dbe0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:7a:4e,bridge_name='br-int',has_traffic_filtering=True,id=0a8cd0f0-6967-4cec-a752-5699a32298b1,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a8cd0f0-69') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:59:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a8cd0f0-69, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:59:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=774123e9-ee7a-476d-8c27-5e5f77d57786) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:59:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:59:45 user nova-compute[75391]: INFO os_vif [None req-c78387e6-89b1-4b31-b1ea-2978b783dbe0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:7a:4e,bridge_name='br-int',has_traffic_filtering=True,id=0a8cd0f0-6967-4cec-a752-5699a32298b1,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a8cd0f0-69')
Nov 15 02:59:45 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-c78387e6-89b1-4b31-b1ea-2978b783dbe0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Deleting instance files /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227_del
Nov 15 02:59:45 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-c78387e6-89b1-4b31-b1ea-2978b783dbe0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Deletion of /opt/stack/data/nova/instances/d36e2f64-11cb-4b35-8471-9a4df7f4c227_del complete
Nov 15 02:59:45 user nova-compute[75391]: INFO nova.compute.manager [None req-c78387e6-89b1-4b31-b1ea-2978b783dbe0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 15 02:59:45 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-c78387e6-89b1-4b31-b1ea-2978b783dbe0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:59:45 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:59:45 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:59:46 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:59:46 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Took 0.60 seconds to deallocate network for instance.
Nov 15 02:59:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-e2150e8c-656f-469e-bd27-bc1681d56f24 req-b3645948-7de9-480c-9040-4e8ed6261437 service nova] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Received event network-vif-deleted-0a8cd0f0-6967-4cec-a752-5699a32298b1 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:59:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c78387e6-89b1-4b31-b1ea-2978b783dbe0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:59:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c78387e6-89b1-4b31-b1ea-2978b783dbe0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:59:46 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-c78387e6-89b1-4b31-b1ea-2978b783dbe0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:59:46 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-c78387e6-89b1-4b31-b1ea-2978b783dbe0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:59:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c78387e6-89b1-4b31-b1ea-2978b783dbe0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:46 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-c78387e6-89b1-4b31-b1ea-2978b783dbe0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Deleted allocations for instance d36e2f64-11cb-4b35-8471-9a4df7f4c227
Nov 15 02:59:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c78387e6-89b1-4b31-b1ea-2978b783dbe0 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "d36e2f64-11cb-4b35-8471-9a4df7f4c227" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.754s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:47 user nova-compute[75391]: DEBUG nova.compute.manager [req-d4e9e87d-7de1-4ca1-97f3-b67145e61685 req-a1e44f49-cbb3-415d-b591-711021a8a3a9 service nova] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Received event network-vif-plugged-0a8cd0f0-6967-4cec-a752-5699a32298b1 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:59:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d4e9e87d-7de1-4ca1-97f3-b67145e61685 req-a1e44f49-cbb3-415d-b591-711021a8a3a9 service nova] Acquiring lock "d36e2f64-11cb-4b35-8471-9a4df7f4c227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:59:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d4e9e87d-7de1-4ca1-97f3-b67145e61685 req-a1e44f49-cbb3-415d-b591-711021a8a3a9 service nova] Lock "d36e2f64-11cb-4b35-8471-9a4df7f4c227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:59:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d4e9e87d-7de1-4ca1-97f3-b67145e61685 req-a1e44f49-cbb3-415d-b591-711021a8a3a9 service nova] Lock "d36e2f64-11cb-4b35-8471-9a4df7f4c227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:47 user nova-compute[75391]: DEBUG nova.compute.manager [req-d4e9e87d-7de1-4ca1-97f3-b67145e61685 req-a1e44f49-cbb3-415d-b591-711021a8a3a9 service nova] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] No waiting events found dispatching network-vif-plugged-0a8cd0f0-6967-4cec-a752-5699a32298b1 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:59:47 user nova-compute[75391]: WARNING nova.compute.manager [req-d4e9e87d-7de1-4ca1-97f3-b67145e61685 req-a1e44f49-cbb3-415d-b591-711021a8a3a9 service nova] [instance: d36e2f64-11cb-4b35-8471-9a4df7f4c227] Received unexpected event network-vif-plugged-0a8cd0f0-6967-4cec-a752-5699a32298b1 for instance with vm_state deleted and task_state None.
Nov 15 02:59:50 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:53 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:59:53 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:59:53 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:59:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-a0382af0-0509-4473-832f-1e5e6588be2e" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:59:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-a0382af0-0509-4473-832f-1e5e6588be2e" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:59:53 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 02:59:54 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Updating instance_info_cache with network_info: [{"id": "f4cd02a6-d62a-435e-93fd-e5216134f788", "address": "fa:16:3e:af:ba:88", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd02a6-d6", "ovs_interfaceid": "f4cd02a6-d62a-435e-93fd-e5216134f788", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:59:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-a0382af0-0509-4473-832f-1e5e6588be2e" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:59:54 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 02:59:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:59:55 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:59:56 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:59:57 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:59:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "a0382af0-0509-4473-832f-1e5e6588be2e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:59:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "a0382af0-0509-4473-832f-1e5e6588be2e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:59:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:59:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:59:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:58 user nova-compute[75391]: INFO nova.compute.manager [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Terminating instance
Nov 15 02:59:58 user nova-compute[75391]: DEBUG nova.compute.manager [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:59:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:58 user nova-compute[75391]: DEBUG nova.compute.manager [req-f268cade-c7bc-4457-8f10-31b11662947b req-0397298a-67ec-4b1b-9c90-ed291ec6f2f6 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Received event network-vif-unplugged-f4cd02a6-d62a-435e-93fd-e5216134f788 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:59:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f268cade-c7bc-4457-8f10-31b11662947b req-0397298a-67ec-4b1b-9c90-ed291ec6f2f6 service nova] Acquiring lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:59:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f268cade-c7bc-4457-8f10-31b11662947b req-0397298a-67ec-4b1b-9c90-ed291ec6f2f6 service nova] Lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:59:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f268cade-c7bc-4457-8f10-31b11662947b req-0397298a-67ec-4b1b-9c90-ed291ec6f2f6 service nova] Lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:58 user nova-compute[75391]: DEBUG nova.compute.manager [req-f268cade-c7bc-4457-8f10-31b11662947b req-0397298a-67ec-4b1b-9c90-ed291ec6f2f6 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] No waiting events found dispatching network-vif-unplugged-f4cd02a6-d62a-435e-93fd-e5216134f788 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:59:58 user nova-compute[75391]: DEBUG nova.compute.manager [req-f268cade-c7bc-4457-8f10-31b11662947b req-0397298a-67ec-4b1b-9c90-ed291ec6f2f6 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Received event network-vif-unplugged-f4cd02a6-d62a-435e-93fd-e5216134f788 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:59:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:58 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Instance destroyed successfully.
Nov 15 02:59:58 user nova-compute[75391]: DEBUG nova.objects.instance [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lazy-loading 'resources' on Instance uuid a0382af0-0509-4473-832f-1e5e6588be2e {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:59:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:53:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-15524939',display_name='tempest-ServerActionsTestOtherA-server-15524939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-15524939',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItI9ByRPHa+npkHzUM7/DmFQcMmvmf/UTbrL8IIRz+RgnE4/GT/cT4MtYBSEthl3H1QqF7/CYKc5G1nHfxc2lqIIfQchUdl2quGrdDYzv011COZxukmBFCsP+0gJadT/A==',key_name='tempest-keypair-1167614249',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:55:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81798f0465704c4d9c09d8c3d3175ac5',ramdisk_id='',reservation_id='r-cpqh006p',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1177660790',owner_user_name='tempest-ServerActionsTestOtherA-1177660790-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:57:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ea5480ad1e49afa394e636c37e3b70',uuid=a0382af0-0509-4473-832f-1e5e6588be2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4cd02a6-d62a-435e-93fd-e5216134f788", "address": "fa:16:3e:af:ba:88", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd02a6-d6", "ovs_interfaceid": "f4cd02a6-d62a-435e-93fd-e5216134f788", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:59:58 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converting VIF {"id": "f4cd02a6-d62a-435e-93fd-e5216134f788", "address": "fa:16:3e:af:ba:88", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd02a6-d6", "ovs_interfaceid": "f4cd02a6-d62a-435e-93fd-e5216134f788", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:59:58 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:ba:88,bridge_name='br-int',has_traffic_filtering=True,id=f4cd02a6-d62a-435e-93fd-e5216134f788,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4cd02a6-d6') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:59:58 user nova-compute[75391]: DEBUG os_vif [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:ba:88,bridge_name='br-int',has_traffic_filtering=True,id=f4cd02a6-d62a-435e-93fd-e5216134f788,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4cd02a6-d6') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:59:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4cd02a6-d6, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62d3558c-21d4-474c-be21-3c9d718d501a) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:59:59 user nova-compute[75391]: INFO os_vif [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:ba:88,bridge_name='br-int',has_traffic_filtering=True,id=f4cd02a6-d62a-435e-93fd-e5216134f788,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4cd02a6-d6')
Nov 15 02:59:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KOsrcXFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:59:59 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:59:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65fdec1-ec35-4c72-a7a8-c021eb2ac4dc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:59:59 user nova-compute[75391]: No targets found.
Nov 15 02:59:59 user nova-compute[75391]: iSNS:
Nov 15 02:59:59 user nova-compute[75391]: No targets found.
Nov 15 02:59:59 user nova-compute[75391]: STATIC:
Nov 15 02:59:59 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281
Nov 15 02:59:59 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:59:59 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:59:59 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b
Nov 15 02:59:59 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:59:59 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:59:59 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 02:59:59 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:59:59 user nova-compute[75391]:                 Iface Name: default
Nov 15 02:59:59 user nova-compute[75391]: FIRMWARE:
Nov 15 02:59:59 user nova-compute[75391]: No targets found.
Nov 15 02:59:59 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:59:59 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:59:59 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c6672f-bce5-4f54-bd65-e3933bb4fdb9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a26ebc-0be6-4aa3-9c8f-4017f52c6f5e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:59:59 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:59:59 user nova-compute[75391]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:59:59 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 02:59:59 user nova-compute[75391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b (non-flash)
Nov 15 02:59:59 user nova-compute[75391]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 02:59:59 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6224791900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b'): ({'sdc'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Removing single pathed devices sdc {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09ae268-53dd-4f4f-838b-281eeae8a51d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c29ecdb-8688-4742-8c4c-104de66d3f44]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Flushing IO for device /dev/sdc {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4770d27-75cf-4057-bc86-0d68b140af67]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe583a5-59c3-46f7-ac36-15d79d74909b]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] SCSI volumes sdc have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26634306530326461', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b3c69457', '/dev/disk/by-id/scsi-1SCST_BIOb3c69457-f40e02da0beda600') {{(pid=85237) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b900ff-614d-4d84-ab62-918d49464b7b]: (4, None) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6f4f95-828e-4d0b-a806-6af876d0ec1d]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ee9665-9ca0-44ec-95cd-4042920b0e0e]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b, portal: 172.16.0.220,3260]
Nov 15 02:59:59 user nova-compute[75391]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b, portal: 172.16.0.220,3260] successful.
Nov 15 02:59:59 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e17fe9-4e90-4cf8-a98a-1a887987165b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95bb45b-6f06-40f8-991d-109ab48d2e65]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] <== disconnect_volume: return (317ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:59:59 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Deleting instance files /opt/stack/data/nova/instances/a0382af0-0509-4473-832f-1e5e6588be2e_del
Nov 15 02:59:59 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Deletion of /opt/stack/data/nova/instances/a0382af0-0509-4473-832f-1e5e6588be2e_del complete
Nov 15 02:59:59 user nova-compute[75391]: INFO nova.compute.manager [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 02:59:59 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:00 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:00:00 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Took 0.62 seconds to deallocate network for instance.
Nov 15 03:00:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:00 user nova-compute[75391]: DEBUG nova.compute.manager [req-8a1d2b26-8e87-4daa-995b-55b0cf889ea8 req-7e15b941-c842-4697-8c1e-d07ea80a8457 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Received event network-vif-plugged-f4cd02a6-d62a-435e-93fd-e5216134f788 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:00:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8a1d2b26-8e87-4daa-995b-55b0cf889ea8 req-7e15b941-c842-4697-8c1e-d07ea80a8457 service nova] Acquiring lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8a1d2b26-8e87-4daa-995b-55b0cf889ea8 req-7e15b941-c842-4697-8c1e-d07ea80a8457 service nova] Lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8a1d2b26-8e87-4daa-995b-55b0cf889ea8 req-7e15b941-c842-4697-8c1e-d07ea80a8457 service nova] Lock "a0382af0-0509-4473-832f-1e5e6588be2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:00 user nova-compute[75391]: DEBUG nova.compute.manager [req-8a1d2b26-8e87-4daa-995b-55b0cf889ea8 req-7e15b941-c842-4697-8c1e-d07ea80a8457 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] No waiting events found dispatching network-vif-plugged-f4cd02a6-d62a-435e-93fd-e5216134f788 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:00:00 user nova-compute[75391]: WARNING nova.compute.manager [req-8a1d2b26-8e87-4daa-995b-55b0cf889ea8 req-7e15b941-c842-4697-8c1e-d07ea80a8457 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Received unexpected event network-vif-plugged-f4cd02a6-d62a-435e-93fd-e5216134f788 for instance with vm_state active and task_state deleting.
Nov 15 03:00:00 user nova-compute[75391]: DEBUG nova.compute.manager [req-8a1d2b26-8e87-4daa-995b-55b0cf889ea8 req-7e15b941-c842-4697-8c1e-d07ea80a8457 service nova] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Received event network-vif-deleted-f4cd02a6-d62a-435e-93fd-e5216134f788 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:00:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 03:00:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:00 user nova-compute[75391]: INFO nova.compute.manager [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Took 0.75 seconds to detach 1 volumes for instance.
Nov 15 03:00:00 user nova-compute[75391]: DEBUG nova.compute.manager [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: a0382af0-0509-4473-832f-1e5e6588be2e] Deleting volume: 77e17fe9-4e90-4cf8-a98a-1a887987165b {{(pid=75391) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 03:00:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:01 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:00:01 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:00:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:01 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Deleted allocations for instance a0382af0-0509-4473-832f-1e5e6588be2e
Nov 15 03:00:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-fc73a7e4-a4ef-40c8-add2-9d78f6666c22 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "a0382af0-0509-4473-832f-1e5e6588be2e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.293s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:03 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:00:03 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:00:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=7864MB free_disk=24.956436157226562GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:00:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9744c8a1-046e-4a00-92e0-92ebb3275ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:00:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance fc9484c0-9083-4797-8ab1-2ad392822ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:00:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6400a5f3-0ec9-4484-930c-1f5061ae5374 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:00:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9909ae6b-7900-4f71-8900-2bf25185e436 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:00:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 7bd332f2-0f74-4a43-96a2-2322b6cbf982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:00:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 991177b1-d6a7-41a7-b9fa-f08d04fa57c6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:00:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 2a8d7b01-d19e-4484-aa06-272de268e376 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:00:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 2316b79b-8366-4f90-b12f-4407db67ba64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:00:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:00:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:00:03 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:00:03 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:00:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:00:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.410s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:04 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:00:04 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:00:04 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:00:04 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:00:04 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:00:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:29 user nova-compute[75391]: DEBUG nova.compute.manager [req-f5dc68d8-fde3-4e04-ae2c-65d4272634da req-fbdd189d-6d4a-4b9a-baf9-34b9e71ef48b service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Received event network-changed-5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:00:29 user nova-compute[75391]: DEBUG nova.compute.manager [req-f5dc68d8-fde3-4e04-ae2c-65d4272634da req-fbdd189d-6d4a-4b9a-baf9-34b9e71ef48b service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Refreshing instance network info cache due to event network-changed-5af75008-fab4-4b58-b936-3d35fdcc8199. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:00:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f5dc68d8-fde3-4e04-ae2c-65d4272634da req-fbdd189d-6d4a-4b9a-baf9-34b9e71ef48b service nova] Acquiring lock "refresh_cache-991177b1-d6a7-41a7-b9fa-f08d04fa57c6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:00:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f5dc68d8-fde3-4e04-ae2c-65d4272634da req-fbdd189d-6d4a-4b9a-baf9-34b9e71ef48b service nova] Acquired lock "refresh_cache-991177b1-d6a7-41a7-b9fa-f08d04fa57c6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:00:29 user nova-compute[75391]: DEBUG nova.network.neutron [req-f5dc68d8-fde3-4e04-ae2c-65d4272634da req-fbdd189d-6d4a-4b9a-baf9-34b9e71ef48b service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Refreshing network info cache for port 5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:00:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Acquiring lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Acquiring lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:29 user nova-compute[75391]: INFO nova.compute.manager [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Terminating instance
Nov 15 03:00:29 user nova-compute[75391]: DEBUG nova.compute.manager [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 03:00:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:29 user nova-compute[75391]: DEBUG nova.network.neutron [req-f5dc68d8-fde3-4e04-ae2c-65d4272634da req-fbdd189d-6d4a-4b9a-baf9-34b9e71ef48b service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Updated VIF entry in instance network info cache for port 5af75008-fab4-4b58-b936-3d35fdcc8199. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:00:29 user nova-compute[75391]: DEBUG nova.network.neutron [req-f5dc68d8-fde3-4e04-ae2c-65d4272634da req-fbdd189d-6d4a-4b9a-baf9-34b9e71ef48b service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Updating instance_info_cache with network_info: [{"id": "5af75008-fab4-4b58-b936-3d35fdcc8199", "address": "fa:16:3e:20:f9:b0", "network": {"id": "525ff764-45a1-4e28-9a54-09f11b8e8a7d", "bridge": "br-int", "label": "tempest-TestShelveInstance-931031505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3451824ac0cb4f32a4882218fa8e63ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af75008-fa", "ovs_interfaceid": "5af75008-fab4-4b58-b936-3d35fdcc8199", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:00:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f5dc68d8-fde3-4e04-ae2c-65d4272634da req-fbdd189d-6d4a-4b9a-baf9-34b9e71ef48b service nova] Releasing lock "refresh_cache-991177b1-d6a7-41a7-b9fa-f08d04fa57c6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG nova.compute.manager [req-4b34ab94-67e2-4c49-9544-52d592d8933c req-60237a4f-9810-46c4-b1af-fbd62af4ad1a service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Received event network-vif-unplugged-5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4b34ab94-67e2-4c49-9544-52d592d8933c req-60237a4f-9810-46c4-b1af-fbd62af4ad1a service nova] Acquiring lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4b34ab94-67e2-4c49-9544-52d592d8933c req-60237a4f-9810-46c4-b1af-fbd62af4ad1a service nova] Lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4b34ab94-67e2-4c49-9544-52d592d8933c req-60237a4f-9810-46c4-b1af-fbd62af4ad1a service nova] Lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG nova.compute.manager [req-4b34ab94-67e2-4c49-9544-52d592d8933c req-60237a4f-9810-46c4-b1af-fbd62af4ad1a service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] No waiting events found dispatching network-vif-unplugged-5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG nova.compute.manager [req-4b34ab94-67e2-4c49-9544-52d592d8933c req-60237a4f-9810-46c4-b1af-fbd62af4ad1a service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Received event network-vif-unplugged-5af75008-fab4-4b58-b936-3d35fdcc8199 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 03:00:30 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Instance destroyed successfully.
Nov 15 03:00:30 user nova-compute[75391]: DEBUG nova.objects.instance [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lazy-loading 'resources' on Instance uuid 991177b1-d6a7-41a7-b9fa-f08d04fa57c6 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T02:54:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-88510188',display_name='tempest-TestShelveInstance-server-88510188',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-88510188',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbWHq0u3vzYDdTA20T21WxOphyWDwBwUdcpvnjvB6rdYVJo9RyP642jhsv3kAcbxdgKg9Vmhj9Bu5vtsg1oFVXUy6TrBHh4+tXEhMns8mSFMH2pDgygK0NQ58MCoKv0yQ==',key_name='tempest-TestShelveInstance-469278701',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:58:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3451824ac0cb4f32a4882218fa8e63ae',ramdisk_id='',reservation_id='r-zi0hjw2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-93691503',owner_user_name='tempest-TestShelveInstance-93691503-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:58:51Z,user_data=None,user_id='a687d6f2859d498492cecd3d7f366618',uuid=991177b1-d6a7-41a7-b9fa-f08d04fa57c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5af75008-fab4-4b58-b936-3d35fdcc8199", "address": "fa:16:3e:20:f9:b0", "network": {"id": "525ff764-45a1-4e28-9a54-09f11b8e8a7d", "bridge": "br-int", "label": "tempest-TestShelveInstance-931031505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3451824ac0cb4f32a4882218fa8e63ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af75008-fa", "ovs_interfaceid": "5af75008-fab4-4b58-b936-3d35fdcc8199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Converting VIF {"id": "5af75008-fab4-4b58-b936-3d35fdcc8199", "address": "fa:16:3e:20:f9:b0", "network": {"id": "525ff764-45a1-4e28-9a54-09f11b8e8a7d", "bridge": "br-int", "label": "tempest-TestShelveInstance-931031505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3451824ac0cb4f32a4882218fa8e63ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af75008-fa", "ovs_interfaceid": "5af75008-fab4-4b58-b936-3d35fdcc8199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:f9:b0,bridge_name='br-int',has_traffic_filtering=True,id=5af75008-fab4-4b58-b936-3d35fdcc8199,network=Network(525ff764-45a1-4e28-9a54-09f11b8e8a7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5af75008-fa') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG os_vif [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:f9:b0,bridge_name='br-int',has_traffic_filtering=True,id=5af75008-fab4-4b58-b936-3d35fdcc8199,network=Network(525ff764-45a1-4e28-9a54-09f11b8e8a7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5af75008-fa') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5af75008-fa, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=35a76956-b87b-473e-8185-10d10499b42b) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:00:30 user nova-compute[75391]: INFO os_vif [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:f9:b0,bridge_name='br-int',has_traffic_filtering=True,id=5af75008-fab4-4b58-b936-3d35fdcc8199,network=Network(525ff764-45a1-4e28-9a54-09f11b8e8a7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5af75008-fa')
Nov 15 03:00:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnptVkFb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:00:30 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:00:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f149c28a-a34a-4fe3-9f1b-9a0c17dc8d04]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 03:00:30 user nova-compute[75391]: No targets found.
Nov 15 03:00:30 user nova-compute[75391]: iSNS:
Nov 15 03:00:30 user nova-compute[75391]: No targets found.
Nov 15 03:00:30 user nova-compute[75391]: STATIC:
Nov 15 03:00:30 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281
Nov 15 03:00:30 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 03:00:30 user nova-compute[75391]:                 Iface Name: default
Nov 15 03:00:30 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 03:00:30 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 03:00:30 user nova-compute[75391]:                 Iface Name: default
Nov 15 03:00:30 user nova-compute[75391]: FIRMWARE:
Nov 15 03:00:30 user nova-compute[75391]: No targets found.
Nov 15 03:00:30 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 03:00:30 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 03:00:30 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b71c5e2-9ab1-4eb8-bb79-e6a1caa4a586]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[209c5073-bd5d-4c9e-b054-8290986fa08d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 03:00:30 user nova-compute[75391]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 03:00:30 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 03:00:30 user nova-compute[75391]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 (non-flash)
Nov 15 03:00:30 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f622460e290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281'): ({'sdg'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Removing single pathed devices sdg {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d42166a-b49f-4c35-980d-04e5584a4d76]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6337d3-f6b4-481d-85eb-c616ec6ec0d5]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Flushing IO for device /dev/sdg {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bc623f-dbd2-4a83-9637-17b9e155a73c]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0fb36e-9bfb-48fb-9670-17f9d24add62]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] SCSI volumes sdg have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23633663764316334', '/dev/disk/by-id/scsi-1SCST_BIOd53c4d0f-63f7d1c4cf3e42c7', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d53c4d0f') {{(pid=85237) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d2832d-fba7-4942-b8f1-104346a1b0de]: (4, None) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[576c7faf-9d64-4103-a9e0-373244e67e1e]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[379ffe9b-a539-4e15-9bf3-ca14be1e2cd6]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281, portal: 172.16.0.220,3260]
Nov 15 03:00:30 user nova-compute[75391]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281, portal: 172.16.0.220,3260] successful.
Nov 15 03:00:30 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3d6140d-7f68-4811-a988-350366cf0281 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fc6426-e98d-483f-9b2a-a87950be34bd]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] <== disconnect_volume: return (329ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 03:00:30 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Deleting instance files /opt/stack/data/nova/instances/991177b1-d6a7-41a7-b9fa-f08d04fa57c6_del
Nov 15 03:00:30 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Deletion of /opt/stack/data/nova/instances/991177b1-d6a7-41a7-b9fa-f08d04fa57c6_del complete
Nov 15 03:00:30 user nova-compute[75391]: INFO nova.compute.manager [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 15 03:00:30 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 03:00:30 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 03:00:31 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:00:31 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Took 0.43 seconds to deallocate network for instance.
Nov 15 03:00:31 user nova-compute[75391]: DEBUG nova.compute.manager [req-1f7edd39-cff6-4025-bb61-e4d129181dee req-887979b4-650d-4cef-8546-9795b6149ae2 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Received event network-vif-deleted-5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:00:32 user nova-compute[75391]: INFO nova.compute.manager [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Took 0.74 seconds to detach 1 volumes for instance.
Nov 15 03:00:32 user nova-compute[75391]: DEBUG nova.compute.manager [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Deleting volume: b3d6140d-7f68-4811-a988-350366cf0281 {{(pid=75391) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 03:00:32 user nova-compute[75391]: DEBUG nova.compute.manager [req-0ac10491-b213-4918-9a23-dc50e4ce192d req-944d7696-4b09-4720-a117-5667addf32d2 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Received event network-vif-plugged-5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:00:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0ac10491-b213-4918-9a23-dc50e4ce192d req-944d7696-4b09-4720-a117-5667addf32d2 service nova] Acquiring lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0ac10491-b213-4918-9a23-dc50e4ce192d req-944d7696-4b09-4720-a117-5667addf32d2 service nova] Lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0ac10491-b213-4918-9a23-dc50e4ce192d req-944d7696-4b09-4720-a117-5667addf32d2 service nova] Lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:32 user nova-compute[75391]: DEBUG nova.compute.manager [req-0ac10491-b213-4918-9a23-dc50e4ce192d req-944d7696-4b09-4720-a117-5667addf32d2 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] No waiting events found dispatching network-vif-plugged-5af75008-fab4-4b58-b936-3d35fdcc8199 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:00:32 user nova-compute[75391]: WARNING nova.compute.manager [req-0ac10491-b213-4918-9a23-dc50e4ce192d req-944d7696-4b09-4720-a117-5667addf32d2 service nova] [instance: 991177b1-d6a7-41a7-b9fa-f08d04fa57c6] Received unexpected event network-vif-plugged-5af75008-fab4-4b58-b936-3d35fdcc8199 for instance with vm_state active and task_state deleting.
Nov 15 03:00:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:32 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:00:32 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:00:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:32 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Deleted allocations for instance 991177b1-d6a7-41a7-b9fa-f08d04fa57c6
Nov 15 03:00:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1feae48c-8429-41d5-b140-0fff6578f867 tempest-TestShelveInstance-93691503 tempest-TestShelveInstance-93691503-project-member] Lock "991177b1-d6a7-41a7-b9fa-f08d04fa57c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.922s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "6400a5f3-0ec9-4484-930c-1f5061ae5374" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:35 user nova-compute[75391]: INFO nova.compute.manager [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Terminating instance
Nov 15 03:00:35 user nova-compute[75391]: DEBUG nova.compute.manager [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 03:00:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-0cfc7175-3f12-490c-9ad1-e8238cc730ac req-dbae4e59-0baf-40a7-bcb0-5bfe4a42d0d3 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Received event network-vif-unplugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:00:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0cfc7175-3f12-490c-9ad1-e8238cc730ac req-dbae4e59-0baf-40a7-bcb0-5bfe4a42d0d3 service nova] Acquiring lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0cfc7175-3f12-490c-9ad1-e8238cc730ac req-dbae4e59-0baf-40a7-bcb0-5bfe4a42d0d3 service nova] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0cfc7175-3f12-490c-9ad1-e8238cc730ac req-dbae4e59-0baf-40a7-bcb0-5bfe4a42d0d3 service nova] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-0cfc7175-3f12-490c-9ad1-e8238cc730ac req-dbae4e59-0baf-40a7-bcb0-5bfe4a42d0d3 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] No waiting events found dispatching network-vif-unplugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:00:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-0cfc7175-3f12-490c-9ad1-e8238cc730ac req-dbae4e59-0baf-40a7-bcb0-5bfe4a42d0d3 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Received event network-vif-unplugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 03:00:36 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Instance destroyed successfully.
Nov 15 03:00:36 user nova-compute[75391]: DEBUG nova.objects.instance [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lazy-loading 'resources' on Instance uuid 6400a5f3-0ec9-4484-930c-1f5061ae5374 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2096192783',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2096192783',id=13,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:46:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e63a88a9fe824c3e9c0807a50b569d54',ramdisk_id='',reservation_id='r-spxo8j0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-141063167',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:48:34Z,user_data=None,user_id='0aa106a59c374dde99b7697f94407339',uuid=6400a5f3-0ec9-4484-930c-1f5061ae5374,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "address": "fa:16:3e:84:8e:2f", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f803b5-4e", "ovs_interfaceid": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Converting VIF {"id": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "address": "fa:16:3e:84:8e:2f", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f803b5-4e", "ovs_interfaceid": "95f803b5-4e7b-4463-aca1-39b54dbc7de9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:8e:2f,bridge_name='br-int',has_traffic_filtering=True,id=95f803b5-4e7b-4463-aca1-39b54dbc7de9,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f803b5-4e') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG os_vif [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:8e:2f,bridge_name='br-int',has_traffic_filtering=True,id=95f803b5-4e7b-4463-aca1-39b54dbc7de9,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f803b5-4e') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95f803b5-4e, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7667068-d3fe-4207-bde4-78eb8809b658) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:36 user nova-compute[75391]: INFO os_vif [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:8e:2f,bridge_name='br-int',has_traffic_filtering=True,id=95f803b5-4e7b-4463-aca1-39b54dbc7de9,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f803b5-4e')
Nov 15 03:00:36 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gjWowTAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:00:36 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:00:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[038b33da-f3da-4b26-b39f-aa49c9beefa2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 03:00:36 user nova-compute[75391]: No targets found.
Nov 15 03:00:36 user nova-compute[75391]: iSNS:
Nov 15 03:00:36 user nova-compute[75391]: No targets found.
Nov 15 03:00:36 user nova-compute[75391]: STATIC:
Nov 15 03:00:36 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f
Nov 15 03:00:36 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 03:00:36 user nova-compute[75391]:                 Iface Name: default
Nov 15 03:00:36 user nova-compute[75391]: FIRMWARE:
Nov 15 03:00:36 user nova-compute[75391]: No targets found.
Nov 15 03:00:36 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 03:00:36 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 03:00:36 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa704e01-b937-43c6-a439-2e3b3177dbdc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bce620-dad7-4188-89df-d26bb1493669]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 03:00:36 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f (non-flash)
Nov 15 03:00:36 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62446fd750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f'): ({'sdf'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Removing single pathed devices sdf {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[78217334-f949-4bb1-8ed5-3ad874909297]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[065ca0b0-7c25-4f14-9094-4af007f7dbef]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Flushing IO for device /dev/sdf {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24e3a9e-f5f1-43ad-9f7b-507a36db1af1]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7269a1f7-37d0-408c-b7a3-f220b69b6d09]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] SCSI volumes sdf have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b296678b-b9d4-4564-800b-a66e4dd4c079]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d8be27-20c0-46ab-b29d-255f8f165e7f]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f, portal: 172.16.0.220,3260]
Nov 15 03:00:36 user nova-compute[75391]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f, portal: 172.16.0.220,3260] successful.
Nov 15 03:00:36 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af618bdf-b151-451b-a7a8-62f1a5270a1f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41898b9-33fa-4d49-b7f0-c0304b79a7df]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] <== disconnect_volume: return (301ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 03:00:36 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Deleting instance files /opt/stack/data/nova/instances/6400a5f3-0ec9-4484-930c-1f5061ae5374_del
Nov 15 03:00:36 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Deletion of /opt/stack/data/nova/instances/6400a5f3-0ec9-4484-930c-1f5061ae5374_del complete
Nov 15 03:00:36 user nova-compute[75391]: INFO nova.compute.manager [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 15 03:00:36 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 03:00:36 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 03:00:37 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:00:37 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Took 0.36 seconds to deallocate network for instance.
Nov 15 03:00:37 user nova-compute[75391]: DEBUG nova.compute.manager [req-de63a9b7-1bfd-4835-a8d9-6943a693d100 req-d0496df5-310f-493e-9281-01b47229faa2 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Received event network-vif-deleted-95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:00:37 user nova-compute[75391]: INFO nova.compute.manager [req-de63a9b7-1bfd-4835-a8d9-6943a693d100 req-d0496df5-310f-493e-9281-01b47229faa2 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Neutron deleted interface 95f803b5-4e7b-4463-aca1-39b54dbc7de9; detaching it from the instance and deleting it from the info cache
Nov 15 03:00:37 user nova-compute[75391]: DEBUG nova.network.neutron [req-de63a9b7-1bfd-4835-a8d9-6943a693d100 req-d0496df5-310f-493e-9281-01b47229faa2 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:00:37 user nova-compute[75391]: DEBUG nova.compute.manager [req-de63a9b7-1bfd-4835-a8d9-6943a693d100 req-d0496df5-310f-493e-9281-01b47229faa2 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Detach interface failed, port_id=95f803b5-4e7b-4463-aca1-39b54dbc7de9, reason: Instance 6400a5f3-0ec9-4484-930c-1f5061ae5374 could not be found. {{(pid=75391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 03:00:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:37 user nova-compute[75391]: DEBUG nova.compute.manager [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 03:00:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:37 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 03:00:37 user nova-compute[75391]: INFO nova.compute.claims [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Claim successful on node user
Nov 15 03:00:37 user nova-compute[75391]: INFO nova.compute.manager [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Took 0.74 seconds to detach 1 volumes for instance.
Nov 15 03:00:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:37 user nova-compute[75391]: DEBUG nova.compute.manager [req-9b857f7e-1eda-4dfe-9d4b-16c6f2acdc6a req-ad17dbe1-87a7-4dd8-b2b4-16090fbd4d98 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Received event network-vif-plugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:00:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9b857f7e-1eda-4dfe-9d4b-16c6f2acdc6a req-ad17dbe1-87a7-4dd8-b2b4-16090fbd4d98 service nova] Acquiring lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9b857f7e-1eda-4dfe-9d4b-16c6f2acdc6a req-ad17dbe1-87a7-4dd8-b2b4-16090fbd4d98 service nova] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9b857f7e-1eda-4dfe-9d4b-16c6f2acdc6a req-ad17dbe1-87a7-4dd8-b2b4-16090fbd4d98 service nova] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:37 user nova-compute[75391]: DEBUG nova.compute.manager [req-9b857f7e-1eda-4dfe-9d4b-16c6f2acdc6a req-ad17dbe1-87a7-4dd8-b2b4-16090fbd4d98 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] No waiting events found dispatching network-vif-plugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:00:37 user nova-compute[75391]: WARNING nova.compute.manager [req-9b857f7e-1eda-4dfe-9d4b-16c6f2acdc6a req-ad17dbe1-87a7-4dd8-b2b4-16090fbd4d98 service nova] [instance: 6400a5f3-0ec9-4484-930c-1f5061ae5374] Received unexpected event network-vif-plugged-95f803b5-4e7b-4463-aca1-39b54dbc7de9 for instance with vm_state deleted and task_state None.
Nov 15 03:00:37 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:00:37 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:00:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:37 user nova-compute[75391]: DEBUG nova.compute.manager [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 03:00:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.081s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:37 user nova-compute[75391]: DEBUG nova.compute.manager [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 03:00:37 user nova-compute[75391]: DEBUG nova.network.neutron [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 03:00:37 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 03:00:38 user nova-compute[75391]: DEBUG nova.compute.manager [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG nova.policy [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '970046cb64de4109bb299f75172b7dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c00f50c42754cea86c68e3e668c0180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG nova.compute.manager [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 03:00:38 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Creating image(s)
Nov 15 03:00:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "/opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "/opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "/opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.188s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:38 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Deleted allocations for instance 6400a5f3-0ec9-4484-930c-1f5061ae5374
Nov 15 03:00:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2d725679-ab61-4213-80fe-8ef2889e93b1 tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "6400a5f3-0ec9-4484-930c-1f5061ae5374" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.973s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.183s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk 1073741824" returned: 0 in 0.051s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG nova.network.neutron [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Successfully created port: 036afc83-072c-46b1-99cb-32b6f2c13116 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.179s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Cannot resize image /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Ensure instance console log exists: /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.network.neutron [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Successfully updated port: 036afc83-072c-46b1-99cb-32b6f2c13116 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "refresh_cache-cadf93c5-d57c-4dfa-a3c6-6c1606049636" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquired lock "refresh_cache-cadf93c5-d57c-4dfa-a3c6-6c1606049636" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.network.neutron [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.compute.manager [req-22c7f053-b3d5-4909-a491-97b8dcd2b066 req-4cf9c7f4-9600-4557-b644-a913f519c69e service nova] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Received event network-changed-036afc83-072c-46b1-99cb-32b6f2c13116 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.compute.manager [req-22c7f053-b3d5-4909-a491-97b8dcd2b066 req-4cf9c7f4-9600-4557-b644-a913f519c69e service nova] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Refreshing instance network info cache due to event network-changed-036afc83-072c-46b1-99cb-32b6f2c13116. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-22c7f053-b3d5-4909-a491-97b8dcd2b066 req-4cf9c7f4-9600-4557-b644-a913f519c69e service nova] Acquiring lock "refresh_cache-cadf93c5-d57c-4dfa-a3c6-6c1606049636" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.network.neutron [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.network.neutron [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Updating instance_info_cache with network_info: [{"id": "036afc83-072c-46b1-99cb-32b6f2c13116", "address": "fa:16:3e:a6:30:ec", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap036afc83-07", "ovs_interfaceid": "036afc83-072c-46b1-99cb-32b6f2c13116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Releasing lock "refresh_cache-cadf93c5-d57c-4dfa-a3c6-6c1606049636" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.compute.manager [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Instance network_info: |[{"id": "036afc83-072c-46b1-99cb-32b6f2c13116", "address": "fa:16:3e:a6:30:ec", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap036afc83-07", "ovs_interfaceid": "036afc83-072c-46b1-99cb-32b6f2c13116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-22c7f053-b3d5-4909-a491-97b8dcd2b066 req-4cf9c7f4-9600-4557-b644-a913f519c69e service nova] Acquired lock "refresh_cache-cadf93c5-d57c-4dfa-a3c6-6c1606049636" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.network.neutron [req-22c7f053-b3d5-4909-a491-97b8dcd2b066 req-4cf9c7f4-9600-4557-b644-a913f519c69e service nova] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Refreshing network info cache for port 036afc83-072c-46b1-99cb-32b6f2c13116 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Start _get_guest_xml network_info=[{"id": "036afc83-072c-46b1-99cb-32b6f2c13116", "address": "fa:16:3e:a6:30:ec", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap036afc83-07", "ovs_interfaceid": "036afc83-072c-46b1-99cb-32b6f2c13116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 03:00:39 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:00:39 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-252680332',display_name='tempest-AttachVolumeNegativeTest-server-252680332',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-252680332',id=38,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyA1KGmQqqfACIAcNTk2m7DanMOx/n/v5oIX0fCEcxACGGfop3mLmkV/o60yuGNocC94ci4fJLbQz1p8ufd6WXTP/s0lSwjiDiHagWApIdZ7pfR8SvBUs0xm5Wki4j3Aw==',key_name='tempest-keypair-1702890038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c00f50c42754cea86c68e3e668c0180',ramdisk_id='',reservation_id='r-pb0urvz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-941502312',owner_user_name='tempest-AttachVolumeNegativeTest-941502312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:00:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970046cb64de4109bb299f75172b7dd7',uuid=cadf93c5-d57c-4dfa-a3c6-6c1606049636,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "036afc83-072c-46b1-99cb-32b6f2c13116", "address": "fa:16:3e:a6:30:ec", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap036afc83-07", "ovs_interfaceid": "036afc83-072c-46b1-99cb-32b6f2c13116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Converting VIF {"id": "036afc83-072c-46b1-99cb-32b6f2c13116", "address": "fa:16:3e:a6:30:ec", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap036afc83-07", "ovs_interfaceid": "036afc83-072c-46b1-99cb-32b6f2c13116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:30:ec,bridge_name='br-int',has_traffic_filtering=True,id=036afc83-072c-46b1-99cb-32b6f2c13116,network=Network(2109b776-effc-4ec7-ac51-d0408f119253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap036afc83-07') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.objects.instance [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lazy-loading 'pci_devices' on Instance uuid cadf93c5-d57c-4dfa-a3c6-6c1606049636 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] End _get_guest_xml xml=<domain type="kvm">
Nov 15 03:00:39 user nova-compute[75391]:   <uuid>cadf93c5-d57c-4dfa-a3c6-6c1606049636</uuid>
Nov 15 03:00:39 user nova-compute[75391]:   <name>instance-00000026</name>
Nov 15 03:00:39 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 03:00:39 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 03:00:39 user nova-compute[75391]:   <metadata>
Nov 15 03:00:39 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 03:00:39 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 03:00:39 user nova-compute[75391]:       <nova:name>tempest-AttachVolumeNegativeTest-server-252680332</nova:name>
Nov 15 03:00:39 user nova-compute[75391]:       <nova:creationTime>2023-11-15 03:00:39</nova:creationTime>
Nov 15 03:00:39 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 03:00:39 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 03:00:39 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 03:00:39 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 03:00:39 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 03:00:39 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 03:00:39 user nova-compute[75391]:       </nova:flavor>
Nov 15 03:00:39 user nova-compute[75391]:       <nova:owner>
Nov 15 03:00:39 user nova-compute[75391]:         <nova:user uuid="970046cb64de4109bb299f75172b7dd7">tempest-AttachVolumeNegativeTest-941502312-project-member</nova:user>
Nov 15 03:00:39 user nova-compute[75391]:         <nova:project uuid="9c00f50c42754cea86c68e3e668c0180">tempest-AttachVolumeNegativeTest-941502312</nova:project>
Nov 15 03:00:39 user nova-compute[75391]:       </nova:owner>
Nov 15 03:00:39 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 03:00:39 user nova-compute[75391]:       <nova:ports>
Nov 15 03:00:39 user nova-compute[75391]:         <nova:port uuid="036afc83-072c-46b1-99cb-32b6f2c13116">
Nov 15 03:00:39 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 03:00:39 user nova-compute[75391]:         </nova:port>
Nov 15 03:00:39 user nova-compute[75391]:       </nova:ports>
Nov 15 03:00:39 user nova-compute[75391]:     </nova:instance>
Nov 15 03:00:39 user nova-compute[75391]:   </metadata>
Nov 15 03:00:39 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 03:00:39 user nova-compute[75391]:     <system>
Nov 15 03:00:39 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 03:00:39 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 03:00:39 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 03:00:39 user nova-compute[75391]:       <entry name="serial">cadf93c5-d57c-4dfa-a3c6-6c1606049636</entry>
Nov 15 03:00:39 user nova-compute[75391]:       <entry name="uuid">cadf93c5-d57c-4dfa-a3c6-6c1606049636</entry>
Nov 15 03:00:39 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 03:00:39 user nova-compute[75391]:     </system>
Nov 15 03:00:39 user nova-compute[75391]:   </sysinfo>
Nov 15 03:00:39 user nova-compute[75391]:   <os>
Nov 15 03:00:39 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 03:00:39 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 03:00:39 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 03:00:39 user nova-compute[75391]:   </os>
Nov 15 03:00:39 user nova-compute[75391]:   <features>
Nov 15 03:00:39 user nova-compute[75391]:     <acpi/>
Nov 15 03:00:39 user nova-compute[75391]:     <apic/>
Nov 15 03:00:39 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 03:00:39 user nova-compute[75391]:   </features>
Nov 15 03:00:39 user nova-compute[75391]:   <clock offset="utc">
Nov 15 03:00:39 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 03:00:39 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 03:00:39 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 03:00:39 user nova-compute[75391]:   </clock>
Nov 15 03:00:39 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 03:00:39 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 03:00:39 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 03:00:39 user nova-compute[75391]:   </cpu>
Nov 15 03:00:39 user nova-compute[75391]:   <devices>
Nov 15 03:00:39 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 03:00:39 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 03:00:39 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk"/>
Nov 15 03:00:39 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 03:00:39 user nova-compute[75391]:     </disk>
Nov 15 03:00:39 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 03:00:39 user nova-compute[75391]:       <mac address="fa:16:3e:a6:30:ec"/>
Nov 15 03:00:39 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:00:39 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 03:00:39 user nova-compute[75391]:       <target dev="tap036afc83-07"/>
Nov 15 03:00:39 user nova-compute[75391]:     </interface>
Nov 15 03:00:39 user nova-compute[75391]:     <serial type="pty">
Nov 15 03:00:39 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/console.log" append="off"/>
Nov 15 03:00:39 user nova-compute[75391]:     </serial>
Nov 15 03:00:39 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 03:00:39 user nova-compute[75391]:     <video>
Nov 15 03:00:39 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:00:39 user nova-compute[75391]:     </video>
Nov 15 03:00:39 user nova-compute[75391]:     <rng model="virtio">
Nov 15 03:00:39 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 03:00:39 user nova-compute[75391]:     </rng>
Nov 15 03:00:39 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 03:00:39 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 03:00:39 user nova-compute[75391]:       <stats period="10"/>
Nov 15 03:00:39 user nova-compute[75391]:     </memballoon>
Nov 15 03:00:39 user nova-compute[75391]:   </devices>
Nov 15 03:00:39 user nova-compute[75391]: </domain>
Nov 15 03:00:39 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-252680332',display_name='tempest-AttachVolumeNegativeTest-server-252680332',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-252680332',id=38,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyA1KGmQqqfACIAcNTk2m7DanMOx/n/v5oIX0fCEcxACGGfop3mLmkV/o60yuGNocC94ci4fJLbQz1p8ufd6WXTP/s0lSwjiDiHagWApIdZ7pfR8SvBUs0xm5Wki4j3Aw==',key_name='tempest-keypair-1702890038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c00f50c42754cea86c68e3e668c0180',ramdisk_id='',reservation_id='r-pb0urvz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-941502312',owner_user_name='tempest-AttachVolumeNegativeTest-941502312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:00:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970046cb64de4109bb299f75172b7dd7',uuid=cadf93c5-d57c-4dfa-a3c6-6c1606049636,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "036afc83-072c-46b1-99cb-32b6f2c13116", "address": "fa:16:3e:a6:30:ec", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap036afc83-07", "ovs_interfaceid": "036afc83-072c-46b1-99cb-32b6f2c13116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Converting VIF {"id": "036afc83-072c-46b1-99cb-32b6f2c13116", "address": "fa:16:3e:a6:30:ec", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap036afc83-07", "ovs_interfaceid": "036afc83-072c-46b1-99cb-32b6f2c13116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:30:ec,bridge_name='br-int',has_traffic_filtering=True,id=036afc83-072c-46b1-99cb-32b6f2c13116,network=Network(2109b776-effc-4ec7-ac51-d0408f119253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap036afc83-07') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG os_vif [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:30:ec,bridge_name='br-int',has_traffic_filtering=True,id=036afc83-072c-46b1-99cb-32b6f2c13116,network=Network(2109b776-effc-4ec7-ac51-d0408f119253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap036afc83-07') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43be0161-6dc1-5597-a7a2-b7cbb6f130d5', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap036afc83-07, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap036afc83-07, col_values=(('qos', UUID('44fd52c8-d53c-4caf-9aab-8ffcd8e4765a')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap036afc83-07, col_values=(('external_ids', {'iface-id': '036afc83-072c-46b1-99cb-32b6f2c13116', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:30:ec', 'vm-uuid': 'cadf93c5-d57c-4dfa-a3c6-6c1606049636'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:39 user nova-compute[75391]: INFO os_vif [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:30:ec,bridge_name='br-int',has_traffic_filtering=True,id=036afc83-072c-46b1-99cb-32b6f2c13116,network=Network(2109b776-effc-4ec7-ac51-d0408f119253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap036afc83-07')
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:00:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] No VIF found with MAC fa:16:3e:a6:30:ec, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 03:00:40 user nova-compute[75391]: DEBUG nova.network.neutron [req-22c7f053-b3d5-4909-a491-97b8dcd2b066 req-4cf9c7f4-9600-4557-b644-a913f519c69e service nova] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Updated VIF entry in instance network info cache for port 036afc83-072c-46b1-99cb-32b6f2c13116. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:00:40 user nova-compute[75391]: DEBUG nova.network.neutron [req-22c7f053-b3d5-4909-a491-97b8dcd2b066 req-4cf9c7f4-9600-4557-b644-a913f519c69e service nova] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Updating instance_info_cache with network_info: [{"id": "036afc83-072c-46b1-99cb-32b6f2c13116", "address": "fa:16:3e:a6:30:ec", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap036afc83-07", "ovs_interfaceid": "036afc83-072c-46b1-99cb-32b6f2c13116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:00:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-22c7f053-b3d5-4909-a491-97b8dcd2b066 req-4cf9c7f4-9600-4557-b644-a913f519c69e service nova] Releasing lock "refresh_cache-cadf93c5-d57c-4dfa-a3c6-6c1606049636" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:00:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:41 user nova-compute[75391]: DEBUG nova.compute.manager [req-b115e2fb-a0cf-471a-8f57-94d0d75d491d req-acfc2794-6a50-4428-bdee-0078e463ccc0 service nova] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Received event network-vif-plugged-036afc83-072c-46b1-99cb-32b6f2c13116 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:00:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b115e2fb-a0cf-471a-8f57-94d0d75d491d req-acfc2794-6a50-4428-bdee-0078e463ccc0 service nova] Acquiring lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b115e2fb-a0cf-471a-8f57-94d0d75d491d req-acfc2794-6a50-4428-bdee-0078e463ccc0 service nova] Lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b115e2fb-a0cf-471a-8f57-94d0d75d491d req-acfc2794-6a50-4428-bdee-0078e463ccc0 service nova] Lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:41 user nova-compute[75391]: DEBUG nova.compute.manager [req-b115e2fb-a0cf-471a-8f57-94d0d75d491d req-acfc2794-6a50-4428-bdee-0078e463ccc0 service nova] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] No waiting events found dispatching network-vif-plugged-036afc83-072c-46b1-99cb-32b6f2c13116 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:00:41 user nova-compute[75391]: WARNING nova.compute.manager [req-b115e2fb-a0cf-471a-8f57-94d0d75d491d req-acfc2794-6a50-4428-bdee-0078e463ccc0 service nova] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Received unexpected event network-vif-plugged-036afc83-072c-46b1-99cb-32b6f2c13116 for instance with vm_state building and task_state spawning.
Nov 15 03:00:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:43 user nova-compute[75391]: DEBUG nova.compute.manager [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 03:00:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 03:00:43 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Instance spawned successfully.
Nov 15 03:00:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 03:00:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:00:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:00:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:00:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:00:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:00:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:00:43 user nova-compute[75391]: INFO nova.compute.manager [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Took 5.12 seconds to spawn the instance on the hypervisor.
Nov 15 03:00:43 user nova-compute[75391]: DEBUG nova.compute.manager [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 03:00:43 user nova-compute[75391]: INFO nova.compute.manager [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Took 5.82 seconds to build instance.
Nov 15 03:00:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-799c294b-5e63-472c-bdf3-9525cea195af tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.914s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:43 user nova-compute[75391]: DEBUG nova.compute.manager [req-c1efd443-1d22-4c58-b832-a6050366fc33 req-d485ef06-832f-49ca-9577-4b0e0faad136 service nova] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Received event network-vif-plugged-036afc83-072c-46b1-99cb-32b6f2c13116 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:00:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c1efd443-1d22-4c58-b832-a6050366fc33 req-d485ef06-832f-49ca-9577-4b0e0faad136 service nova] Acquiring lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c1efd443-1d22-4c58-b832-a6050366fc33 req-d485ef06-832f-49ca-9577-4b0e0faad136 service nova] Lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c1efd443-1d22-4c58-b832-a6050366fc33 req-d485ef06-832f-49ca-9577-4b0e0faad136 service nova] Lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:43 user nova-compute[75391]: DEBUG nova.compute.manager [req-c1efd443-1d22-4c58-b832-a6050366fc33 req-d485ef06-832f-49ca-9577-4b0e0faad136 service nova] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] No waiting events found dispatching network-vif-plugged-036afc83-072c-46b1-99cb-32b6f2c13116 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:00:43 user nova-compute[75391]: WARNING nova.compute.manager [req-c1efd443-1d22-4c58-b832-a6050366fc33 req-d485ef06-832f-49ca-9577-4b0e0faad136 service nova] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Received unexpected event network-vif-plugged-036afc83-072c-46b1-99cb-32b6f2c13116 for instance with vm_state active and task_state None.
Nov 15 03:00:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:48 user nova-compute[75391]: DEBUG nova.compute.manager [req-b60b58aa-d346-40ba-afeb-709beb44efb5 req-718c97c8-3dcf-4b37-b199-0e7100363e2d service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received event network-changed-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:00:48 user nova-compute[75391]: DEBUG nova.compute.manager [req-b60b58aa-d346-40ba-afeb-709beb44efb5 req-718c97c8-3dcf-4b37-b199-0e7100363e2d service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Refreshing instance network info cache due to event network-changed-90ba99bb-115f-4726-9944-9409490db504. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:00:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b60b58aa-d346-40ba-afeb-709beb44efb5 req-718c97c8-3dcf-4b37-b199-0e7100363e2d service nova] Acquiring lock "refresh_cache-2a8d7b01-d19e-4484-aa06-272de268e376" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:00:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b60b58aa-d346-40ba-afeb-709beb44efb5 req-718c97c8-3dcf-4b37-b199-0e7100363e2d service nova] Acquired lock "refresh_cache-2a8d7b01-d19e-4484-aa06-272de268e376" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:00:48 user nova-compute[75391]: DEBUG nova.network.neutron [req-b60b58aa-d346-40ba-afeb-709beb44efb5 req-718c97c8-3dcf-4b37-b199-0e7100363e2d service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Refreshing network info cache for port 90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:00:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "2a8d7b01-d19e-4484-aa06-272de268e376" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "2a8d7b01-d19e-4484-aa06-272de268e376" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:49 user nova-compute[75391]: DEBUG nova.objects.instance [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'flavor' on Instance uuid 2a8d7b01-d19e-4484-aa06-272de268e376 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:00:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "2a8d7b01-d19e-4484-aa06-272de268e376" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "2a8d7b01-d19e-4484-aa06-272de268e376" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "2a8d7b01-d19e-4484-aa06-272de268e376" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:49 user nova-compute[75391]: INFO nova.compute.manager [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Attaching volume 7c07a1f1-b1b6-4759-9c20-f9e04a6b968e to /dev/vdb
Nov 15 03:00:49 user nova-compute[75391]: DEBUG os_brick.utils [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:00:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:49 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d365a777-d823-4859-86f1-b9b3b5f9cd9b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:49 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b2d74b-00ac-4c73-8094-07b0b9e03f33]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:49 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[57def750-84fa-464a-bdde-33b7f05d4a7d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:49 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b660ea23-44fd-4402-ad52-8c2db0e97664]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:49 user nova-compute[75391]: DEBUG nova.network.neutron [req-b60b58aa-d346-40ba-afeb-709beb44efb5 req-718c97c8-3dcf-4b37-b199-0e7100363e2d service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Updated VIF entry in instance network info cache for port 90ba99bb-115f-4726-9944-9409490db504. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:00:49 user nova-compute[75391]: DEBUG nova.network.neutron [req-b60b58aa-d346-40ba-afeb-709beb44efb5 req-718c97c8-3dcf-4b37-b199-0e7100363e2d service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Updating instance_info_cache with network_info: [{"id": "90ba99bb-115f-4726-9944-9409490db504", "address": "fa:16:3e:31:51:9b", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ba99bb-11", "ovs_interfaceid": "90ba99bb-115f-4726-9944-9409490db504", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:00:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:00:49 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 03:00:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b60b58aa-d346-40ba-afeb-709beb44efb5 req-718c97c8-3dcf-4b37-b199-0e7100363e2d service nova] Releasing lock "refresh_cache-2a8d7b01-d19e-4484-aa06-272de268e376" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:00:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:00:49 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 03:00:49 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba07f21c-b20d-45b0-809f-6e7f37410b77]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:49 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 03:00:49 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 03:00:49 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 03:00:49 user nova-compute[75391]: DEBUG os_brick.utils [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:00:49 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Updating existing volume attachment record: 02ef0e03-ec97-41a0-bb5e-55f3fa927a67 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 03:00:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:50 user nova-compute[75391]: DEBUG nova.compute.manager [req-54f23303-db96-4c2d-81a6-6cafdf7f67ca req-fae224a6-4966-4833-9802-c2f5472fe3dc service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Received event network-changed-a35cf440-e574-46d9-acb0-9602b9da7f02 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:00:50 user nova-compute[75391]: DEBUG nova.compute.manager [req-54f23303-db96-4c2d-81a6-6cafdf7f67ca req-fae224a6-4966-4833-9802-c2f5472fe3dc service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Refreshing instance network info cache due to event network-changed-a35cf440-e574-46d9-acb0-9602b9da7f02. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:00:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-54f23303-db96-4c2d-81a6-6cafdf7f67ca req-fae224a6-4966-4833-9802-c2f5472fe3dc service nova] Acquiring lock "refresh_cache-2316b79b-8366-4f90-b12f-4407db67ba64" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:00:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-54f23303-db96-4c2d-81a6-6cafdf7f67ca req-fae224a6-4966-4833-9802-c2f5472fe3dc service nova] Acquired lock "refresh_cache-2316b79b-8366-4f90-b12f-4407db67ba64" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:00:50 user nova-compute[75391]: DEBUG nova.network.neutron [req-54f23303-db96-4c2d-81a6-6cafdf7f67ca req-fae224a6-4966-4833-9802-c2f5472fe3dc service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Refreshing network info cache for port a35cf440-e574-46d9-acb0-9602b9da7f02 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:00:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-29f5a571-93c2-41e9-8c00-df3f0a364d04 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "fc9484c0-9083-4797-8ab1-2ad392822ce8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-29f5a571-93c2-41e9-8c00-df3f0a364d04 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "fc9484c0-9083-4797-8ab1-2ad392822ce8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-29f5a571-93c2-41e9-8c00-df3f0a364d04 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "fc9484c0-9083-4797-8ab1-2ad392822ce8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-29f5a571-93c2-41e9-8c00-df3f0a364d04 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "fc9484c0-9083-4797-8ab1-2ad392822ce8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-29f5a571-93c2-41e9-8c00-df3f0a364d04 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "fc9484c0-9083-4797-8ab1-2ad392822ce8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:51 user nova-compute[75391]: INFO nova.compute.manager [None req-29f5a571-93c2-41e9-8c00-df3f0a364d04 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Terminating instance
Nov 15 03:00:51 user nova-compute[75391]: DEBUG nova.compute.manager [None req-29f5a571-93c2-41e9-8c00-df3f0a364d04 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 03:00:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:51 user nova-compute[75391]: DEBUG nova.network.neutron [req-54f23303-db96-4c2d-81a6-6cafdf7f67ca req-fae224a6-4966-4833-9802-c2f5472fe3dc service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Updated VIF entry in instance network info cache for port a35cf440-e574-46d9-acb0-9602b9da7f02. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:00:51 user nova-compute[75391]: DEBUG nova.network.neutron [req-54f23303-db96-4c2d-81a6-6cafdf7f67ca req-fae224a6-4966-4833-9802-c2f5472fe3dc service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Updating instance_info_cache with network_info: [{"id": "a35cf440-e574-46d9-acb0-9602b9da7f02", "address": "fa:16:3e:85:6f:38", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa35cf440-e5", "ovs_interfaceid": "a35cf440-e574-46d9-acb0-9602b9da7f02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:00:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-54f23303-db96-4c2d-81a6-6cafdf7f67ca req-fae224a6-4966-4833-9802-c2f5472fe3dc service nova] Releasing lock "refresh_cache-2316b79b-8366-4f90-b12f-4407db67ba64" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:00:51 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Instance destroyed successfully.
Nov 15 03:00:51 user nova-compute[75391]: DEBUG nova.objects.instance [None req-29f5a571-93c2-41e9-8c00-df3f0a364d04 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lazy-loading 'resources' on Instance uuid fc9484c0-9083-4797-8ab1-2ad392822ce8 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:00:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-29f5a571-93c2-41e9-8c00-df3f0a364d04 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-300199683',display_name='tempest-ServerActionsTestOtherA-server-300199683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-300199683',id=3,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItI9ByRPHa+npkHzUM7/DmFQcMmvmf/UTbrL8IIRz+RgnE4/GT/cT4MtYBSEthl3H1QqF7/CYKc5G1nHfxc2lqIIfQchUdl2quGrdDYzv011COZxukmBFCsP+0gJadT/A==',key_name='tempest-keypair-1167614249',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:42:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81798f0465704c4d9c09d8c3d3175ac5',ramdisk_id='',reservation_id='r-j2v8xjn2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1177660790',owner_user_name='tempest-ServerActionsTestOtherA-1177660790-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:42:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ea5480ad1e49afa394e636c37e3b70',uuid=fc9484c0-9083-4797-8ab1-2ad392822ce8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8f34e4c-5c99-45eb-a282-a721a2019209", "address": "fa:16:3e:ca:58:46", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f34e4c-5c", "ovs_interfaceid": "d8f34e4c-5c99-45eb-a282-a721a2019209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 03:00:51 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-29f5a571-93c2-41e9-8c00-df3f0a364d04 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converting VIF {"id": "d8f34e4c-5c99-45eb-a282-a721a2019209", "address": "fa:16:3e:ca:58:46", "network": {"id": "1400ecf3-ee03-4e00-89cf-d8f3aae45e2d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1680507754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81798f0465704c4d9c09d8c3d3175ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f34e4c-5c", "ovs_interfaceid": "d8f34e4c-5c99-45eb-a282-a721a2019209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:00:51 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-29f5a571-93c2-41e9-8c00-df3f0a364d04 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:58:46,bridge_name='br-int',has_traffic_filtering=True,id=d8f34e4c-5c99-45eb-a282-a721a2019209,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8f34e4c-5c') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:00:51 user nova-compute[75391]: DEBUG os_vif [None req-29f5a571-93c2-41e9-8c00-df3f0a364d04 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:58:46,bridge_name='br-int',has_traffic_filtering=True,id=d8f34e4c-5c99-45eb-a282-a721a2019209,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8f34e4c-5c') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 03:00:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8f34e4c-5c, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:00:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9ff80f7-5571-4ab6-aaff-3c3238945fa6) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:00:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:00:51 user nova-compute[75391]: INFO os_vif [None req-29f5a571-93c2-41e9-8c00-df3f0a364d04 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:58:46,bridge_name='br-int',has_traffic_filtering=True,id=d8f34e4c-5c99-45eb-a282-a721a2019209,network=Network(1400ecf3-ee03-4e00-89cf-d8f3aae45e2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8f34e4c-5c')
Nov 15 03:00:51 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-29f5a571-93c2-41e9-8c00-df3f0a364d04 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Deleting instance files /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8_del
Nov 15 03:00:51 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-29f5a571-93c2-41e9-8c00-df3f0a364d04 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Deletion of /opt/stack/data/nova/instances/fc9484c0-9083-4797-8ab1-2ad392822ce8_del complete
Nov 15 03:00:51 user nova-compute[75391]: INFO nova.compute.manager [None req-29f5a571-93c2-41e9-8c00-df3f0a364d04 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 15 03:00:51 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-29f5a571-93c2-41e9-8c00-df3f0a364d04 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 03:00:51 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 03:00:51 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 03:00:52 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:00:52 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Took 0.44 seconds to deallocate network for instance.
Nov 15 03:00:52 user nova-compute[75391]: DEBUG nova.compute.manager [req-1e8f6443-ffcd-443c-8ea2-4923fdd0cfd4 req-b80be061-7fbc-4772-a53c-efada8dff9a8 service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Received event network-vif-deleted-d8f34e4c-5c99-45eb-a282-a721a2019209 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:00:52 user nova-compute[75391]: INFO nova.compute.manager [req-1e8f6443-ffcd-443c-8ea2-4923fdd0cfd4 req-b80be061-7fbc-4772-a53c-efada8dff9a8 service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Neutron deleted interface d8f34e4c-5c99-45eb-a282-a721a2019209; detaching it from the instance and deleting it from the info cache
Nov 15 03:00:52 user nova-compute[75391]: DEBUG nova.network.neutron [req-1e8f6443-ffcd-443c-8ea2-4923fdd0cfd4 req-b80be061-7fbc-4772-a53c-efada8dff9a8 service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:00:52 user nova-compute[75391]: DEBUG nova.compute.manager [req-1e8f6443-ffcd-443c-8ea2-4923fdd0cfd4 req-b80be061-7fbc-4772-a53c-efada8dff9a8 service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Detach interface failed, port_id=d8f34e4c-5c99-45eb-a282-a721a2019209, reason: Instance fc9484c0-9083-4797-8ab1-2ad392822ce8 could not be found. {{(pid=75391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 03:00:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-29f5a571-93c2-41e9-8c00-df3f0a364d04 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-29f5a571-93c2-41e9-8c00-df3f0a364d04 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "2316b79b-8366-4f90-b12f-4407db67ba64" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "2316b79b-8366-4f90-b12f-4407db67ba64" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:52 user nova-compute[75391]: INFO nova.compute.manager [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Shelving
Nov 15 03:00:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:52 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-29f5a571-93c2-41e9-8c00-df3f0a364d04 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:00:52 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-29f5a571-93c2-41e9-8c00-df3f0a364d04 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:00:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-29f5a571-93c2-41e9-8c00-df3f0a364d04 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:52 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-29f5a571-93c2-41e9-8c00-df3f0a364d04 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Deleted allocations for instance fc9484c0-9083-4797-8ab1-2ad392822ce8
Nov 15 03:00:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-29f5a571-93c2-41e9-8c00-df3f0a364d04 tempest-ServerActionsTestOtherA-1177660790 tempest-ServerActionsTestOtherA-1177660790-project-member] Lock "fc9484c0-9083-4797-8ab1-2ad392822ce8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.648s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:52 user nova-compute[75391]: DEBUG nova.compute.manager [req-523db4c2-5ebc-433c-8e83-a7edc98d81db req-7edd1874-06b1-4169-880b-cf14f1c8e753 service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Received event network-vif-unplugged-a35cf440-e574-46d9-acb0-9602b9da7f02 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:00:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-523db4c2-5ebc-433c-8e83-a7edc98d81db req-7edd1874-06b1-4169-880b-cf14f1c8e753 service nova] Acquiring lock "2316b79b-8366-4f90-b12f-4407db67ba64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-523db4c2-5ebc-433c-8e83-a7edc98d81db req-7edd1874-06b1-4169-880b-cf14f1c8e753 service nova] Lock "2316b79b-8366-4f90-b12f-4407db67ba64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-523db4c2-5ebc-433c-8e83-a7edc98d81db req-7edd1874-06b1-4169-880b-cf14f1c8e753 service nova] Lock "2316b79b-8366-4f90-b12f-4407db67ba64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:52 user nova-compute[75391]: DEBUG nova.compute.manager [req-523db4c2-5ebc-433c-8e83-a7edc98d81db req-7edd1874-06b1-4169-880b-cf14f1c8e753 service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] No waiting events found dispatching network-vif-unplugged-a35cf440-e574-46d9-acb0-9602b9da7f02 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:00:52 user nova-compute[75391]: WARNING nova.compute.manager [req-523db4c2-5ebc-433c-8e83-a7edc98d81db req-7edd1874-06b1-4169-880b-cf14f1c8e753 service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Received unexpected event network-vif-unplugged-a35cf440-e574-46d9-acb0-9602b9da7f02 for instance with vm_state active and task_state shelving.
Nov 15 03:00:52 user nova-compute[75391]: DEBUG nova.compute.manager [req-21514e7f-199a-4f11-b350-9e783dccef64 req-f31d77aa-486a-4ab5-bf71-8f63bc78b0d6 service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Received event network-vif-unplugged-d8f34e4c-5c99-45eb-a282-a721a2019209 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:00:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-21514e7f-199a-4f11-b350-9e783dccef64 req-f31d77aa-486a-4ab5-bf71-8f63bc78b0d6 service nova] Acquiring lock "fc9484c0-9083-4797-8ab1-2ad392822ce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-21514e7f-199a-4f11-b350-9e783dccef64 req-f31d77aa-486a-4ab5-bf71-8f63bc78b0d6 service nova] Lock "fc9484c0-9083-4797-8ab1-2ad392822ce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-21514e7f-199a-4f11-b350-9e783dccef64 req-f31d77aa-486a-4ab5-bf71-8f63bc78b0d6 service nova] Lock "fc9484c0-9083-4797-8ab1-2ad392822ce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:52 user nova-compute[75391]: DEBUG nova.compute.manager [req-21514e7f-199a-4f11-b350-9e783dccef64 req-f31d77aa-486a-4ab5-bf71-8f63bc78b0d6 service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] No waiting events found dispatching network-vif-unplugged-d8f34e4c-5c99-45eb-a282-a721a2019209 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:00:52 user nova-compute[75391]: WARNING nova.compute.manager [req-21514e7f-199a-4f11-b350-9e783dccef64 req-f31d77aa-486a-4ab5-bf71-8f63bc78b0d6 service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Received unexpected event network-vif-unplugged-d8f34e4c-5c99-45eb-a282-a721a2019209 for instance with vm_state deleted and task_state None.
Nov 15 03:00:52 user nova-compute[75391]: DEBUG nova.compute.manager [req-21514e7f-199a-4f11-b350-9e783dccef64 req-f31d77aa-486a-4ab5-bf71-8f63bc78b0d6 service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Received event network-vif-plugged-d8f34e4c-5c99-45eb-a282-a721a2019209 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:00:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-21514e7f-199a-4f11-b350-9e783dccef64 req-f31d77aa-486a-4ab5-bf71-8f63bc78b0d6 service nova] Acquiring lock "fc9484c0-9083-4797-8ab1-2ad392822ce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-21514e7f-199a-4f11-b350-9e783dccef64 req-f31d77aa-486a-4ab5-bf71-8f63bc78b0d6 service nova] Lock "fc9484c0-9083-4797-8ab1-2ad392822ce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-21514e7f-199a-4f11-b350-9e783dccef64 req-f31d77aa-486a-4ab5-bf71-8f63bc78b0d6 service nova] Lock "fc9484c0-9083-4797-8ab1-2ad392822ce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:52 user nova-compute[75391]: DEBUG nova.compute.manager [req-21514e7f-199a-4f11-b350-9e783dccef64 req-f31d77aa-486a-4ab5-bf71-8f63bc78b0d6 service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] No waiting events found dispatching network-vif-plugged-d8f34e4c-5c99-45eb-a282-a721a2019209 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:00:52 user nova-compute[75391]: WARNING nova.compute.manager [req-21514e7f-199a-4f11-b350-9e783dccef64 req-f31d77aa-486a-4ab5-bf71-8f63bc78b0d6 service nova] [instance: fc9484c0-9083-4797-8ab1-2ad392822ce8] Received unexpected event network-vif-plugged-d8f34e4c-5c99-45eb-a282-a721a2019209 for instance with vm_state deleted and task_state None.
Nov 15 03:00:52 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Instance destroyed successfully.
Nov 15 03:00:52 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Beginning cold snapshot process
Nov 15 03:00:53 user nova-compute[75391]: DEBUG nova.privsep.utils [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 03:00:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk /opt/stack/data/nova/instances/snapshots/tmpqpy2nizj/15598862844d4bdc8781b5966666cff3 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk /opt/stack/data/nova/instances/snapshots/tmpqpy2nizj/15598862844d4bdc8781b5966666cff3" returned: 0 in 0.916s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:53 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Snapshot extracted, beginning image upload
Nov 15 03:00:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ngLYyvKl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:00:54 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:00:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:00:54 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:00:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:00:54 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53f133f-e5a7-4528-af45-243c512373f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 03:00:54 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d635f2fd-da28-4769-9dfd-f7d1ff681230]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e] added
Nov 15 03:00:54 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f977def8-13fa-4f27-ad75-2af57f7978b9]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1e72ad-cdcb-4e23-a659-ec06a2cce12d]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ngLYyvKl {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ngLYyvKl" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b438ff6-c707-46b6-839c-c1f8fc8cdd21]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ngLYyvKl'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0878aa7d-b951-41de-8c99-d9a965bebe23]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de0b801-9a3e-40fb-bf6b-b24fde0dfd2a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 03:00:54 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 03:00:54 user nova-compute[75391]:  {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:00:54 user nova-compute[75391]: WARNING os_brick.initiator.connectors.iscsi [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 03:00:54 user nova-compute[75391]: 
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[916d73cc-091b-4f50-96f0-56e094b6b771]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e, portal: 172.16.0.220,3260]
Nov 15 03:00:54 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e, portal: 172.16.0.220,3260] successful.
Nov 15 03:00:54 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee37e6ee-cc3a-40ee-8962-dcb63c6fe63c]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff746ca-59cd-4e74-a6fd-ae1ca5f31e0b]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e (non-flash)
Nov 15 03:00:54 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e (non-flash)
Nov 15 03:00:54 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[14076749-6992-45b9-9e57-33a2380108b3]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ngLYyvKl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG nova.compute.manager [req-46940d81-d3a0-42a0-ae21-46ce86df2d90 req-9d614139-c2fa-450a-a4a8-8a394b453874 service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Received event network-vif-plugged-a35cf440-e574-46d9-acb0-9602b9da7f02 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-46940d81-d3a0-42a0-ae21-46ce86df2d90 req-9d614139-c2fa-450a-a4a8-8a394b453874 service nova] Acquiring lock "2316b79b-8366-4f90-b12f-4407db67ba64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-46940d81-d3a0-42a0-ae21-46ce86df2d90 req-9d614139-c2fa-450a-a4a8-8a394b453874 service nova] Lock "2316b79b-8366-4f90-b12f-4407db67ba64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-46940d81-d3a0-42a0-ae21-46ce86df2d90 req-9d614139-c2fa-450a-a4a8-8a394b453874 service nova] Lock "2316b79b-8366-4f90-b12f-4407db67ba64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:54 user nova-compute[75391]: DEBUG nova.compute.manager [req-46940d81-d3a0-42a0-ae21-46ce86df2d90 req-9d614139-c2fa-450a-a4a8-8a394b453874 service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] No waiting events found dispatching network-vif-plugged-a35cf440-e574-46d9-acb0-9602b9da7f02 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:00:54 user nova-compute[75391]: WARNING nova.compute.manager [req-46940d81-d3a0-42a0-ae21-46ce86df2d90 req-9d614139-c2fa-450a-a4a8-8a394b453874 service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Received unexpected event network-vif-plugged-a35cf440-e574-46d9-acb0-9602b9da7f02 for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 03:00:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:00:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23931646232613932', 'path': '/dev/sdb'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:00:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931646232613932', 'path': '/dev/sdb'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 03:00:55 user nova-compute[75391]: DEBUG nova.objects.instance [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'flavor' on Instance uuid 2a8d7b01-d19e-4484-aa06-272de268e376 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:00:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 03:00:55 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:00:55 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 03:00:55 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 03:00:55 user nova-compute[75391]:   <serial>7c07a1f1-b1b6-4759-9c20-f9e04a6b968e</serial>
Nov 15 03:00:55 user nova-compute[75391]: </disk>
Nov 15 03:00:55 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 03:00:55 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:00:55 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:00:55 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:00:55 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Didn't find any instances for network info cache update. {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 03:00:55 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:00:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:00:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:00:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] No VIF found with MAC fa:16:3e:31:51:9b, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 03:00:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f0fe2121-6a77-4291-b1f5-035c64e693e3 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "2a8d7b01-d19e-4484-aa06-272de268e376" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.924s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:56 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Snapshot image upload complete
Nov 15 03:00:56 user nova-compute[75391]: DEBUG nova.compute.manager [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 03:00:56 user nova-compute[75391]: INFO nova.compute.manager [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Shelve offloading
Nov 15 03:00:56 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Instance destroyed successfully.
Nov 15 03:00:56 user nova-compute[75391]: DEBUG nova.compute.manager [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 03:00:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "refresh_cache-2316b79b-8366-4f90-b12f-4407db67ba64" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:00:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquired lock "refresh_cache-2316b79b-8366-4f90-b12f-4407db67ba64" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:00:56 user nova-compute[75391]: DEBUG nova.network.neutron [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 03:00:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:57 user nova-compute[75391]: DEBUG nova.network.neutron [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Updating instance_info_cache with network_info: [{"id": "a35cf440-e574-46d9-acb0-9602b9da7f02", "address": "fa:16:3e:85:6f:38", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa35cf440-e5", "ovs_interfaceid": "a35cf440-e574-46d9-acb0-9602b9da7f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:00:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Releasing lock "refresh_cache-2316b79b-8366-4f90-b12f-4407db67ba64" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:00:57 user nova-compute[75391]: INFO nova.compute.manager [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Rescuing
Nov 15 03:00:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "refresh_cache-2a8d7b01-d19e-4484-aa06-272de268e376" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:00:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquired lock "refresh_cache-2a8d7b01-d19e-4484-aa06-272de268e376" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:00:57 user nova-compute[75391]: DEBUG nova.network.neutron [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 03:00:57 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:00:57 user nova-compute[75391]: DEBUG nova.network.neutron [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Updating instance_info_cache with network_info: [{"id": "90ba99bb-115f-4726-9944-9409490db504", "address": "fa:16:3e:31:51:9b", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ba99bb-11", "ovs_interfaceid": "90ba99bb-115f-4726-9944-9409490db504", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:00:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Releasing lock "refresh_cache-2a8d7b01-d19e-4484-aa06-272de268e376" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:00:57 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Instance destroyed successfully.
Nov 15 03:00:57 user nova-compute[75391]: DEBUG nova.objects.instance [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lazy-loading 'resources' on Instance uuid 2316b79b-8366-4f90-b12f-4407db67ba64 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:00:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:58:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1482534692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1482534692',id=37,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvMjjliJ566FQMHT1T/lDX3ih1jNIg/g/cs9dRru8ZvLLPpfmeNWYvht71keBrnz0Xw5g478KgMc9qZ3ErTIzYsmP8nzQ4ZT4TxL+SXFtSe+FueqF2smBhVIQUjkyVetw==',key_name='tempest-keypair-29219381',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:59:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f1ec3021653b4209a509852c7a28bf46',ramdisk_id='',reservation_id='r-rksnk0uu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1315675398',owner_user_name='tempest-AttachVolumeShelveTestJSON-1315675398-project-member',shelved_at='2023-11-15T03:00:56.544896',shelved_host='user',shelved_image_id='aaa466ce-5d13-4fa4-aabd-956f5c126fb6'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T03:00:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e55cae841f994756843bc97a063ebe86',uuid=2316b79b-8366-4f90-b12f-4407db67ba64,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "a35cf440-e574-46d9-acb0-9602b9da7f02", "address": "fa:16:3e:85:6f:38", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa35cf440-e5", "ovs_interfaceid": "a35cf440-e574-46d9-acb0-9602b9da7f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 03:00:57 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Converting VIF {"id": "a35cf440-e574-46d9-acb0-9602b9da7f02", "address": "fa:16:3e:85:6f:38", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa35cf440-e5", "ovs_interfaceid": "a35cf440-e574-46d9-acb0-9602b9da7f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:00:57 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:6f:38,bridge_name='br-int',has_traffic_filtering=True,id=a35cf440-e574-46d9-acb0-9602b9da7f02,network=Network(64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa35cf440-e5') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:00:57 user nova-compute[75391]: DEBUG os_vif [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:6f:38,bridge_name='br-int',has_traffic_filtering=True,id=a35cf440-e574-46d9-acb0-9602b9da7f02,network=Network(64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa35cf440-e5') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 03:00:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa35cf440-e5, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:00:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:57 user nova-compute[75391]: DEBUG nova.compute.manager [req-6e2adc5b-098a-4abe-86a2-ea50f378b4a8 req-847e7840-5c05-4185-b30e-45571cde060a service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Received event network-changed-a35cf440-e574-46d9-acb0-9602b9da7f02 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:00:57 user nova-compute[75391]: DEBUG nova.compute.manager [req-6e2adc5b-098a-4abe-86a2-ea50f378b4a8 req-847e7840-5c05-4185-b30e-45571cde060a service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Refreshing instance network info cache due to event network-changed-a35cf440-e574-46d9-acb0-9602b9da7f02. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:00:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6e2adc5b-098a-4abe-86a2-ea50f378b4a8 req-847e7840-5c05-4185-b30e-45571cde060a service nova] Acquiring lock "refresh_cache-2316b79b-8366-4f90-b12f-4407db67ba64" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:00:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6e2adc5b-098a-4abe-86a2-ea50f378b4a8 req-847e7840-5c05-4185-b30e-45571cde060a service nova] Acquired lock "refresh_cache-2316b79b-8366-4f90-b12f-4407db67ba64" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:00:57 user nova-compute[75391]: DEBUG nova.network.neutron [req-6e2adc5b-098a-4abe-86a2-ea50f378b4a8 req-847e7840-5c05-4185-b30e-45571cde060a service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Refreshing network info cache for port a35cf440-e574-46d9-acb0-9602b9da7f02 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:00:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:00:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=18a7d7eb-1d7c-4c6d-8c6e-b358b680f33d) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:00:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:00:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:57 user nova-compute[75391]: INFO os_vif [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:6f:38,bridge_name='br-int',has_traffic_filtering=True,id=a35cf440-e574-46d9-acb0-9602b9da7f02,network=Network(64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa35cf440-e5')
Nov 15 03:00:57 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Deleting instance files /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64_del
Nov 15 03:00:57 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Deletion of /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64_del complete
Nov 15 03:00:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:58 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Deleted allocations for instance 2316b79b-8366-4f90-b12f-4407db67ba64
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.compute.manager [req-ccf81708-b1b4-4d46-8ef2-9a0d61402e76 req-67708612-168e-4afb-8e05-6d734d7acdeb service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received event network-vif-unplugged-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ccf81708-b1b4-4d46-8ef2-9a0d61402e76 req-67708612-168e-4afb-8e05-6d734d7acdeb service nova] Acquiring lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ccf81708-b1b4-4d46-8ef2-9a0d61402e76 req-67708612-168e-4afb-8e05-6d734d7acdeb service nova] Lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ccf81708-b1b4-4d46-8ef2-9a0d61402e76 req-67708612-168e-4afb-8e05-6d734d7acdeb service nova] Lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.compute.manager [req-ccf81708-b1b4-4d46-8ef2-9a0d61402e76 req-67708612-168e-4afb-8e05-6d734d7acdeb service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] No waiting events found dispatching network-vif-unplugged-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:00:58 user nova-compute[75391]: WARNING nova.compute.manager [req-ccf81708-b1b4-4d46-8ef2-9a0d61402e76 req-67708612-168e-4afb-8e05-6d734d7acdeb service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received unexpected event network-vif-unplugged-90ba99bb-115f-4726-9944-9409490db504 for instance with vm_state active and task_state rescuing.
Nov 15 03:00:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.objects.instance [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lazy-loading 'numa_topology' on Instance uuid 2316b79b-8366-4f90-b12f-4407db67ba64 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.objects.base [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Object Instance<2316b79b-8366-4f90-b12f-4407db67ba64> lazy-loaded attributes: resources,numa_topology {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.network.neutron [req-6e2adc5b-098a-4abe-86a2-ea50f378b4a8 req-847e7840-5c05-4185-b30e-45571cde060a service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Updated VIF entry in instance network info cache for port a35cf440-e574-46d9-acb0-9602b9da7f02. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.network.neutron [req-6e2adc5b-098a-4abe-86a2-ea50f378b4a8 req-847e7840-5c05-4185-b30e-45571cde060a service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Updating instance_info_cache with network_info: [{"id": "a35cf440-e574-46d9-acb0-9602b9da7f02", "address": "fa:16:3e:85:6f:38", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa35cf440-e5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6e2adc5b-098a-4abe-86a2-ea50f378b4a8 req-847e7840-5c05-4185-b30e-45571cde060a service nova] Releasing lock "refresh_cache-2316b79b-8366-4f90-b12f-4407db67ba64" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-868971dd-07f9-4283-9491-8cff9ae0af7b tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "2316b79b-8366-4f90-b12f-4407db67ba64" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.211s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:58 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Instance destroyed successfully.
Nov 15 03:00:58 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Attempting rescue
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75391) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Instance directory exists: not creating {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 03:00:58 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Creating image(s)
Nov 15 03:00:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "/opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "/opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.objects.instance [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2a8d7b01-d19e-4484-aa06-272de268e376 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.176s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk.rescue {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk.rescue" returned: 0 in 0.049s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.objects.instance [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'migration_context' on Instance uuid 2a8d7b01-d19e-4484-aa06-272de268e376 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.objects.base [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Object Instance<2a8d7b01-d19e-4484-aa06-272de268e376> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Start _get_guest_xml network_info=[{"id": "90ba99bb-115f-4726-9944-9409490db504", "address": "fa:16:3e:31:51:9b", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "vif_mac": "fa:16:3e:31:51:9b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ba99bb-11", "ovs_interfaceid": "90ba99bb-115f-4726-9944-9409490db504", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.objects.instance [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'resources' on Instance uuid 2a8d7b01-d19e-4484-aa06-272de268e376 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.objects.base [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Object Instance<2a8d7b01-d19e-4484-aa06-272de268e376> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.objects.instance [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'numa_topology' on Instance uuid 2a8d7b01-d19e-4484-aa06-272de268e376 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.objects.base [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Object Instance<2a8d7b01-d19e-4484-aa06-272de268e376> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 03:00:58 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:00:58 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.objects.instance [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2a8d7b01-d19e-4484-aa06-272de268e376 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.objects.base [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Object Instance<2a8d7b01-d19e-4484-aa06-272de268e376> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:58:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-76853416',display_name='tempest-ServerRescueNegativeTestJSON-server-76853416',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-76853416',id=36,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKhaSGqkAzqoum9cargZcVScRKDn1aseIr3GdLRDApyAQ9Xe9xaDmZe3UVdGEeCJjSw59lcw42052OFJbiRx2gsQ9lF8J0h8H1P4kefig/DmS2Avx4QZkI5VTKZo+/Bnw==',key_name='tempest-keypair-660591234',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:59:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8bfe79a4e16f4fa89437bcc50fc4b356',ramdisk_id='',reservation_id='r-13eb6cmf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-388649299',owner_user_name='tempest-ServerRescueNegativeTestJSON-388649299-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:59:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b3fc7a83f6c4c5baa7621163e9f62aa',uuid=2a8d7b01-d19e-4484-aa06-272de268e376,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90ba99bb-115f-4726-9944-9409490db504", "address": "fa:16:3e:31:51:9b", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "vif_mac": "fa:16:3e:31:51:9b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ba99bb-11", "ovs_interfaceid": "90ba99bb-115f-4726-9944-9409490db504", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Converting VIF {"id": "90ba99bb-115f-4726-9944-9409490db504", "address": "fa:16:3e:31:51:9b", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "vif_mac": "fa:16:3e:31:51:9b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ba99bb-11", "ovs_interfaceid": "90ba99bb-115f-4726-9944-9409490db504", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:51:9b,bridge_name='br-int',has_traffic_filtering=True,id=90ba99bb-115f-4726-9944-9409490db504,network=Network(079437cd-2e7d-40ea-98c0-24a1c9091aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ba99bb-11') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.objects.instance [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a8d7b01-d19e-4484-aa06-272de268e376 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.objects.base [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Object Instance<2a8d7b01-d19e-4484-aa06-272de268e376> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 03:00:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] End _get_guest_xml xml=<domain type="kvm">
Nov 15 03:00:58 user nova-compute[75391]:   <uuid>2a8d7b01-d19e-4484-aa06-272de268e376</uuid>
Nov 15 03:00:58 user nova-compute[75391]:   <name>instance-00000024</name>
Nov 15 03:00:58 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 03:00:58 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 03:00:58 user nova-compute[75391]:   <metadata>
Nov 15 03:00:58 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 03:00:58 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 03:00:58 user nova-compute[75391]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-76853416</nova:name>
Nov 15 03:00:58 user nova-compute[75391]:       <nova:creationTime>2023-11-15 03:00:58</nova:creationTime>
Nov 15 03:00:58 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 03:00:58 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 03:00:58 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 03:00:58 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 03:00:58 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 03:00:58 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 03:00:58 user nova-compute[75391]:       </nova:flavor>
Nov 15 03:00:58 user nova-compute[75391]:       <nova:owner>
Nov 15 03:00:58 user nova-compute[75391]:         <nova:user uuid="9b3fc7a83f6c4c5baa7621163e9f62aa">tempest-ServerRescueNegativeTestJSON-388649299-project-member</nova:user>
Nov 15 03:00:58 user nova-compute[75391]:         <nova:project uuid="8bfe79a4e16f4fa89437bcc50fc4b356">tempest-ServerRescueNegativeTestJSON-388649299</nova:project>
Nov 15 03:00:58 user nova-compute[75391]:       </nova:owner>
Nov 15 03:00:58 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 03:00:58 user nova-compute[75391]:       <nova:ports>
Nov 15 03:00:58 user nova-compute[75391]:         <nova:port uuid="90ba99bb-115f-4726-9944-9409490db504">
Nov 15 03:00:58 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 03:00:58 user nova-compute[75391]:         </nova:port>
Nov 15 03:00:58 user nova-compute[75391]:       </nova:ports>
Nov 15 03:00:58 user nova-compute[75391]:     </nova:instance>
Nov 15 03:00:58 user nova-compute[75391]:   </metadata>
Nov 15 03:00:58 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 03:00:58 user nova-compute[75391]:     <system>
Nov 15 03:00:58 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 03:00:58 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 03:00:58 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 03:00:58 user nova-compute[75391]:       <entry name="serial">2a8d7b01-d19e-4484-aa06-272de268e376</entry>
Nov 15 03:00:58 user nova-compute[75391]:       <entry name="uuid">2a8d7b01-d19e-4484-aa06-272de268e376</entry>
Nov 15 03:00:58 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 03:00:58 user nova-compute[75391]:     </system>
Nov 15 03:00:58 user nova-compute[75391]:   </sysinfo>
Nov 15 03:00:58 user nova-compute[75391]:   <os>
Nov 15 03:00:58 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 03:00:58 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 03:00:58 user nova-compute[75391]:   </os>
Nov 15 03:00:58 user nova-compute[75391]:   <features>
Nov 15 03:00:58 user nova-compute[75391]:     <acpi/>
Nov 15 03:00:58 user nova-compute[75391]:     <apic/>
Nov 15 03:00:58 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 03:00:58 user nova-compute[75391]:   </features>
Nov 15 03:00:58 user nova-compute[75391]:   <clock offset="utc">
Nov 15 03:00:58 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 03:00:58 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 03:00:58 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 03:00:58 user nova-compute[75391]:   </clock>
Nov 15 03:00:58 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 03:00:58 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 03:00:58 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 03:00:58 user nova-compute[75391]:   </cpu>
Nov 15 03:00:58 user nova-compute[75391]:   <devices>
Nov 15 03:00:58 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 03:00:58 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 03:00:58 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk.rescue"/>
Nov 15 03:00:58 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 03:00:58 user nova-compute[75391]:     </disk>
Nov 15 03:00:58 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 03:00:58 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 03:00:58 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk"/>
Nov 15 03:00:58 user nova-compute[75391]:       <target dev="vdb" bus="virtio"/>
Nov 15 03:00:58 user nova-compute[75391]:     </disk>
Nov 15 03:00:58 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 03:00:58 user nova-compute[75391]:       <mac address="fa:16:3e:31:51:9b"/>
Nov 15 03:00:58 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:00:58 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 03:00:58 user nova-compute[75391]:       <target dev="tap90ba99bb-11"/>
Nov 15 03:00:58 user nova-compute[75391]:     </interface>
Nov 15 03:00:58 user nova-compute[75391]:     <serial type="pty">
Nov 15 03:00:58 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/console.log" append="off"/>
Nov 15 03:00:58 user nova-compute[75391]:     </serial>
Nov 15 03:00:58 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 03:00:58 user nova-compute[75391]:     <video>
Nov 15 03:00:58 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:00:58 user nova-compute[75391]:     </video>
Nov 15 03:00:58 user nova-compute[75391]:     <rng model="virtio">
Nov 15 03:00:58 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 03:00:58 user nova-compute[75391]:     </rng>
Nov 15 03:00:58 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 03:00:58 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 03:00:58 user nova-compute[75391]:       <stats period="10"/>
Nov 15 03:00:58 user nova-compute[75391]:     </memballoon>
Nov 15 03:00:58 user nova-compute[75391]:   </devices>
Nov 15 03:00:58 user nova-compute[75391]: </domain>
Nov 15 03:00:58 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 03:00:58 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Instance destroyed successfully.
Nov 15 03:00:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:00:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:00:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] No VIF found with MAC fa:16:3e:31:51:9b, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 03:00:59 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:01:00 user nova-compute[75391]: DEBUG nova.compute.manager [req-e16d8786-a575-407e-a563-719071bfcff4 req-3dabb66a-b25a-4252-bf6c-02e8dfb94045 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received event network-vif-plugged-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:01:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e16d8786-a575-407e-a563-719071bfcff4 req-3dabb66a-b25a-4252-bf6c-02e8dfb94045 service nova] Acquiring lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:01:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e16d8786-a575-407e-a563-719071bfcff4 req-3dabb66a-b25a-4252-bf6c-02e8dfb94045 service nova] Lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:01:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e16d8786-a575-407e-a563-719071bfcff4 req-3dabb66a-b25a-4252-bf6c-02e8dfb94045 service nova] Lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:01:00 user nova-compute[75391]: DEBUG nova.compute.manager [req-e16d8786-a575-407e-a563-719071bfcff4 req-3dabb66a-b25a-4252-bf6c-02e8dfb94045 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] No waiting events found dispatching network-vif-plugged-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:01:00 user nova-compute[75391]: WARNING nova.compute.manager [req-e16d8786-a575-407e-a563-719071bfcff4 req-3dabb66a-b25a-4252-bf6c-02e8dfb94045 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received unexpected event network-vif-plugged-90ba99bb-115f-4726-9944-9409490db504 for instance with vm_state active and task_state rescuing.
Nov 15 03:01:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:01 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:01:01 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:01:01 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:01:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:01:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:01:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:01:01 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:01:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:01:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:01:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:01:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-074e6b34-6b7b-4dd0-b031-959ca478a3fe req-04b11da7-09e2-46d1-869b-05ccd4d639e8 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received event network-vif-plugged-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:01:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-074e6b34-6b7b-4dd0-b031-959ca478a3fe req-04b11da7-09e2-46d1-869b-05ccd4d639e8 service nova] Acquiring lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:01:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-074e6b34-6b7b-4dd0-b031-959ca478a3fe req-04b11da7-09e2-46d1-869b-05ccd4d639e8 service nova] Lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:01:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-074e6b34-6b7b-4dd0-b031-959ca478a3fe req-04b11da7-09e2-46d1-869b-05ccd4d639e8 service nova] Lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:01:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-074e6b34-6b7b-4dd0-b031-959ca478a3fe req-04b11da7-09e2-46d1-869b-05ccd4d639e8 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] No waiting events found dispatching network-vif-plugged-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:01:02 user nova-compute[75391]: WARNING nova.compute.manager [req-074e6b34-6b7b-4dd0-b031-959ca478a3fe req-04b11da7-09e2-46d1-869b-05ccd4d639e8 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received unexpected event network-vif-plugged-90ba99bb-115f-4726-9944-9409490db504 for instance with vm_state active and task_state rescuing.
Nov 15 03:01:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-074e6b34-6b7b-4dd0-b031-959ca478a3fe req-04b11da7-09e2-46d1-869b-05ccd4d639e8 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received event network-vif-plugged-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:01:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-074e6b34-6b7b-4dd0-b031-959ca478a3fe req-04b11da7-09e2-46d1-869b-05ccd4d639e8 service nova] Acquiring lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:01:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-074e6b34-6b7b-4dd0-b031-959ca478a3fe req-04b11da7-09e2-46d1-869b-05ccd4d639e8 service nova] Lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:01:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-074e6b34-6b7b-4dd0-b031-959ca478a3fe req-04b11da7-09e2-46d1-869b-05ccd4d639e8 service nova] Lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:01:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-074e6b34-6b7b-4dd0-b031-959ca478a3fe req-04b11da7-09e2-46d1-869b-05ccd4d639e8 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] No waiting events found dispatching network-vif-plugged-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:01:02 user nova-compute[75391]: WARNING nova.compute.manager [req-074e6b34-6b7b-4dd0-b031-959ca478a3fe req-04b11da7-09e2-46d1-869b-05ccd4d639e8 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received unexpected event network-vif-plugged-90ba99bb-115f-4726-9944-9409490db504 for instance with vm_state active and task_state rescuing.
Nov 15 03:01:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:01:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:01:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:01:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:01:02 user nova-compute[75391]: DEBUG nova.compute.manager [None req-45b9d7ba-d469-4ccf-ae79-0d351d76819f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 03:01:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:01:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 03:01:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:01:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:01:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:01:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:01:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:01:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:01:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:01:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:01:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:01:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:01:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:01:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:01:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:01:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:01:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:01:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:01:04 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:01:04 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:01:04 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8370MB free_disk=24.92413330078125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:01:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:01:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:01:04 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9744c8a1-046e-4a00-92e0-92ebb3275ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:01:04 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9909ae6b-7900-4f71-8900-2bf25185e436 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:01:04 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 7bd332f2-0f74-4a43-96a2-2322b6cbf982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:01:04 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 2a8d7b01-d19e-4484-aa06-272de268e376 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:01:04 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance cadf93c5-d57c-4dfa-a3c6-6c1606049636 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:01:04 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:01:04 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:01:04 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:01:04 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:01:04 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:01:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.329s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:01:05 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:01:05 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:01:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:17 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:22 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:22 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f232f49c-6348-4fba-9422-780a5a612dcb tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "9744c8a1-046e-4a00-92e0-92ebb3275ea9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:01:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f232f49c-6348-4fba-9422-780a5a612dcb tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "9744c8a1-046e-4a00-92e0-92ebb3275ea9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:01:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f232f49c-6348-4fba-9422-780a5a612dcb tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "9744c8a1-046e-4a00-92e0-92ebb3275ea9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:01:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f232f49c-6348-4fba-9422-780a5a612dcb tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "9744c8a1-046e-4a00-92e0-92ebb3275ea9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:01:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f232f49c-6348-4fba-9422-780a5a612dcb tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "9744c8a1-046e-4a00-92e0-92ebb3275ea9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:01:26 user nova-compute[75391]: INFO nova.compute.manager [None req-f232f49c-6348-4fba-9422-780a5a612dcb tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Terminating instance
Nov 15 03:01:26 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f232f49c-6348-4fba-9422-780a5a612dcb tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 03:01:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-dddd1af8-46ea-4f9e-acd2-be19402d2a4f req-62090e82-2e77-4659-a47e-28e51fd5d477 service nova] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Received event network-vif-unplugged-dc4f904f-dd76-4f25-b9e6-41cc42493911 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:01:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-dddd1af8-46ea-4f9e-acd2-be19402d2a4f req-62090e82-2e77-4659-a47e-28e51fd5d477 service nova] Acquiring lock "9744c8a1-046e-4a00-92e0-92ebb3275ea9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:01:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-dddd1af8-46ea-4f9e-acd2-be19402d2a4f req-62090e82-2e77-4659-a47e-28e51fd5d477 service nova] Lock "9744c8a1-046e-4a00-92e0-92ebb3275ea9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:01:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-dddd1af8-46ea-4f9e-acd2-be19402d2a4f req-62090e82-2e77-4659-a47e-28e51fd5d477 service nova] Lock "9744c8a1-046e-4a00-92e0-92ebb3275ea9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:01:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-dddd1af8-46ea-4f9e-acd2-be19402d2a4f req-62090e82-2e77-4659-a47e-28e51fd5d477 service nova] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] No waiting events found dispatching network-vif-unplugged-dc4f904f-dd76-4f25-b9e6-41cc42493911 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:01:26 user nova-compute[75391]: DEBUG nova.compute.manager [req-dddd1af8-46ea-4f9e-acd2-be19402d2a4f req-62090e82-2e77-4659-a47e-28e51fd5d477 service nova] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Received event network-vif-unplugged-dc4f904f-dd76-4f25-b9e6-41cc42493911 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 03:01:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:27 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Instance destroyed successfully.
Nov 15 03:01:27 user nova-compute[75391]: DEBUG nova.objects.instance [None req-f232f49c-6348-4fba-9422-780a5a612dcb tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lazy-loading 'resources' on Instance uuid 9744c8a1-046e-4a00-92e0-92ebb3275ea9 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:01:27 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-f232f49c-6348-4fba-9422-780a5a612dcb tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1769560489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1769560489',id=1,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:42:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e63a88a9fe824c3e9c0807a50b569d54',ramdisk_id='',reservation_id='r-37a096xw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-141063167',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:43:44Z,user_data=None,user_id='0aa106a59c374dde99b7697f94407339',uuid=9744c8a1-046e-4a00-92e0-92ebb3275ea9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc4f904f-dd76-4f25-b9e6-41cc42493911", "address": "fa:16:3e:e6:ec:c3", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4f904f-dd", "ovs_interfaceid": "dc4f904f-dd76-4f25-b9e6-41cc42493911", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 03:01:27 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f232f49c-6348-4fba-9422-780a5a612dcb tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Converting VIF {"id": "dc4f904f-dd76-4f25-b9e6-41cc42493911", "address": "fa:16:3e:e6:ec:c3", "network": {"id": "1aedd33c-2f73-4c89-a32d-522752d7b402", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-207444388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63a88a9fe824c3e9c0807a50b569d54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4f904f-dd", "ovs_interfaceid": "dc4f904f-dd76-4f25-b9e6-41cc42493911", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:01:27 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f232f49c-6348-4fba-9422-780a5a612dcb tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:ec:c3,bridge_name='br-int',has_traffic_filtering=True,id=dc4f904f-dd76-4f25-b9e6-41cc42493911,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4f904f-dd') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:01:27 user nova-compute[75391]: DEBUG os_vif [None req-f232f49c-6348-4fba-9422-780a5a612dcb tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:ec:c3,bridge_name='br-int',has_traffic_filtering=True,id=dc4f904f-dd76-4f25-b9e6-41cc42493911,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4f904f-dd') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 03:01:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc4f904f-dd, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:01:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:01:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2248ab6-9038-4352-ae3d-b0aaf26cc6b9) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:01:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:27 user nova-compute[75391]: INFO os_vif [None req-f232f49c-6348-4fba-9422-780a5a612dcb tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:ec:c3,bridge_name='br-int',has_traffic_filtering=True,id=dc4f904f-dd76-4f25-b9e6-41cc42493911,network=Network(1aedd33c-2f73-4c89-a32d-522752d7b402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4f904f-dd')
Nov 15 03:01:27 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-f232f49c-6348-4fba-9422-780a5a612dcb tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Deleting instance files /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9_del
Nov 15 03:01:27 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-f232f49c-6348-4fba-9422-780a5a612dcb tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Deletion of /opt/stack/data/nova/instances/9744c8a1-046e-4a00-92e0-92ebb3275ea9_del complete
Nov 15 03:01:27 user nova-compute[75391]: INFO nova.compute.manager [None req-f232f49c-6348-4fba-9422-780a5a612dcb tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Took 0.80 seconds to destroy the instance on the hypervisor.
Nov 15 03:01:27 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-f232f49c-6348-4fba-9422-780a5a612dcb tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 03:01:27 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 03:01:27 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 03:01:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:27 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:01:27 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Took 0.70 seconds to deallocate network for instance.
Nov 15 03:01:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-ec5f0811-0a8b-46f2-8d6f-863a8dded136 req-a44323f4-a149-400a-bc51-a3d7c68a9ca7 service nova] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Received event network-vif-deleted-dc4f904f-dd76-4f25-b9e6-41cc42493911 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:01:27 user nova-compute[75391]: INFO nova.compute.manager [req-ec5f0811-0a8b-46f2-8d6f-863a8dded136 req-a44323f4-a149-400a-bc51-a3d7c68a9ca7 service nova] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Neutron deleted interface dc4f904f-dd76-4f25-b9e6-41cc42493911; detaching it from the instance and deleting it from the info cache
Nov 15 03:01:27 user nova-compute[75391]: DEBUG nova.network.neutron [req-ec5f0811-0a8b-46f2-8d6f-863a8dded136 req-a44323f4-a149-400a-bc51-a3d7c68a9ca7 service nova] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:01:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-ec5f0811-0a8b-46f2-8d6f-863a8dded136 req-a44323f4-a149-400a-bc51-a3d7c68a9ca7 service nova] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Detach interface failed, port_id=dc4f904f-dd76-4f25-b9e6-41cc42493911, reason: Instance 9744c8a1-046e-4a00-92e0-92ebb3275ea9 could not be found. {{(pid=75391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 03:01:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f232f49c-6348-4fba-9422-780a5a612dcb tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:01:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f232f49c-6348-4fba-9422-780a5a612dcb tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:01:28 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-f232f49c-6348-4fba-9422-780a5a612dcb tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:01:28 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-f232f49c-6348-4fba-9422-780a5a612dcb tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:01:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f232f49c-6348-4fba-9422-780a5a612dcb tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:01:28 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-f232f49c-6348-4fba-9422-780a5a612dcb tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Deleted allocations for instance 9744c8a1-046e-4a00-92e0-92ebb3275ea9
Nov 15 03:01:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f232f49c-6348-4fba-9422-780a5a612dcb tempest-ServerBootFromVolumeStableRescueTest-141063167 tempest-ServerBootFromVolumeStableRescueTest-141063167-project-member] Lock "9744c8a1-046e-4a00-92e0-92ebb3275ea9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.982s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:01:28 user nova-compute[75391]: DEBUG nova.compute.manager [req-f28dd624-0138-4e99-8339-73f27ade24bc req-f5264fed-64a2-44a0-bcb8-736ffb5eaf86 service nova] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Received event network-vif-plugged-dc4f904f-dd76-4f25-b9e6-41cc42493911 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:01:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f28dd624-0138-4e99-8339-73f27ade24bc req-f5264fed-64a2-44a0-bcb8-736ffb5eaf86 service nova] Acquiring lock "9744c8a1-046e-4a00-92e0-92ebb3275ea9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:01:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f28dd624-0138-4e99-8339-73f27ade24bc req-f5264fed-64a2-44a0-bcb8-736ffb5eaf86 service nova] Lock "9744c8a1-046e-4a00-92e0-92ebb3275ea9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:01:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f28dd624-0138-4e99-8339-73f27ade24bc req-f5264fed-64a2-44a0-bcb8-736ffb5eaf86 service nova] Lock "9744c8a1-046e-4a00-92e0-92ebb3275ea9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:01:28 user nova-compute[75391]: DEBUG nova.compute.manager [req-f28dd624-0138-4e99-8339-73f27ade24bc req-f5264fed-64a2-44a0-bcb8-736ffb5eaf86 service nova] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] No waiting events found dispatching network-vif-plugged-dc4f904f-dd76-4f25-b9e6-41cc42493911 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:01:28 user nova-compute[75391]: WARNING nova.compute.manager [req-f28dd624-0138-4e99-8339-73f27ade24bc req-f5264fed-64a2-44a0-bcb8-736ffb5eaf86 service nova] [instance: 9744c8a1-046e-4a00-92e0-92ebb3275ea9] Received unexpected event network-vif-plugged-dc4f904f-dd76-4f25-b9e6-41cc42493911 for instance with vm_state deleted and task_state None.
Nov 15 03:01:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:55 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:01:55 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:01:55 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 03:01:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-9909ae6b-7900-4f71-8900-2bf25185e436" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:01:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-9909ae6b-7900-4f71-8900-2bf25185e436" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:01:55 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:01:55 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lazy-loading 'info_cache' on Instance uuid 9909ae6b-7900-4f71-8900-2bf25185e436 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:01:56 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Updating instance_info_cache with network_info: [{"id": "45919066-22c9-4df6-b411-e07851e743b6", "address": "fa:16:3e:86:62:a8", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45919066-22", "ovs_interfaceid": "45919066-22c9-4df6-b411-e07851e743b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:01:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-9909ae6b-7900-4f71-8900-2bf25185e436" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:01:56 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:01:56 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:01:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:57 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:01:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:01:58 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:01:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:01 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:02:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:02 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:02:02 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:02:02 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:02:02 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:02:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:03 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:02:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:02:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 03:02:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Acquiring lock "780583af-4625-4d90-9e96-6cefcd5311fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Lock "780583af-4625-4d90-9e96-6cefcd5311fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:04 user nova-compute[75391]: DEBUG nova.compute.manager [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 03:02:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:04 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 03:02:04 user nova-compute[75391]: INFO nova.compute.claims [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Claim successful on node user
Nov 15 03:02:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:05 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:02:05 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:02:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:05 user nova-compute[75391]: DEBUG nova.compute.manager [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 03:02:05 user nova-compute[75391]: DEBUG nova.compute.manager [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 03:02:05 user nova-compute[75391]: DEBUG nova.network.neutron [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 03:02:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:05 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 03:02:05 user nova-compute[75391]: DEBUG nova.compute.manager [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 03:02:05 user nova-compute[75391]: DEBUG nova.policy [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6423d98b36fc4102b0d21bf5b62aa60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea13f2f935d479c8c629ff4e4eb06c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 03:02:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:05 user nova-compute[75391]: DEBUG nova.compute.manager [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 03:02:05 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 03:02:05 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Creating image(s)
Nov 15 03:02:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Acquiring lock "/opt/stack/data/nova/instances/780583af-4625-4d90-9e96-6cefcd5311fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Lock "/opt/stack/data/nova/instances/780583af-4625-4d90-9e96-6cefcd5311fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Lock "/opt/stack/data/nova/instances/780583af-4625-4d90-9e96-6cefcd5311fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.172s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.512s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/780583af-4625-4d90-9e96-6cefcd5311fb/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG nova.network.neutron [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Successfully created port: ed513a43-6b15-48e4-a3ad-14c1b3b86c25 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/780583af-4625-4d90-9e96-6cefcd5311fb/disk 1073741824" returned: 0 in 0.049s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.565s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:06 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:02:06 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:02:06 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8523MB free_disk=25.044429779052734GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9909ae6b-7900-4f71-8900-2bf25185e436 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 7bd332f2-0f74-4a43-96a2-2322b6cbf982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 2a8d7b01-d19e-4484-aa06-272de268e376 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance cadf93c5-d57c-4dfa-a3c6-6c1606049636 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 780583af-4625-4d90-9e96-6cefcd5311fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.183s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Checking if we can resize image /opt/stack/data/nova/instances/780583af-4625-4d90-9e96-6cefcd5311fb/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/780583af-4625-4d90-9e96-6cefcd5311fb/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/780583af-4625-4d90-9e96-6cefcd5311fb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Cannot resize image /opt/stack/data/nova/instances/780583af-4625-4d90-9e96-6cefcd5311fb/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Ensure instance console log exists: /opt/stack/data/nova/instances/780583af-4625-4d90-9e96-6cefcd5311fb/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.342s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG nova.network.neutron [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Successfully updated port: ed513a43-6b15-48e4-a3ad-14c1b3b86c25 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Acquiring lock "refresh_cache-780583af-4625-4d90-9e96-6cefcd5311fb" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Acquired lock "refresh_cache-780583af-4625-4d90-9e96-6cefcd5311fb" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG nova.network.neutron [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG nova.compute.manager [req-63e1e00b-84dc-47f4-94c4-dc1b93b5143b req-078e116e-e38d-4bff-8782-8c7196b56a5b service nova] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Received event network-changed-ed513a43-6b15-48e4-a3ad-14c1b3b86c25 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG nova.compute.manager [req-63e1e00b-84dc-47f4-94c4-dc1b93b5143b req-078e116e-e38d-4bff-8782-8c7196b56a5b service nova] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Refreshing instance network info cache due to event network-changed-ed513a43-6b15-48e4-a3ad-14c1b3b86c25. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-63e1e00b-84dc-47f4-94c4-dc1b93b5143b req-078e116e-e38d-4bff-8782-8c7196b56a5b service nova] Acquiring lock "refresh_cache-780583af-4625-4d90-9e96-6cefcd5311fb" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG nova.network.neutron [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 03:02:06 user nova-compute[75391]: DEBUG nova.network.neutron [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Updating instance_info_cache with network_info: [{"id": "ed513a43-6b15-48e4-a3ad-14c1b3b86c25", "address": "fa:16:3e:c8:30:10", "network": {"id": "e8ee78cc-99a2-4e49-a06b-623741f8f139", "bridge": "br-int", "label": "tempest-VolumesActionsTest-303373147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea13f2f935d479c8c629ff4e4eb06c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped513a43-6b", "ovs_interfaceid": "ed513a43-6b15-48e4-a3ad-14c1b3b86c25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Releasing lock "refresh_cache-780583af-4625-4d90-9e96-6cefcd5311fb" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.compute.manager [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Instance network_info: |[{"id": "ed513a43-6b15-48e4-a3ad-14c1b3b86c25", "address": "fa:16:3e:c8:30:10", "network": {"id": "e8ee78cc-99a2-4e49-a06b-623741f8f139", "bridge": "br-int", "label": "tempest-VolumesActionsTest-303373147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea13f2f935d479c8c629ff4e4eb06c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped513a43-6b", "ovs_interfaceid": "ed513a43-6b15-48e4-a3ad-14c1b3b86c25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-63e1e00b-84dc-47f4-94c4-dc1b93b5143b req-078e116e-e38d-4bff-8782-8c7196b56a5b service nova] Acquired lock "refresh_cache-780583af-4625-4d90-9e96-6cefcd5311fb" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.network.neutron [req-63e1e00b-84dc-47f4-94c4-dc1b93b5143b req-078e116e-e38d-4bff-8782-8c7196b56a5b service nova] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Refreshing network info cache for port ed513a43-6b15-48e4-a3ad-14c1b3b86c25 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Start _get_guest_xml network_info=[{"id": "ed513a43-6b15-48e4-a3ad-14c1b3b86c25", "address": "fa:16:3e:c8:30:10", "network": {"id": "e8ee78cc-99a2-4e49-a06b-623741f8f139", "bridge": "br-int", "label": "tempest-VolumesActionsTest-303373147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea13f2f935d479c8c629ff4e4eb06c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped513a43-6b", "ovs_interfaceid": "ed513a43-6b15-48e4-a3ad-14c1b3b86c25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 03:02:07 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:02:07 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:02:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-369533408',display_name='tempest-VolumesActionsTest-instance-369533408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-369533408',id=39,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eea13f2f935d479c8c629ff4e4eb06c0',ramdisk_id='',reservation_id='r-0iqqc0np',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-88225058',owner_user_name='tempest-VolumesActionsTest-88225058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:02:05Z,user_data=None,user_id='6423d98b36fc4102b0d21bf5b62aa60b',uuid=780583af-4625-4d90-9e96-6cefcd5311fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed513a43-6b15-48e4-a3ad-14c1b3b86c25", "address": "fa:16:3e:c8:30:10", "network": {"id": "e8ee78cc-99a2-4e49-a06b-623741f8f139", "bridge": "br-int", "label": "tempest-VolumesActionsTest-303373147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea13f2f935d479c8c629ff4e4eb06c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped513a43-6b", "ovs_interfaceid": "ed513a43-6b15-48e4-a3ad-14c1b3b86c25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Converting VIF {"id": "ed513a43-6b15-48e4-a3ad-14c1b3b86c25", "address": "fa:16:3e:c8:30:10", "network": {"id": "e8ee78cc-99a2-4e49-a06b-623741f8f139", "bridge": "br-int", "label": "tempest-VolumesActionsTest-303373147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea13f2f935d479c8c629ff4e4eb06c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped513a43-6b", "ovs_interfaceid": "ed513a43-6b15-48e4-a3ad-14c1b3b86c25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:30:10,bridge_name='br-int',has_traffic_filtering=True,id=ed513a43-6b15-48e4-a3ad-14c1b3b86c25,network=Network(e8ee78cc-99a2-4e49-a06b-623741f8f139),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped513a43-6b') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.objects.instance [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Lazy-loading 'pci_devices' on Instance uuid 780583af-4625-4d90-9e96-6cefcd5311fb {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] End _get_guest_xml xml=<domain type="kvm">
Nov 15 03:02:07 user nova-compute[75391]:   <uuid>780583af-4625-4d90-9e96-6cefcd5311fb</uuid>
Nov 15 03:02:07 user nova-compute[75391]:   <name>instance-00000027</name>
Nov 15 03:02:07 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 03:02:07 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 03:02:07 user nova-compute[75391]:   <metadata>
Nov 15 03:02:07 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 03:02:07 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 03:02:07 user nova-compute[75391]:       <nova:name>tempest-VolumesActionsTest-instance-369533408</nova:name>
Nov 15 03:02:07 user nova-compute[75391]:       <nova:creationTime>2023-11-15 03:02:07</nova:creationTime>
Nov 15 03:02:07 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 03:02:07 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 03:02:07 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 03:02:07 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 03:02:07 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 03:02:07 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 03:02:07 user nova-compute[75391]:       </nova:flavor>
Nov 15 03:02:07 user nova-compute[75391]:       <nova:owner>
Nov 15 03:02:07 user nova-compute[75391]:         <nova:user uuid="6423d98b36fc4102b0d21bf5b62aa60b">tempest-VolumesActionsTest-88225058-project-member</nova:user>
Nov 15 03:02:07 user nova-compute[75391]:         <nova:project uuid="eea13f2f935d479c8c629ff4e4eb06c0">tempest-VolumesActionsTest-88225058</nova:project>
Nov 15 03:02:07 user nova-compute[75391]:       </nova:owner>
Nov 15 03:02:07 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 03:02:07 user nova-compute[75391]:       <nova:ports>
Nov 15 03:02:07 user nova-compute[75391]:         <nova:port uuid="ed513a43-6b15-48e4-a3ad-14c1b3b86c25">
Nov 15 03:02:07 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 03:02:07 user nova-compute[75391]:         </nova:port>
Nov 15 03:02:07 user nova-compute[75391]:       </nova:ports>
Nov 15 03:02:07 user nova-compute[75391]:     </nova:instance>
Nov 15 03:02:07 user nova-compute[75391]:   </metadata>
Nov 15 03:02:07 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 03:02:07 user nova-compute[75391]:     <system>
Nov 15 03:02:07 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 03:02:07 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 03:02:07 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 03:02:07 user nova-compute[75391]:       <entry name="serial">780583af-4625-4d90-9e96-6cefcd5311fb</entry>
Nov 15 03:02:07 user nova-compute[75391]:       <entry name="uuid">780583af-4625-4d90-9e96-6cefcd5311fb</entry>
Nov 15 03:02:07 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 03:02:07 user nova-compute[75391]:     </system>
Nov 15 03:02:07 user nova-compute[75391]:   </sysinfo>
Nov 15 03:02:07 user nova-compute[75391]:   <os>
Nov 15 03:02:07 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 03:02:07 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 03:02:07 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 03:02:07 user nova-compute[75391]:   </os>
Nov 15 03:02:07 user nova-compute[75391]:   <features>
Nov 15 03:02:07 user nova-compute[75391]:     <acpi/>
Nov 15 03:02:07 user nova-compute[75391]:     <apic/>
Nov 15 03:02:07 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 03:02:07 user nova-compute[75391]:   </features>
Nov 15 03:02:07 user nova-compute[75391]:   <clock offset="utc">
Nov 15 03:02:07 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 03:02:07 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 03:02:07 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 03:02:07 user nova-compute[75391]:   </clock>
Nov 15 03:02:07 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 03:02:07 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 03:02:07 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 03:02:07 user nova-compute[75391]:   </cpu>
Nov 15 03:02:07 user nova-compute[75391]:   <devices>
Nov 15 03:02:07 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 03:02:07 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 03:02:07 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/780583af-4625-4d90-9e96-6cefcd5311fb/disk"/>
Nov 15 03:02:07 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 03:02:07 user nova-compute[75391]:     </disk>
Nov 15 03:02:07 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 03:02:07 user nova-compute[75391]:       <mac address="fa:16:3e:c8:30:10"/>
Nov 15 03:02:07 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:02:07 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 03:02:07 user nova-compute[75391]:       <target dev="taped513a43-6b"/>
Nov 15 03:02:07 user nova-compute[75391]:     </interface>
Nov 15 03:02:07 user nova-compute[75391]:     <serial type="pty">
Nov 15 03:02:07 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/780583af-4625-4d90-9e96-6cefcd5311fb/console.log" append="off"/>
Nov 15 03:02:07 user nova-compute[75391]:     </serial>
Nov 15 03:02:07 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 03:02:07 user nova-compute[75391]:     <video>
Nov 15 03:02:07 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:02:07 user nova-compute[75391]:     </video>
Nov 15 03:02:07 user nova-compute[75391]:     <rng model="virtio">
Nov 15 03:02:07 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 03:02:07 user nova-compute[75391]:     </rng>
Nov 15 03:02:07 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 03:02:07 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 03:02:07 user nova-compute[75391]:       <stats period="10"/>
Nov 15 03:02:07 user nova-compute[75391]:     </memballoon>
Nov 15 03:02:07 user nova-compute[75391]:   </devices>
Nov 15 03:02:07 user nova-compute[75391]: </domain>
Nov 15 03:02:07 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:02:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-369533408',display_name='tempest-VolumesActionsTest-instance-369533408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-369533408',id=39,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eea13f2f935d479c8c629ff4e4eb06c0',ramdisk_id='',reservation_id='r-0iqqc0np',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-88225058',owner_user_name='tempest-VolumesActionsTest-88225058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:02:05Z,user_data=None,user_id='6423d98b36fc4102b0d21bf5b62aa60b',uuid=780583af-4625-4d90-9e96-6cefcd5311fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed513a43-6b15-48e4-a3ad-14c1b3b86c25", "address": "fa:16:3e:c8:30:10", "network": {"id": "e8ee78cc-99a2-4e49-a06b-623741f8f139", "bridge": "br-int", "label": "tempest-VolumesActionsTest-303373147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea13f2f935d479c8c629ff4e4eb06c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped513a43-6b", "ovs_interfaceid": "ed513a43-6b15-48e4-a3ad-14c1b3b86c25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Converting VIF {"id": "ed513a43-6b15-48e4-a3ad-14c1b3b86c25", "address": "fa:16:3e:c8:30:10", "network": {"id": "e8ee78cc-99a2-4e49-a06b-623741f8f139", "bridge": "br-int", "label": "tempest-VolumesActionsTest-303373147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea13f2f935d479c8c629ff4e4eb06c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped513a43-6b", "ovs_interfaceid": "ed513a43-6b15-48e4-a3ad-14c1b3b86c25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:30:10,bridge_name='br-int',has_traffic_filtering=True,id=ed513a43-6b15-48e4-a3ad-14c1b3b86c25,network=Network(e8ee78cc-99a2-4e49-a06b-623741f8f139),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped513a43-6b') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG os_vif [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:30:10,bridge_name='br-int',has_traffic_filtering=True,id=ed513a43-6b15-48e4-a3ad-14c1b3b86c25,network=Network(e8ee78cc-99a2-4e49-a06b-623741f8f139),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped513a43-6b') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eb63fcd3-24e7-5f14-8c80-09289095fe6d', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped513a43-6b, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped513a43-6b, col_values=(('qos', UUID('87974025-8b1a-4318-8724-e7ff1f0aab84')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped513a43-6b, col_values=(('external_ids', {'iface-id': 'ed513a43-6b15-48e4-a3ad-14c1b3b86c25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:30:10', 'vm-uuid': '780583af-4625-4d90-9e96-6cefcd5311fb'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:07 user nova-compute[75391]: INFO os_vif [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:30:10,bridge_name='br-int',has_traffic_filtering=True,id=ed513a43-6b15-48e4-a3ad-14c1b3b86c25,network=Network(e8ee78cc-99a2-4e49-a06b-623741f8f139),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped513a43-6b')
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] No VIF found with MAC fa:16:3e:c8:30:10, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.network.neutron [req-63e1e00b-84dc-47f4-94c4-dc1b93b5143b req-078e116e-e38d-4bff-8782-8c7196b56a5b service nova] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Updated VIF entry in instance network info cache for port ed513a43-6b15-48e4-a3ad-14c1b3b86c25. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG nova.network.neutron [req-63e1e00b-84dc-47f4-94c4-dc1b93b5143b req-078e116e-e38d-4bff-8782-8c7196b56a5b service nova] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Updating instance_info_cache with network_info: [{"id": "ed513a43-6b15-48e4-a3ad-14c1b3b86c25", "address": "fa:16:3e:c8:30:10", "network": {"id": "e8ee78cc-99a2-4e49-a06b-623741f8f139", "bridge": "br-int", "label": "tempest-VolumesActionsTest-303373147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea13f2f935d479c8c629ff4e4eb06c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped513a43-6b", "ovs_interfaceid": "ed513a43-6b15-48e4-a3ad-14c1b3b86c25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-63e1e00b-84dc-47f4-94c4-dc1b93b5143b req-078e116e-e38d-4bff-8782-8c7196b56a5b service nova] Releasing lock "refresh_cache-780583af-4625-4d90-9e96-6cefcd5311fb" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:02:07 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:02:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:08 user nova-compute[75391]: DEBUG nova.compute.manager [req-97788ed8-6761-4179-83b7-8bfa5ca7e92d req-a0abba97-d663-4dcd-a338-25197f2259b1 service nova] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Received event network-vif-plugged-ed513a43-6b15-48e4-a3ad-14c1b3b86c25 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:02:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-97788ed8-6761-4179-83b7-8bfa5ca7e92d req-a0abba97-d663-4dcd-a338-25197f2259b1 service nova] Acquiring lock "780583af-4625-4d90-9e96-6cefcd5311fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-97788ed8-6761-4179-83b7-8bfa5ca7e92d req-a0abba97-d663-4dcd-a338-25197f2259b1 service nova] Lock "780583af-4625-4d90-9e96-6cefcd5311fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-97788ed8-6761-4179-83b7-8bfa5ca7e92d req-a0abba97-d663-4dcd-a338-25197f2259b1 service nova] Lock "780583af-4625-4d90-9e96-6cefcd5311fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:08 user nova-compute[75391]: DEBUG nova.compute.manager [req-97788ed8-6761-4179-83b7-8bfa5ca7e92d req-a0abba97-d663-4dcd-a338-25197f2259b1 service nova] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] No waiting events found dispatching network-vif-plugged-ed513a43-6b15-48e4-a3ad-14c1b3b86c25 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:02:08 user nova-compute[75391]: WARNING nova.compute.manager [req-97788ed8-6761-4179-83b7-8bfa5ca7e92d req-a0abba97-d663-4dcd-a338-25197f2259b1 service nova] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Received unexpected event network-vif-plugged-ed513a43-6b15-48e4-a3ad-14c1b3b86c25 for instance with vm_state building and task_state spawning.
Nov 15 03:02:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:10 user nova-compute[75391]: DEBUG nova.compute.manager [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 03:02:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 03:02:10 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Instance spawned successfully.
Nov 15 03:02:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 03:02:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:02:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:02:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:02:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:02:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:02:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:02:10 user nova-compute[75391]: INFO nova.compute.manager [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Took 5.25 seconds to spawn the instance on the hypervisor.
Nov 15 03:02:10 user nova-compute[75391]: DEBUG nova.compute.manager [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 03:02:10 user nova-compute[75391]: INFO nova.compute.manager [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Took 5.99 seconds to build instance.
Nov 15 03:02:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b3cd757d-2a67-4aa4-8934-823ab0b9c4c7 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Lock "780583af-4625-4d90-9e96-6cefcd5311fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.089s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:10 user nova-compute[75391]: DEBUG nova.compute.manager [req-8f0768f0-b4df-4c03-92cf-8f6f4b85f545 req-03d58409-29c6-40d1-bda2-6b4beab7057e service nova] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Received event network-vif-plugged-ed513a43-6b15-48e4-a3ad-14c1b3b86c25 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:02:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8f0768f0-b4df-4c03-92cf-8f6f4b85f545 req-03d58409-29c6-40d1-bda2-6b4beab7057e service nova] Acquiring lock "780583af-4625-4d90-9e96-6cefcd5311fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8f0768f0-b4df-4c03-92cf-8f6f4b85f545 req-03d58409-29c6-40d1-bda2-6b4beab7057e service nova] Lock "780583af-4625-4d90-9e96-6cefcd5311fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8f0768f0-b4df-4c03-92cf-8f6f4b85f545 req-03d58409-29c6-40d1-bda2-6b4beab7057e service nova] Lock "780583af-4625-4d90-9e96-6cefcd5311fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:10 user nova-compute[75391]: DEBUG nova.compute.manager [req-8f0768f0-b4df-4c03-92cf-8f6f4b85f545 req-03d58409-29c6-40d1-bda2-6b4beab7057e service nova] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] No waiting events found dispatching network-vif-plugged-ed513a43-6b15-48e4-a3ad-14c1b3b86c25 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:02:10 user nova-compute[75391]: WARNING nova.compute.manager [req-8f0768f0-b4df-4c03-92cf-8f6f4b85f545 req-03d58409-29c6-40d1-bda2-6b4beab7057e service nova] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Received unexpected event network-vif-plugged-ed513a43-6b15-48e4-a3ad-14c1b3b86c25 for instance with vm_state active and task_state None.
Nov 15 03:02:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:17 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:22 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:28 user nova-compute[75391]: DEBUG nova.compute.manager [req-6a27ea84-0f8b-4955-96c0-0f996d7965b9 req-11cdcbcd-1f67-412a-bfd0-c626bb7275ed service nova] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Received event network-changed-036afc83-072c-46b1-99cb-32b6f2c13116 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:02:28 user nova-compute[75391]: DEBUG nova.compute.manager [req-6a27ea84-0f8b-4955-96c0-0f996d7965b9 req-11cdcbcd-1f67-412a-bfd0-c626bb7275ed service nova] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Refreshing instance network info cache due to event network-changed-036afc83-072c-46b1-99cb-32b6f2c13116. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:02:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6a27ea84-0f8b-4955-96c0-0f996d7965b9 req-11cdcbcd-1f67-412a-bfd0-c626bb7275ed service nova] Acquiring lock "refresh_cache-cadf93c5-d57c-4dfa-a3c6-6c1606049636" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:02:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6a27ea84-0f8b-4955-96c0-0f996d7965b9 req-11cdcbcd-1f67-412a-bfd0-c626bb7275ed service nova] Acquired lock "refresh_cache-cadf93c5-d57c-4dfa-a3c6-6c1606049636" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:02:28 user nova-compute[75391]: DEBUG nova.network.neutron [req-6a27ea84-0f8b-4955-96c0-0f996d7965b9 req-11cdcbcd-1f67-412a-bfd0-c626bb7275ed service nova] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Refreshing network info cache for port 036afc83-072c-46b1-99cb-32b6f2c13116 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:02:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Acquiring lock "bf7a7308-36a6-4a34-bde5-bacd29a77101" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:28 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 03:02:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:29 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 03:02:29 user nova-compute[75391]: INFO nova.compute.claims [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Claim successful on node user
Nov 15 03:02:29 user nova-compute[75391]: DEBUG nova.network.neutron [req-6a27ea84-0f8b-4955-96c0-0f996d7965b9 req-11cdcbcd-1f67-412a-bfd0-c626bb7275ed service nova] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Updated VIF entry in instance network info cache for port 036afc83-072c-46b1-99cb-32b6f2c13116. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:02:29 user nova-compute[75391]: DEBUG nova.network.neutron [req-6a27ea84-0f8b-4955-96c0-0f996d7965b9 req-11cdcbcd-1f67-412a-bfd0-c626bb7275ed service nova] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Updating instance_info_cache with network_info: [{"id": "036afc83-072c-46b1-99cb-32b6f2c13116", "address": "fa:16:3e:a6:30:ec", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap036afc83-07", "ovs_interfaceid": "036afc83-072c-46b1-99cb-32b6f2c13116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:02:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6a27ea84-0f8b-4955-96c0-0f996d7965b9 req-11cdcbcd-1f67-412a-bfd0-c626bb7275ed service nova] Releasing lock "refresh_cache-cadf93c5-d57c-4dfa-a3c6-6c1606049636" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:02:29 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:02:29 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:02:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:29 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 03:02:29 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 03:02:29 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 03:02:29 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 03:02:29 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 03:02:29 user nova-compute[75391]: DEBUG nova.policy [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bcd0fbcb04e84312b99a82f772a17159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a64dab12ce74d18b3d9414595910180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 03:02:29 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 03:02:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 03:02:29 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Creating image(s)
Nov 15 03:02:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "/opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "/opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.188s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.175s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk 1073741824" returned: 0 in 0.051s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:30 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Successfully created port: 53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 03:02:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.192s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:30 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 03:02:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:30 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Cannot resize image /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 03:02:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 03:02:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Ensure instance console log exists: /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 03:02:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:30 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Successfully updated port: 53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 03:02:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Acquiring lock "refresh_cache-bf7a7308-36a6-4a34-bde5-bacd29a77101" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:02:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Acquired lock "refresh_cache-bf7a7308-36a6-4a34-bde5-bacd29a77101" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:02:30 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 03:02:30 user nova-compute[75391]: DEBUG nova.compute.manager [req-6ed16d6b-dbce-4ba0-9b12-b0337a7e859b req-9dda4b04-aafd-44bc-ae93-4ede5faf60dc service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received event network-changed-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:02:30 user nova-compute[75391]: DEBUG nova.compute.manager [req-6ed16d6b-dbce-4ba0-9b12-b0337a7e859b req-9dda4b04-aafd-44bc-ae93-4ede5faf60dc service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Refreshing instance network info cache due to event network-changed-53ee1144-b72a-431c-9e42-7efd212177b3. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:02:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6ed16d6b-dbce-4ba0-9b12-b0337a7e859b req-9dda4b04-aafd-44bc-ae93-4ede5faf60dc service nova] Acquiring lock "refresh_cache-bf7a7308-36a6-4a34-bde5-bacd29a77101" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:02:30 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Updating instance_info_cache with network_info: [{"id": "53ee1144-b72a-431c-9e42-7efd212177b3", "address": "fa:16:3e:98:e2:5a", "network": {"id": "434e7c61-37f4-4a23-be35-6cc6f9842cad", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1311932462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a64dab12ce74d18b3d9414595910180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee1144-b7", "ovs_interfaceid": "53ee1144-b72a-431c-9e42-7efd212177b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Releasing lock "refresh_cache-bf7a7308-36a6-4a34-bde5-bacd29a77101" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Instance network_info: |[{"id": "53ee1144-b72a-431c-9e42-7efd212177b3", "address": "fa:16:3e:98:e2:5a", "network": {"id": "434e7c61-37f4-4a23-be35-6cc6f9842cad", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1311932462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a64dab12ce74d18b3d9414595910180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee1144-b7", "ovs_interfaceid": "53ee1144-b72a-431c-9e42-7efd212177b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6ed16d6b-dbce-4ba0-9b12-b0337a7e859b req-9dda4b04-aafd-44bc-ae93-4ede5faf60dc service nova] Acquired lock "refresh_cache-bf7a7308-36a6-4a34-bde5-bacd29a77101" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.network.neutron [req-6ed16d6b-dbce-4ba0-9b12-b0337a7e859b req-9dda4b04-aafd-44bc-ae93-4ede5faf60dc service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Refreshing network info cache for port 53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Start _get_guest_xml network_info=[{"id": "53ee1144-b72a-431c-9e42-7efd212177b3", "address": "fa:16:3e:98:e2:5a", "network": {"id": "434e7c61-37f4-4a23-be35-6cc6f9842cad", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1311932462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a64dab12ce74d18b3d9414595910180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee1144-b7", "ovs_interfaceid": "53ee1144-b72a-431c-9e42-7efd212177b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 03:02:31 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:02:31 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:02:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1144670272',display_name='tempest-ServerStableDeviceRescueTest-server-1144670272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1144670272',id=40,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMF+BI5+VcRTfw7TjGfQSa5zuNaSx3cK49go9Lazpbp+FSmkfPXXz0+tU5ZPdsXBgHoz5XxyPQPvegViPYNbaX34RcJtjgnqsfR1T88wVqzXO6jm1bMSLFqh9Q165b4ybA==',key_name='tempest-keypair-1852285092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a64dab12ce74d18b3d9414595910180',ramdisk_id='',reservation_id='r-e107dfhn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-370419686',owner_user_name='tempest-ServerStableDeviceRescueTest-370419686-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:02:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcd0fbcb04e84312b99a82f772a17159',uuid=bf7a7308-36a6-4a34-bde5-bacd29a77101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53ee1144-b72a-431c-9e42-7efd212177b3", "address": "fa:16:3e:98:e2:5a", "network": {"id": "434e7c61-37f4-4a23-be35-6cc6f9842cad", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1311932462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a64dab12ce74d18b3d9414595910180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee1144-b7", "ovs_interfaceid": "53ee1144-b72a-431c-9e42-7efd212177b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Converting VIF {"id": "53ee1144-b72a-431c-9e42-7efd212177b3", "address": "fa:16:3e:98:e2:5a", "network": {"id": "434e7c61-37f4-4a23-be35-6cc6f9842cad", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1311932462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a64dab12ce74d18b3d9414595910180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee1144-b7", "ovs_interfaceid": "53ee1144-b72a-431c-9e42-7efd212177b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:e2:5a,bridge_name='br-int',has_traffic_filtering=True,id=53ee1144-b72a-431c-9e42-7efd212177b3,network=Network(434e7c61-37f4-4a23-be35-6cc6f9842cad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ee1144-b7') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.objects.instance [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lazy-loading 'pci_devices' on Instance uuid bf7a7308-36a6-4a34-bde5-bacd29a77101 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] End _get_guest_xml xml=<domain type="kvm">
Nov 15 03:02:31 user nova-compute[75391]:   <uuid>bf7a7308-36a6-4a34-bde5-bacd29a77101</uuid>
Nov 15 03:02:31 user nova-compute[75391]:   <name>instance-00000028</name>
Nov 15 03:02:31 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 03:02:31 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 03:02:31 user nova-compute[75391]:   <metadata>
Nov 15 03:02:31 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 03:02:31 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 03:02:31 user nova-compute[75391]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1144670272</nova:name>
Nov 15 03:02:31 user nova-compute[75391]:       <nova:creationTime>2023-11-15 03:02:31</nova:creationTime>
Nov 15 03:02:31 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 03:02:31 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 03:02:31 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 03:02:31 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 03:02:31 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 03:02:31 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 03:02:31 user nova-compute[75391]:       </nova:flavor>
Nov 15 03:02:31 user nova-compute[75391]:       <nova:owner>
Nov 15 03:02:31 user nova-compute[75391]:         <nova:user uuid="bcd0fbcb04e84312b99a82f772a17159">tempest-ServerStableDeviceRescueTest-370419686-project-member</nova:user>
Nov 15 03:02:31 user nova-compute[75391]:         <nova:project uuid="2a64dab12ce74d18b3d9414595910180">tempest-ServerStableDeviceRescueTest-370419686</nova:project>
Nov 15 03:02:31 user nova-compute[75391]:       </nova:owner>
Nov 15 03:02:31 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 03:02:31 user nova-compute[75391]:       <nova:ports>
Nov 15 03:02:31 user nova-compute[75391]:         <nova:port uuid="53ee1144-b72a-431c-9e42-7efd212177b3">
Nov 15 03:02:31 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 03:02:31 user nova-compute[75391]:         </nova:port>
Nov 15 03:02:31 user nova-compute[75391]:       </nova:ports>
Nov 15 03:02:31 user nova-compute[75391]:     </nova:instance>
Nov 15 03:02:31 user nova-compute[75391]:   </metadata>
Nov 15 03:02:31 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 03:02:31 user nova-compute[75391]:     <system>
Nov 15 03:02:31 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 03:02:31 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 03:02:31 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 03:02:31 user nova-compute[75391]:       <entry name="serial">bf7a7308-36a6-4a34-bde5-bacd29a77101</entry>
Nov 15 03:02:31 user nova-compute[75391]:       <entry name="uuid">bf7a7308-36a6-4a34-bde5-bacd29a77101</entry>
Nov 15 03:02:31 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 03:02:31 user nova-compute[75391]:     </system>
Nov 15 03:02:31 user nova-compute[75391]:   </sysinfo>
Nov 15 03:02:31 user nova-compute[75391]:   <os>
Nov 15 03:02:31 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 03:02:31 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 03:02:31 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 03:02:31 user nova-compute[75391]:   </os>
Nov 15 03:02:31 user nova-compute[75391]:   <features>
Nov 15 03:02:31 user nova-compute[75391]:     <acpi/>
Nov 15 03:02:31 user nova-compute[75391]:     <apic/>
Nov 15 03:02:31 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 03:02:31 user nova-compute[75391]:   </features>
Nov 15 03:02:31 user nova-compute[75391]:   <clock offset="utc">
Nov 15 03:02:31 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 03:02:31 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 03:02:31 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 03:02:31 user nova-compute[75391]:   </clock>
Nov 15 03:02:31 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 03:02:31 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 03:02:31 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 03:02:31 user nova-compute[75391]:   </cpu>
Nov 15 03:02:31 user nova-compute[75391]:   <devices>
Nov 15 03:02:31 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 03:02:31 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 03:02:31 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk"/>
Nov 15 03:02:31 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 03:02:31 user nova-compute[75391]:     </disk>
Nov 15 03:02:31 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 03:02:31 user nova-compute[75391]:       <mac address="fa:16:3e:98:e2:5a"/>
Nov 15 03:02:31 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:02:31 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 03:02:31 user nova-compute[75391]:       <target dev="tap53ee1144-b7"/>
Nov 15 03:02:31 user nova-compute[75391]:     </interface>
Nov 15 03:02:31 user nova-compute[75391]:     <serial type="pty">
Nov 15 03:02:31 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/console.log" append="off"/>
Nov 15 03:02:31 user nova-compute[75391]:     </serial>
Nov 15 03:02:31 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 03:02:31 user nova-compute[75391]:     <video>
Nov 15 03:02:31 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:02:31 user nova-compute[75391]:     </video>
Nov 15 03:02:31 user nova-compute[75391]:     <rng model="virtio">
Nov 15 03:02:31 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 03:02:31 user nova-compute[75391]:     </rng>
Nov 15 03:02:31 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 03:02:31 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 03:02:31 user nova-compute[75391]:       <stats period="10"/>
Nov 15 03:02:31 user nova-compute[75391]:     </memballoon>
Nov 15 03:02:31 user nova-compute[75391]:   </devices>
Nov 15 03:02:31 user nova-compute[75391]: </domain>
Nov 15 03:02:31 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:02:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1144670272',display_name='tempest-ServerStableDeviceRescueTest-server-1144670272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1144670272',id=40,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMF+BI5+VcRTfw7TjGfQSa5zuNaSx3cK49go9Lazpbp+FSmkfPXXz0+tU5ZPdsXBgHoz5XxyPQPvegViPYNbaX34RcJtjgnqsfR1T88wVqzXO6jm1bMSLFqh9Q165b4ybA==',key_name='tempest-keypair-1852285092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a64dab12ce74d18b3d9414595910180',ramdisk_id='',reservation_id='r-e107dfhn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-370419686',owner_user_name='tempest-ServerStableDeviceRescueTest-370419686-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:02:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcd0fbcb04e84312b99a82f772a17159',uuid=bf7a7308-36a6-4a34-bde5-bacd29a77101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53ee1144-b72a-431c-9e42-7efd212177b3", "address": "fa:16:3e:98:e2:5a", "network": {"id": "434e7c61-37f4-4a23-be35-6cc6f9842cad", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1311932462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a64dab12ce74d18b3d9414595910180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee1144-b7", "ovs_interfaceid": "53ee1144-b72a-431c-9e42-7efd212177b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Converting VIF {"id": "53ee1144-b72a-431c-9e42-7efd212177b3", "address": "fa:16:3e:98:e2:5a", "network": {"id": "434e7c61-37f4-4a23-be35-6cc6f9842cad", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1311932462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a64dab12ce74d18b3d9414595910180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee1144-b7", "ovs_interfaceid": "53ee1144-b72a-431c-9e42-7efd212177b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:e2:5a,bridge_name='br-int',has_traffic_filtering=True,id=53ee1144-b72a-431c-9e42-7efd212177b3,network=Network(434e7c61-37f4-4a23-be35-6cc6f9842cad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ee1144-b7') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG os_vif [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:e2:5a,bridge_name='br-int',has_traffic_filtering=True,id=53ee1144-b72a-431c-9e42-7efd212177b3,network=Network(434e7c61-37f4-4a23-be35-6cc6f9842cad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ee1144-b7') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55724352-a791-54d1-9c2f-f6a26d6ca4ed', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53ee1144-b7, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53ee1144-b7, col_values=(('qos', UUID('f5079a97-bbd4-442c-a867-22ad1aabac08')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53ee1144-b7, col_values=(('external_ids', {'iface-id': '53ee1144-b72a-431c-9e42-7efd212177b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:e2:5a', 'vm-uuid': 'bf7a7308-36a6-4a34-bde5-bacd29a77101'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:31 user nova-compute[75391]: INFO os_vif [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:e2:5a,bridge_name='br-int',has_traffic_filtering=True,id=53ee1144-b72a-431c-9e42-7efd212177b3,network=Network(434e7c61-37f4-4a23-be35-6cc6f9842cad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ee1144-b7')
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] No VIF found with MAC fa:16:3e:98:e2:5a, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.objects.instance [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lazy-loading 'flavor' on Instance uuid cadf93c5-d57c-4dfa-a3c6-6c1606049636 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.network.neutron [req-6ed16d6b-dbce-4ba0-9b12-b0337a7e859b req-9dda4b04-aafd-44bc-ae93-4ede5faf60dc service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Updated VIF entry in instance network info cache for port 53ee1144-b72a-431c-9e42-7efd212177b3. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.network.neutron [req-6ed16d6b-dbce-4ba0-9b12-b0337a7e859b req-9dda4b04-aafd-44bc-ae93-4ede5faf60dc service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Updating instance_info_cache with network_info: [{"id": "53ee1144-b72a-431c-9e42-7efd212177b3", "address": "fa:16:3e:98:e2:5a", "network": {"id": "434e7c61-37f4-4a23-be35-6cc6f9842cad", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1311932462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a64dab12ce74d18b3d9414595910180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee1144-b7", "ovs_interfaceid": "53ee1144-b72a-431c-9e42-7efd212177b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6ed16d6b-dbce-4ba0-9b12-b0337a7e859b req-9dda4b04-aafd-44bc-ae93-4ede5faf60dc service nova] Releasing lock "refresh_cache-bf7a7308-36a6-4a34-bde5-bacd29a77101" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:31 user nova-compute[75391]: INFO nova.compute.manager [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Attaching volume 28e26499-333b-48d6-a55f-588ebe41361d to /dev/vdb
Nov 15 03:02:31 user nova-compute[75391]: DEBUG os_brick.utils [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f493eef9-f12f-44db-8edc-ee0e30fcd0a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a62f25b-9e64-46b1-939a-9ea3e0a02eb2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20eb997-d601-4eed-abab-251b4fc52976]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7963af-a3e7-43e9-8542-c03b0ce2152a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:02:31 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 03:02:31 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[de06c73d-7d36-4e54-853e-6033c4b3e1ef]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG os_brick.utils [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:02:31 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Updating existing volume attachment record: 680fbfd1-35e4-4452-ab72-680e79d4df95 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 03:02:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:32 user nova-compute[75391]: DEBUG nova.compute.manager [req-8a935f60-d17e-47f1-aa18-4b8892aa7cd8 req-3973d55b-11e6-4ded-af2f-a912b6f144a4 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received event network-vif-plugged-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:02:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8a935f60-d17e-47f1-aa18-4b8892aa7cd8 req-3973d55b-11e6-4ded-af2f-a912b6f144a4 service nova] Acquiring lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8a935f60-d17e-47f1-aa18-4b8892aa7cd8 req-3973d55b-11e6-4ded-af2f-a912b6f144a4 service nova] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8a935f60-d17e-47f1-aa18-4b8892aa7cd8 req-3973d55b-11e6-4ded-af2f-a912b6f144a4 service nova] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:32 user nova-compute[75391]: DEBUG nova.compute.manager [req-8a935f60-d17e-47f1-aa18-4b8892aa7cd8 req-3973d55b-11e6-4ded-af2f-a912b6f144a4 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] No waiting events found dispatching network-vif-plugged-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:02:32 user nova-compute[75391]: WARNING nova.compute.manager [req-8a935f60-d17e-47f1-aa18-4b8892aa7cd8 req-3973d55b-11e6-4ded-af2f-a912b6f144a4 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received unexpected event network-vif-plugged-53ee1144-b72a-431c-9e42-7efd212177b3 for instance with vm_state building and task_state spawning.
Nov 15 03:02:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:34 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 03:02:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 03:02:34 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Instance spawned successfully.
Nov 15 03:02:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 03:02:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:02:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:02:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:02:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:02:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:02:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:02:34 user nova-compute[75391]: INFO nova.compute.manager [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Took 5.22 seconds to spawn the instance on the hypervisor.
Nov 15 03:02:34 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 03:02:34 user nova-compute[75391]: INFO nova.compute.manager [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Took 5.85 seconds to build instance.
Nov 15 03:02:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f52d1426-e2cd-4b6e-80f4-35be021c883e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.962s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:34 user nova-compute[75391]: DEBUG nova.compute.manager [req-c4a9b36f-9884-41e2-b0a1-e2dc0b0e751e req-f4e27240-02fa-4514-9363-3cf9f8b3a3a9 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received event network-vif-plugged-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:02:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c4a9b36f-9884-41e2-b0a1-e2dc0b0e751e req-f4e27240-02fa-4514-9363-3cf9f8b3a3a9 service nova] Acquiring lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c4a9b36f-9884-41e2-b0a1-e2dc0b0e751e req-f4e27240-02fa-4514-9363-3cf9f8b3a3a9 service nova] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c4a9b36f-9884-41e2-b0a1-e2dc0b0e751e req-f4e27240-02fa-4514-9363-3cf9f8b3a3a9 service nova] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:34 user nova-compute[75391]: DEBUG nova.compute.manager [req-c4a9b36f-9884-41e2-b0a1-e2dc0b0e751e req-f4e27240-02fa-4514-9363-3cf9f8b3a3a9 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] No waiting events found dispatching network-vif-plugged-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:02:34 user nova-compute[75391]: WARNING nova.compute.manager [req-c4a9b36f-9884-41e2-b0a1-e2dc0b0e751e req-f4e27240-02fa-4514-9363-3cf9f8b3a3a9 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received unexpected event network-vif-plugged-53ee1144-b72a-431c-9e42-7efd212177b3 for instance with vm_state active and task_state None.
Nov 15 03:02:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJRaOUeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:02:36 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:02:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:02:36 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:02:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:02:36 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[91675498-1b3e-431a-8b9f-a05c233039db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 03:02:36 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a07f43e-a47b-4a8f-b938-073e32f921e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d] added
Nov 15 03:02:36 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f7f97f-62c5-418a-bc36-6d0270ed123e]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6bde34-10a7-4bab-a635-f5ffda3551c5]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LJRaOUeV {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LJRaOUeV" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2cd20a-58e7-46db-bdcc-e299baf441c7]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LJRaOUeV'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfa8939-e95b-4c55-bcce-abb4d21618f2]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd88a55-1291-4806-a84f-ede8efff96fc]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e (non-flash)
Nov 15 03:02:36 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e (non-flash)
Nov 15 03:02:36 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba0b76e-8b2d-4e3f-aec9-266cf59510c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d, portal: 172.16.0.220,3260]
Nov 15 03:02:36 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d, portal: 172.16.0.220,3260] successful.
Nov 15 03:02:36 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fc068d-4492-45bc-9dcd-4678efcbf1ff]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e121166f-c165-4570-887f-55b8e89360d4]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e (non-flash)
Nov 15 03:02:36 user nova-compute[75391]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d (non-flash)
Nov 15 03:02:36 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e (non-flash)
Nov 15 03:02:36 user nova-compute[75391]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d (non-flash)
Nov 15 03:02:36 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d651d839-b03d-41cf-b92f-6d8c6f610ec5]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 03:02:36 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJRaOUeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 03:02:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:02:37 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23134363535313937', 'path': '/dev/sdc'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:02:37 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134363535313937', 'path': '/dev/sdc'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 03:02:37 user nova-compute[75391]: DEBUG nova.objects.instance [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lazy-loading 'flavor' on Instance uuid cadf93c5-d57c-4dfa-a3c6-6c1606049636 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:02:37 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 03:02:37 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:02:37 user nova-compute[75391]:   <source dev="/dev/sdc"/>
Nov 15 03:02:37 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 03:02:37 user nova-compute[75391]:   <serial>28e26499-333b-48d6-a55f-588ebe41361d</serial>
Nov 15 03:02:37 user nova-compute[75391]: </disk>
Nov 15 03:02:37 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 03:02:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:02:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:02:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] No VIF found with MAC fa:16:3e:a6:30:ec, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 03:02:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-eec3eda2-edcb-40be-bf0a-521b2c6d3542 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.652s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "c095d09f-2c28-447c-825a-5b7d35a1a364" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "c095d09f-2c28-447c-825a-5b7d35a1a364" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:42 user nova-compute[75391]: DEBUG nova.compute.manager [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 03:02:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:42 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 03:02:42 user nova-compute[75391]: INFO nova.compute.claims [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Claim successful on node user
Nov 15 03:02:42 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:02:42 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:02:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:42 user nova-compute[75391]: DEBUG nova.compute.manager [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 03:02:42 user nova-compute[75391]: DEBUG nova.compute.manager [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 03:02:42 user nova-compute[75391]: DEBUG nova.network.neutron [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 03:02:42 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 03:02:42 user nova-compute[75391]: DEBUG nova.compute.manager [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 03:02:42 user nova-compute[75391]: DEBUG nova.policy [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '970046cb64de4109bb299f75172b7dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c00f50c42754cea86c68e3e668c0180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 03:02:42 user nova-compute[75391]: DEBUG nova.compute.manager [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 03:02:42 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 03:02:42 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Creating image(s)
Nov 15 03:02:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "/opt/stack/data/nova/instances/c095d09f-2c28-447c-825a-5b7d35a1a364/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "/opt/stack/data/nova/instances/c095d09f-2c28-447c-825a-5b7d35a1a364/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "/opt/stack/data/nova/instances/c095d09f-2c28-447c-825a-5b7d35a1a364/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.186s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:42 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.176s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/c095d09f-2c28-447c-825a-5b7d35a1a364/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/c095d09f-2c28-447c-825a-5b7d35a1a364/disk 1073741824" returned: 0 in 0.051s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:43 user nova-compute[75391]: DEBUG nova.network.neutron [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Successfully created port: 890fb506-c663-42f4-88b3-e25a9b58676f {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 03:02:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.193s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:43 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c095d09f-2c28-447c-825a-5b7d35a1a364/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 03:02:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c095d09f-2c28-447c-825a-5b7d35a1a364/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c095d09f-2c28-447c-825a-5b7d35a1a364/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:43 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Cannot resize image /opt/stack/data/nova/instances/c095d09f-2c28-447c-825a-5b7d35a1a364/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 03:02:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 03:02:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Ensure instance console log exists: /opt/stack/data/nova/instances/c095d09f-2c28-447c-825a-5b7d35a1a364/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 03:02:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:43 user nova-compute[75391]: DEBUG nova.network.neutron [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Successfully updated port: 890fb506-c663-42f4-88b3-e25a9b58676f {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 03:02:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "refresh_cache-c095d09f-2c28-447c-825a-5b7d35a1a364" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:02:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquired lock "refresh_cache-c095d09f-2c28-447c-825a-5b7d35a1a364" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:02:43 user nova-compute[75391]: DEBUG nova.network.neutron [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 03:02:43 user nova-compute[75391]: DEBUG nova.compute.manager [req-3d09bb58-4a0a-4837-b1ad-293633f0d341 req-ca584712-f1cd-48b2-bade-71347fd4edaf service nova] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Received event network-changed-890fb506-c663-42f4-88b3-e25a9b58676f {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:02:43 user nova-compute[75391]: DEBUG nova.compute.manager [req-3d09bb58-4a0a-4837-b1ad-293633f0d341 req-ca584712-f1cd-48b2-bade-71347fd4edaf service nova] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Refreshing instance network info cache due to event network-changed-890fb506-c663-42f4-88b3-e25a9b58676f. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:02:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3d09bb58-4a0a-4837-b1ad-293633f0d341 req-ca584712-f1cd-48b2-bade-71347fd4edaf service nova] Acquiring lock "refresh_cache-c095d09f-2c28-447c-825a-5b7d35a1a364" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:02:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:43 user nova-compute[75391]: DEBUG nova.network.neutron [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.network.neutron [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Updating instance_info_cache with network_info: [{"id": "890fb506-c663-42f4-88b3-e25a9b58676f", "address": "fa:16:3e:2b:7e:33", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890fb506-c6", "ovs_interfaceid": "890fb506-c663-42f4-88b3-e25a9b58676f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Releasing lock "refresh_cache-c095d09f-2c28-447c-825a-5b7d35a1a364" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.compute.manager [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Instance network_info: |[{"id": "890fb506-c663-42f4-88b3-e25a9b58676f", "address": "fa:16:3e:2b:7e:33", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890fb506-c6", "ovs_interfaceid": "890fb506-c663-42f4-88b3-e25a9b58676f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3d09bb58-4a0a-4837-b1ad-293633f0d341 req-ca584712-f1cd-48b2-bade-71347fd4edaf service nova] Acquired lock "refresh_cache-c095d09f-2c28-447c-825a-5b7d35a1a364" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.network.neutron [req-3d09bb58-4a0a-4837-b1ad-293633f0d341 req-ca584712-f1cd-48b2-bade-71347fd4edaf service nova] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Refreshing network info cache for port 890fb506-c663-42f4-88b3-e25a9b58676f {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Start _get_guest_xml network_info=[{"id": "890fb506-c663-42f4-88b3-e25a9b58676f", "address": "fa:16:3e:2b:7e:33", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890fb506-c6", "ovs_interfaceid": "890fb506-c663-42f4-88b3-e25a9b58676f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 03:02:44 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:02:44 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-392080998',display_name='tempest-AttachVolumeNegativeTest-server-392080998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-392080998',id=41,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWS48m79Gu7pozxl1/wnBIk1/Ui+lZj0enXXe9N18XvwhaQp+ZZegOhJueNzTyTeHWWaNP45JkpzaZ/SPJH6luzfXffCZvTQulkmJ/cmTlrp5T/S8DA1HoBxyd36bE4NQ==',key_name='tempest-keypair-1724219349',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c00f50c42754cea86c68e3e668c0180',ramdisk_id='',reservation_id='r-m50b8jwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-941502312',owner_user_name='tempest-AttachVolumeNegativeTest-941502312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:02:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970046cb64de4109bb299f75172b7dd7',uuid=c095d09f-2c28-447c-825a-5b7d35a1a364,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "890fb506-c663-42f4-88b3-e25a9b58676f", "address": "fa:16:3e:2b:7e:33", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890fb506-c6", "ovs_interfaceid": "890fb506-c663-42f4-88b3-e25a9b58676f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Converting VIF {"id": "890fb506-c663-42f4-88b3-e25a9b58676f", "address": "fa:16:3e:2b:7e:33", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890fb506-c6", "ovs_interfaceid": "890fb506-c663-42f4-88b3-e25a9b58676f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:7e:33,bridge_name='br-int',has_traffic_filtering=True,id=890fb506-c663-42f4-88b3-e25a9b58676f,network=Network(2109b776-effc-4ec7-ac51-d0408f119253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap890fb506-c6') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.objects.instance [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lazy-loading 'pci_devices' on Instance uuid c095d09f-2c28-447c-825a-5b7d35a1a364 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] End _get_guest_xml xml=<domain type="kvm">
Nov 15 03:02:44 user nova-compute[75391]:   <uuid>c095d09f-2c28-447c-825a-5b7d35a1a364</uuid>
Nov 15 03:02:44 user nova-compute[75391]:   <name>instance-00000029</name>
Nov 15 03:02:44 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 03:02:44 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 03:02:44 user nova-compute[75391]:   <metadata>
Nov 15 03:02:44 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 03:02:44 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 03:02:44 user nova-compute[75391]:       <nova:name>tempest-AttachVolumeNegativeTest-server-392080998</nova:name>
Nov 15 03:02:44 user nova-compute[75391]:       <nova:creationTime>2023-11-15 03:02:44</nova:creationTime>
Nov 15 03:02:44 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 03:02:44 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 03:02:44 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 03:02:44 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 03:02:44 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 03:02:44 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 03:02:44 user nova-compute[75391]:       </nova:flavor>
Nov 15 03:02:44 user nova-compute[75391]:       <nova:owner>
Nov 15 03:02:44 user nova-compute[75391]:         <nova:user uuid="970046cb64de4109bb299f75172b7dd7">tempest-AttachVolumeNegativeTest-941502312-project-member</nova:user>
Nov 15 03:02:44 user nova-compute[75391]:         <nova:project uuid="9c00f50c42754cea86c68e3e668c0180">tempest-AttachVolumeNegativeTest-941502312</nova:project>
Nov 15 03:02:44 user nova-compute[75391]:       </nova:owner>
Nov 15 03:02:44 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 03:02:44 user nova-compute[75391]:       <nova:ports>
Nov 15 03:02:44 user nova-compute[75391]:         <nova:port uuid="890fb506-c663-42f4-88b3-e25a9b58676f">
Nov 15 03:02:44 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 03:02:44 user nova-compute[75391]:         </nova:port>
Nov 15 03:02:44 user nova-compute[75391]:       </nova:ports>
Nov 15 03:02:44 user nova-compute[75391]:     </nova:instance>
Nov 15 03:02:44 user nova-compute[75391]:   </metadata>
Nov 15 03:02:44 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 03:02:44 user nova-compute[75391]:     <system>
Nov 15 03:02:44 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 03:02:44 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 03:02:44 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 03:02:44 user nova-compute[75391]:       <entry name="serial">c095d09f-2c28-447c-825a-5b7d35a1a364</entry>
Nov 15 03:02:44 user nova-compute[75391]:       <entry name="uuid">c095d09f-2c28-447c-825a-5b7d35a1a364</entry>
Nov 15 03:02:44 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 03:02:44 user nova-compute[75391]:     </system>
Nov 15 03:02:44 user nova-compute[75391]:   </sysinfo>
Nov 15 03:02:44 user nova-compute[75391]:   <os>
Nov 15 03:02:44 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 03:02:44 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 03:02:44 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 03:02:44 user nova-compute[75391]:   </os>
Nov 15 03:02:44 user nova-compute[75391]:   <features>
Nov 15 03:02:44 user nova-compute[75391]:     <acpi/>
Nov 15 03:02:44 user nova-compute[75391]:     <apic/>
Nov 15 03:02:44 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 03:02:44 user nova-compute[75391]:   </features>
Nov 15 03:02:44 user nova-compute[75391]:   <clock offset="utc">
Nov 15 03:02:44 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 03:02:44 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 03:02:44 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 03:02:44 user nova-compute[75391]:   </clock>
Nov 15 03:02:44 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 03:02:44 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 03:02:44 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 03:02:44 user nova-compute[75391]:   </cpu>
Nov 15 03:02:44 user nova-compute[75391]:   <devices>
Nov 15 03:02:44 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 03:02:44 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 03:02:44 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/c095d09f-2c28-447c-825a-5b7d35a1a364/disk"/>
Nov 15 03:02:44 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 03:02:44 user nova-compute[75391]:     </disk>
Nov 15 03:02:44 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 03:02:44 user nova-compute[75391]:       <mac address="fa:16:3e:2b:7e:33"/>
Nov 15 03:02:44 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:02:44 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 03:02:44 user nova-compute[75391]:       <target dev="tap890fb506-c6"/>
Nov 15 03:02:44 user nova-compute[75391]:     </interface>
Nov 15 03:02:44 user nova-compute[75391]:     <serial type="pty">
Nov 15 03:02:44 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/c095d09f-2c28-447c-825a-5b7d35a1a364/console.log" append="off"/>
Nov 15 03:02:44 user nova-compute[75391]:     </serial>
Nov 15 03:02:44 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 03:02:44 user nova-compute[75391]:     <video>
Nov 15 03:02:44 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:02:44 user nova-compute[75391]:     </video>
Nov 15 03:02:44 user nova-compute[75391]:     <rng model="virtio">
Nov 15 03:02:44 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 03:02:44 user nova-compute[75391]:     </rng>
Nov 15 03:02:44 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 03:02:44 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 03:02:44 user nova-compute[75391]:       <stats period="10"/>
Nov 15 03:02:44 user nova-compute[75391]:     </memballoon>
Nov 15 03:02:44 user nova-compute[75391]:   </devices>
Nov 15 03:02:44 user nova-compute[75391]: </domain>
Nov 15 03:02:44 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-392080998',display_name='tempest-AttachVolumeNegativeTest-server-392080998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-392080998',id=41,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWS48m79Gu7pozxl1/wnBIk1/Ui+lZj0enXXe9N18XvwhaQp+ZZegOhJueNzTyTeHWWaNP45JkpzaZ/SPJH6luzfXffCZvTQulkmJ/cmTlrp5T/S8DA1HoBxyd36bE4NQ==',key_name='tempest-keypair-1724219349',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c00f50c42754cea86c68e3e668c0180',ramdisk_id='',reservation_id='r-m50b8jwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-941502312',owner_user_name='tempest-AttachVolumeNegativeTest-941502312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:02:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970046cb64de4109bb299f75172b7dd7',uuid=c095d09f-2c28-447c-825a-5b7d35a1a364,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "890fb506-c663-42f4-88b3-e25a9b58676f", "address": "fa:16:3e:2b:7e:33", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890fb506-c6", "ovs_interfaceid": "890fb506-c663-42f4-88b3-e25a9b58676f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Converting VIF {"id": "890fb506-c663-42f4-88b3-e25a9b58676f", "address": "fa:16:3e:2b:7e:33", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890fb506-c6", "ovs_interfaceid": "890fb506-c663-42f4-88b3-e25a9b58676f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:7e:33,bridge_name='br-int',has_traffic_filtering=True,id=890fb506-c663-42f4-88b3-e25a9b58676f,network=Network(2109b776-effc-4ec7-ac51-d0408f119253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap890fb506-c6') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG os_vif [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:7e:33,bridge_name='br-int',has_traffic_filtering=True,id=890fb506-c663-42f4-88b3-e25a9b58676f,network=Network(2109b776-effc-4ec7-ac51-d0408f119253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap890fb506-c6') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72c0d1e4-2c23-5e92-8f29-ee64aab96d19', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap890fb506-c6, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap890fb506-c6, col_values=(('qos', UUID('7c022449-4333-40a1-8d33-9f324943b375')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap890fb506-c6, col_values=(('external_ids', {'iface-id': '890fb506-c663-42f4-88b3-e25a9b58676f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:7e:33', 'vm-uuid': 'c095d09f-2c28-447c-825a-5b7d35a1a364'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:44 user nova-compute[75391]: INFO os_vif [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:7e:33,bridge_name='br-int',has_traffic_filtering=True,id=890fb506-c663-42f4-88b3-e25a9b58676f,network=Network(2109b776-effc-4ec7-ac51-d0408f119253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap890fb506-c6')
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] No VIF found with MAC fa:16:3e:2b:7e:33, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.network.neutron [req-3d09bb58-4a0a-4837-b1ad-293633f0d341 req-ca584712-f1cd-48b2-bade-71347fd4edaf service nova] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Updated VIF entry in instance network info cache for port 890fb506-c663-42f4-88b3-e25a9b58676f. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.network.neutron [req-3d09bb58-4a0a-4837-b1ad-293633f0d341 req-ca584712-f1cd-48b2-bade-71347fd4edaf service nova] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Updating instance_info_cache with network_info: [{"id": "890fb506-c663-42f4-88b3-e25a9b58676f", "address": "fa:16:3e:2b:7e:33", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890fb506-c6", "ovs_interfaceid": "890fb506-c663-42f4-88b3-e25a9b58676f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3d09bb58-4a0a-4837-b1ad-293633f0d341 req-ca584712-f1cd-48b2-bade-71347fd4edaf service nova] Releasing lock "refresh_cache-c095d09f-2c28-447c-825a-5b7d35a1a364" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "2316b79b-8366-4f90-b12f-4407db67ba64" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "2316b79b-8366-4f90-b12f-4407db67ba64" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:44 user nova-compute[75391]: INFO nova.compute.manager [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Unshelving
Nov 15 03:02:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.objects.instance [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lazy-loading 'pci_requests' on Instance uuid 2316b79b-8366-4f90-b12f-4407db67ba64 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:02:44 user nova-compute[75391]: DEBUG nova.objects.instance [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lazy-loading 'numa_topology' on Instance uuid 2316b79b-8366-4f90-b12f-4407db67ba64 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:02:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 03:02:45 user nova-compute[75391]: INFO nova.compute.claims [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Claim successful on node user
Nov 15 03:02:45 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:02:45 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:02:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:45 user nova-compute[75391]: INFO nova.network.neutron [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Updating port a35cf440-e574-46d9-acb0-9602b9da7f02 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 03:02:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-dad06169-6c64-479f-87a5-d44ac9160e99 req-e599e04d-57a2-495b-aca6-c268f22c22c2 service nova] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Received event network-vif-plugged-890fb506-c663-42f4-88b3-e25a9b58676f {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:02:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-dad06169-6c64-479f-87a5-d44ac9160e99 req-e599e04d-57a2-495b-aca6-c268f22c22c2 service nova] Acquiring lock "c095d09f-2c28-447c-825a-5b7d35a1a364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-dad06169-6c64-479f-87a5-d44ac9160e99 req-e599e04d-57a2-495b-aca6-c268f22c22c2 service nova] Lock "c095d09f-2c28-447c-825a-5b7d35a1a364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-dad06169-6c64-479f-87a5-d44ac9160e99 req-e599e04d-57a2-495b-aca6-c268f22c22c2 service nova] Lock "c095d09f-2c28-447c-825a-5b7d35a1a364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-dad06169-6c64-479f-87a5-d44ac9160e99 req-e599e04d-57a2-495b-aca6-c268f22c22c2 service nova] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] No waiting events found dispatching network-vif-plugged-890fb506-c663-42f4-88b3-e25a9b58676f {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:02:46 user nova-compute[75391]: WARNING nova.compute.manager [req-dad06169-6c64-479f-87a5-d44ac9160e99 req-e599e04d-57a2-495b-aca6-c268f22c22c2 service nova] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Received unexpected event network-vif-plugged-890fb506-c663-42f4-88b3-e25a9b58676f for instance with vm_state building and task_state spawning.
Nov 15 03:02:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "refresh_cache-2316b79b-8366-4f90-b12f-4407db67ba64" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:02:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquired lock "refresh_cache-2316b79b-8366-4f90-b12f-4407db67ba64" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:02:46 user nova-compute[75391]: DEBUG nova.network.neutron [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 03:02:46 user nova-compute[75391]: DEBUG nova.network.neutron [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Updating instance_info_cache with network_info: [{"id": "a35cf440-e574-46d9-acb0-9602b9da7f02", "address": "fa:16:3e:85:6f:38", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa35cf440-e5", "ovs_interfaceid": "a35cf440-e574-46d9-acb0-9602b9da7f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:02:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Releasing lock "refresh_cache-2316b79b-8366-4f90-b12f-4407db67ba64" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:02:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 03:02:46 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Creating image(s)
Nov 15 03:02:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "/opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "/opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "/opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:46 user nova-compute[75391]: DEBUG nova.objects.instance [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2316b79b-8366-4f90-b12f-4407db67ba64 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:02:46 user nova-compute[75391]: DEBUG nova.objects.base [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Object Instance<2316b79b-8366-4f90-b12f-4407db67ba64> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 03:02:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "10096a2f4ad7902fc94fd20f45ffb07eb2a637f5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "10096a2f4ad7902fc94fd20f45ffb07eb2a637f5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10096a2f4ad7902fc94fd20f45ffb07eb2a637f5.part --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG nova.compute.manager [req-97ec2772-0ddd-42d2-8392-c7844e2a6d78 req-83cfdcd0-fb4d-45dc-be97-e0e618751eee service nova] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Received event network-vif-plugged-890fb506-c663-42f4-88b3-e25a9b58676f {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-97ec2772-0ddd-42d2-8392-c7844e2a6d78 req-83cfdcd0-fb4d-45dc-be97-e0e618751eee service nova] Acquiring lock "c095d09f-2c28-447c-825a-5b7d35a1a364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-97ec2772-0ddd-42d2-8392-c7844e2a6d78 req-83cfdcd0-fb4d-45dc-be97-e0e618751eee service nova] Lock "c095d09f-2c28-447c-825a-5b7d35a1a364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-97ec2772-0ddd-42d2-8392-c7844e2a6d78 req-83cfdcd0-fb4d-45dc-be97-e0e618751eee service nova] Lock "c095d09f-2c28-447c-825a-5b7d35a1a364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG nova.compute.manager [req-97ec2772-0ddd-42d2-8392-c7844e2a6d78 req-83cfdcd0-fb4d-45dc-be97-e0e618751eee service nova] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] No waiting events found dispatching network-vif-plugged-890fb506-c663-42f4-88b3-e25a9b58676f {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:02:48 user nova-compute[75391]: WARNING nova.compute.manager [req-97ec2772-0ddd-42d2-8392-c7844e2a6d78 req-83cfdcd0-fb4d-45dc-be97-e0e618751eee service nova] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Received unexpected event network-vif-plugged-890fb506-c663-42f4-88b3-e25a9b58676f for instance with vm_state building and task_state spawning.
Nov 15 03:02:48 user nova-compute[75391]: DEBUG nova.compute.manager [req-97ec2772-0ddd-42d2-8392-c7844e2a6d78 req-83cfdcd0-fb4d-45dc-be97-e0e618751eee service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Received event network-changed-a35cf440-e574-46d9-acb0-9602b9da7f02 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG nova.compute.manager [req-97ec2772-0ddd-42d2-8392-c7844e2a6d78 req-83cfdcd0-fb4d-45dc-be97-e0e618751eee service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Refreshing instance network info cache due to event network-changed-a35cf440-e574-46d9-acb0-9602b9da7f02. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-97ec2772-0ddd-42d2-8392-c7844e2a6d78 req-83cfdcd0-fb4d-45dc-be97-e0e618751eee service nova] Acquiring lock "refresh_cache-2316b79b-8366-4f90-b12f-4407db67ba64" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-97ec2772-0ddd-42d2-8392-c7844e2a6d78 req-83cfdcd0-fb4d-45dc-be97-e0e618751eee service nova] Acquired lock "refresh_cache-2316b79b-8366-4f90-b12f-4407db67ba64" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG nova.network.neutron [req-97ec2772-0ddd-42d2-8392-c7844e2a6d78 req-83cfdcd0-fb4d-45dc-be97-e0e618751eee service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Refreshing network info cache for port a35cf440-e574-46d9-acb0-9602b9da7f02 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10096a2f4ad7902fc94fd20f45ffb07eb2a637f5.part --force-share --output=json" returned: 0 in 0.194s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG nova.virt.images [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] aaa466ce-5d13-4fa4-aabd-956f5c126fb6 was qcow2, converting to raw {{(pid=75391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG nova.privsep.utils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/10096a2f4ad7902fc94fd20f45ffb07eb2a637f5.part /opt/stack/data/nova/instances/_base/10096a2f4ad7902fc94fd20f45ffb07eb2a637f5.converted {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:48 user nova-compute[75391]: INFO nova.compute.manager [None req-00c03c7d-e917-46f3-aed7-d02d84df62b5 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Unrescuing
Nov 15 03:02:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-00c03c7d-e917-46f3-aed7-d02d84df62b5 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "refresh_cache-2a8d7b01-d19e-4484-aa06-272de268e376" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-00c03c7d-e917-46f3-aed7-d02d84df62b5 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquired lock "refresh_cache-2a8d7b01-d19e-4484-aa06-272de268e376" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG nova.network.neutron [None req-00c03c7d-e917-46f3-aed7-d02d84df62b5 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG nova.network.neutron [req-97ec2772-0ddd-42d2-8392-c7844e2a6d78 req-83cfdcd0-fb4d-45dc-be97-e0e618751eee service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Updated VIF entry in instance network info cache for port a35cf440-e574-46d9-acb0-9602b9da7f02. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG nova.network.neutron [req-97ec2772-0ddd-42d2-8392-c7844e2a6d78 req-83cfdcd0-fb4d-45dc-be97-e0e618751eee service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Updating instance_info_cache with network_info: [{"id": "a35cf440-e574-46d9-acb0-9602b9da7f02", "address": "fa:16:3e:85:6f:38", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa35cf440-e5", "ovs_interfaceid": "a35cf440-e574-46d9-acb0-9602b9da7f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG nova.compute.manager [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 03:02:48 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Instance spawned successfully.
Nov 15 03:02:48 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-97ec2772-0ddd-42d2-8392-c7844e2a6d78 req-83cfdcd0-fb4d-45dc-be97-e0e618751eee service nova] Releasing lock "refresh_cache-2316b79b-8366-4f90-b12f-4407db67ba64" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:02:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:49 user nova-compute[75391]: INFO nova.compute.manager [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Took 6.42 seconds to spawn the instance on the hypervisor.
Nov 15 03:02:49 user nova-compute[75391]: DEBUG nova.compute.manager [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 03:02:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/10096a2f4ad7902fc94fd20f45ffb07eb2a637f5.part /opt/stack/data/nova/instances/_base/10096a2f4ad7902fc94fd20f45ffb07eb2a637f5.converted" returned: 0 in 0.706s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10096a2f4ad7902fc94fd20f45ffb07eb2a637f5.converted --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:49 user nova-compute[75391]: INFO nova.compute.manager [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Took 7.25 seconds to build instance.
Nov 15 03:02:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10096a2f4ad7902fc94fd20f45ffb07eb2a637f5.converted --force-share --output=json" returned: 0 in 0.195s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "10096a2f4ad7902fc94fd20f45ffb07eb2a637f5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.554s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10096a2f4ad7902fc94fd20f45ffb07eb2a637f5 --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2f3cde21-36bd-4bd5-bcfb-ae4c6628470d tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "c095d09f-2c28-447c-825a-5b7d35a1a364" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.376s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10096a2f4ad7902fc94fd20f45ffb07eb2a637f5 --force-share --output=json" returned: 0 in 0.182s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "10096a2f4ad7902fc94fd20f45ffb07eb2a637f5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "10096a2f4ad7902fc94fd20f45ffb07eb2a637f5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10096a2f4ad7902fc94fd20f45ffb07eb2a637f5 --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:49 user nova-compute[75391]: DEBUG nova.network.neutron [None req-00c03c7d-e917-46f3-aed7-d02d84df62b5 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Updating instance_info_cache with network_info: [{"id": "90ba99bb-115f-4726-9944-9409490db504", "address": "fa:16:3e:31:51:9b", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ba99bb-11", "ovs_interfaceid": "90ba99bb-115f-4726-9944-9409490db504", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:02:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-00c03c7d-e917-46f3-aed7-d02d84df62b5 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Releasing lock "refresh_cache-2a8d7b01-d19e-4484-aa06-272de268e376" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:02:49 user nova-compute[75391]: DEBUG nova.objects.instance [None req-00c03c7d-e917-46f3-aed7-d02d84df62b5 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'flavor' on Instance uuid 2a8d7b01-d19e-4484-aa06-272de268e376 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:02:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10096a2f4ad7902fc94fd20f45ffb07eb2a637f5 --force-share --output=json" returned: 0 in 0.214s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/10096a2f4ad7902fc94fd20f45ffb07eb2a637f5,backing_fmt=raw /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/10096a2f4ad7902fc94fd20f45ffb07eb2a637f5,backing_fmt=raw /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk 1073741824" returned: 0 in 0.057s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "10096a2f4ad7902fc94fd20f45ffb07eb2a637f5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:49 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10096a2f4ad7902fc94fd20f45ffb07eb2a637f5 --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10096a2f4ad7902fc94fd20f45ffb07eb2a637f5 --force-share --output=json" returned: 0 in 0.217s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:50 user nova-compute[75391]: DEBUG nova.objects.instance [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lazy-loading 'migration_context' on Instance uuid 2316b79b-8366-4f90-b12f-4407db67ba64 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:02:50 user nova-compute[75391]: DEBUG nova.compute.manager [req-43b9f95a-6e8f-4e53-a496-f8e631d8387a req-fe10cf14-a2e8-491d-94b0-c9caf1cf7a3e service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received event network-vif-unplugged-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:02:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-43b9f95a-6e8f-4e53-a496-f8e631d8387a req-fe10cf14-a2e8-491d-94b0-c9caf1cf7a3e service nova] Acquiring lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-43b9f95a-6e8f-4e53-a496-f8e631d8387a req-fe10cf14-a2e8-491d-94b0-c9caf1cf7a3e service nova] Lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-43b9f95a-6e8f-4e53-a496-f8e631d8387a req-fe10cf14-a2e8-491d-94b0-c9caf1cf7a3e service nova] Lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:50 user nova-compute[75391]: DEBUG nova.compute.manager [req-43b9f95a-6e8f-4e53-a496-f8e631d8387a req-fe10cf14-a2e8-491d-94b0-c9caf1cf7a3e service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] No waiting events found dispatching network-vif-unplugged-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:02:50 user nova-compute[75391]: WARNING nova.compute.manager [req-43b9f95a-6e8f-4e53-a496-f8e631d8387a req-fe10cf14-a2e8-491d-94b0-c9caf1cf7a3e service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received unexpected event network-vif-unplugged-90ba99bb-115f-4726-9944-9409490db504 for instance with vm_state rescued and task_state unrescuing.
Nov 15 03:02:50 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:50 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:50 user nova-compute[75391]: DEBUG nova.objects.base [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Object Instance<2316b79b-8366-4f90-b12f-4407db67ba64> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 03:02:50 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Rebasing disk image.
Nov 15 03:02:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.180s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:50 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a -F raw /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:02:50 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Instance destroyed successfully.
Nov 15 03:02:52 user nova-compute[75391]: DEBUG nova.compute.manager [req-dd7daad2-213d-4639-9ae5-9dfd2bd185f5 req-83c9a663-807d-4d8d-a135-316d35644656 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received event network-vif-plugged-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:02:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-dd7daad2-213d-4639-9ae5-9dfd2bd185f5 req-83c9a663-807d-4d8d-a135-316d35644656 service nova] Acquiring lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-dd7daad2-213d-4639-9ae5-9dfd2bd185f5 req-83c9a663-807d-4d8d-a135-316d35644656 service nova] Lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-dd7daad2-213d-4639-9ae5-9dfd2bd185f5 req-83c9a663-807d-4d8d-a135-316d35644656 service nova] Lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:52 user nova-compute[75391]: DEBUG nova.compute.manager [req-dd7daad2-213d-4639-9ae5-9dfd2bd185f5 req-83c9a663-807d-4d8d-a135-316d35644656 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] No waiting events found dispatching network-vif-plugged-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:02:52 user nova-compute[75391]: WARNING nova.compute.manager [req-dd7daad2-213d-4639-9ae5-9dfd2bd185f5 req-83c9a663-807d-4d8d-a135-316d35644656 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received unexpected event network-vif-plugged-90ba99bb-115f-4726-9944-9409490db504 for instance with vm_state rescued and task_state unrescuing.
Nov 15 03:02:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a -F raw /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk" returned: 0 in 3.183s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Ensure instance console log exists: /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Start _get_guest_xml network_info=[{"id": "a35cf440-e574-46d9-acb0-9602b9da7f02", "address": "fa:16:3e:85:6f:38", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa35cf440-e5", "ovs_interfaceid": "a35cf440-e574-46d9-acb0-9602b9da7f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='716a93f3e1fcba70672e6932205c078d',container_format='bare',created_at=2023-11-15T03:00:52Z,direct_url=<?>,disk_format='qcow2',id=aaa466ce-5d13-4fa4-aabd-956f5c126fb6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1482534692-shelved',owner='f1ec3021653b4209a509852c7a28bf46',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T03:00:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 03:02:53 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:02:53 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='716a93f3e1fcba70672e6932205c078d',container_format='bare',created_at=2023-11-15T03:00:52Z,direct_url=<?>,disk_format='qcow2',id=aaa466ce-5d13-4fa4-aabd-956f5c126fb6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1482534692-shelved',owner='f1ec3021653b4209a509852c7a28bf46',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T03:00:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.objects.instance [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2316b79b-8366-4f90-b12f-4407db67ba64 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.objects.base [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Object Instance<2316b79b-8366-4f90-b12f-4407db67ba64> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T02:58:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1482534692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1482534692',id=37,image_ref='aaa466ce-5d13-4fa4-aabd-956f5c126fb6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-29219381',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:59:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f1ec3021653b4209a509852c7a28bf46',ramdisk_id='',reservation_id='r-rksnk0uu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1315675398',owner_user_name='tempest-AttachVolumeShelveTestJSON-1315675398-project-member',shelved_at='2023-11-15T03:00:56.544896',shelved_host='user',shelved_image_id='aaa466ce-5d13-4fa4-aabd-956f5c126fb6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:02:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e55cae841f994756843bc97a063ebe86',uuid=2316b79b-8366-4f90-b12f-4407db67ba64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a35cf440-e574-46d9-acb0-9602b9da7f02", "address": "fa:16:3e:85:6f:38", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa35cf440-e5", "ovs_interfaceid": "a35cf440-e574-46d9-acb0-9602b9da7f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Converting VIF {"id": "a35cf440-e574-46d9-acb0-9602b9da7f02", "address": "fa:16:3e:85:6f:38", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa35cf440-e5", "ovs_interfaceid": "a35cf440-e574-46d9-acb0-9602b9da7f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:6f:38,bridge_name='br-int',has_traffic_filtering=True,id=a35cf440-e574-46d9-acb0-9602b9da7f02,network=Network(64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa35cf440-e5') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.objects.instance [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lazy-loading 'pci_devices' on Instance uuid 2316b79b-8366-4f90-b12f-4407db67ba64 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.objects.base [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Object Instance<2316b79b-8366-4f90-b12f-4407db67ba64> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] End _get_guest_xml xml=<domain type="kvm">
Nov 15 03:02:53 user nova-compute[75391]:   <uuid>2316b79b-8366-4f90-b12f-4407db67ba64</uuid>
Nov 15 03:02:53 user nova-compute[75391]:   <name>instance-00000025</name>
Nov 15 03:02:53 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 03:02:53 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 03:02:53 user nova-compute[75391]:   <metadata>
Nov 15 03:02:53 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 03:02:53 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 03:02:53 user nova-compute[75391]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1482534692</nova:name>
Nov 15 03:02:53 user nova-compute[75391]:       <nova:creationTime>2023-11-15 03:02:53</nova:creationTime>
Nov 15 03:02:53 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 03:02:53 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 03:02:53 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 03:02:53 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 03:02:53 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 03:02:53 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 03:02:53 user nova-compute[75391]:       </nova:flavor>
Nov 15 03:02:53 user nova-compute[75391]:       <nova:owner>
Nov 15 03:02:53 user nova-compute[75391]:         <nova:user uuid="e55cae841f994756843bc97a063ebe86">tempest-AttachVolumeShelveTestJSON-1315675398-project-member</nova:user>
Nov 15 03:02:53 user nova-compute[75391]:         <nova:project uuid="f1ec3021653b4209a509852c7a28bf46">tempest-AttachVolumeShelveTestJSON-1315675398</nova:project>
Nov 15 03:02:53 user nova-compute[75391]:       </nova:owner>
Nov 15 03:02:53 user nova-compute[75391]:       <nova:root type="image" uuid="aaa466ce-5d13-4fa4-aabd-956f5c126fb6"/>
Nov 15 03:02:53 user nova-compute[75391]:       <nova:ports>
Nov 15 03:02:53 user nova-compute[75391]:         <nova:port uuid="a35cf440-e574-46d9-acb0-9602b9da7f02">
Nov 15 03:02:53 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 03:02:53 user nova-compute[75391]:         </nova:port>
Nov 15 03:02:53 user nova-compute[75391]:       </nova:ports>
Nov 15 03:02:53 user nova-compute[75391]:     </nova:instance>
Nov 15 03:02:53 user nova-compute[75391]:   </metadata>
Nov 15 03:02:53 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 03:02:53 user nova-compute[75391]:     <system>
Nov 15 03:02:53 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 03:02:53 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 03:02:53 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 03:02:53 user nova-compute[75391]:       <entry name="serial">2316b79b-8366-4f90-b12f-4407db67ba64</entry>
Nov 15 03:02:53 user nova-compute[75391]:       <entry name="uuid">2316b79b-8366-4f90-b12f-4407db67ba64</entry>
Nov 15 03:02:53 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 03:02:53 user nova-compute[75391]:     </system>
Nov 15 03:02:53 user nova-compute[75391]:   </sysinfo>
Nov 15 03:02:53 user nova-compute[75391]:   <os>
Nov 15 03:02:53 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 03:02:53 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 03:02:53 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 03:02:53 user nova-compute[75391]:   </os>
Nov 15 03:02:53 user nova-compute[75391]:   <features>
Nov 15 03:02:53 user nova-compute[75391]:     <acpi/>
Nov 15 03:02:53 user nova-compute[75391]:     <apic/>
Nov 15 03:02:53 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 03:02:53 user nova-compute[75391]:   </features>
Nov 15 03:02:53 user nova-compute[75391]:   <clock offset="utc">
Nov 15 03:02:53 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 03:02:53 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 03:02:53 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 03:02:53 user nova-compute[75391]:   </clock>
Nov 15 03:02:53 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 03:02:53 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 03:02:53 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 03:02:53 user nova-compute[75391]:   </cpu>
Nov 15 03:02:53 user nova-compute[75391]:   <devices>
Nov 15 03:02:53 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 03:02:53 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 03:02:53 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk"/>
Nov 15 03:02:53 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 03:02:53 user nova-compute[75391]:     </disk>
Nov 15 03:02:53 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 03:02:53 user nova-compute[75391]:       <mac address="fa:16:3e:85:6f:38"/>
Nov 15 03:02:53 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:02:53 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 03:02:53 user nova-compute[75391]:       <target dev="tapa35cf440-e5"/>
Nov 15 03:02:53 user nova-compute[75391]:     </interface>
Nov 15 03:02:53 user nova-compute[75391]:     <serial type="pty">
Nov 15 03:02:53 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/console.log" append="off"/>
Nov 15 03:02:53 user nova-compute[75391]:     </serial>
Nov 15 03:02:53 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 03:02:53 user nova-compute[75391]:     <video>
Nov 15 03:02:53 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:02:53 user nova-compute[75391]:     </video>
Nov 15 03:02:53 user nova-compute[75391]:     <rng model="virtio">
Nov 15 03:02:53 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 03:02:53 user nova-compute[75391]:     </rng>
Nov 15 03:02:53 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 03:02:53 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 03:02:53 user nova-compute[75391]:       <stats period="10"/>
Nov 15 03:02:53 user nova-compute[75391]:     </memballoon>
Nov 15 03:02:53 user nova-compute[75391]:   </devices>
Nov 15 03:02:53 user nova-compute[75391]: </domain>
Nov 15 03:02:53 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T02:58:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1482534692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1482534692',id=37,image_ref='aaa466ce-5d13-4fa4-aabd-956f5c126fb6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-29219381',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:59:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f1ec3021653b4209a509852c7a28bf46',ramdisk_id='',reservation_id='r-rksnk0uu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1315675398',owner_user_name='tempest-AttachVolumeShelveTestJSON-1315675398-project-member',shelved_at='2023-11-15T03:00:56.544896',shelved_host='user',shelved_image_id='aaa466ce-5d13-4fa4-aabd-956f5c126fb6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:02:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e55cae841f994756843bc97a063ebe86',uuid=2316b79b-8366-4f90-b12f-4407db67ba64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a35cf440-e574-46d9-acb0-9602b9da7f02", "address": "fa:16:3e:85:6f:38", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa35cf440-e5", "ovs_interfaceid": "a35cf440-e574-46d9-acb0-9602b9da7f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Converting VIF {"id": "a35cf440-e574-46d9-acb0-9602b9da7f02", "address": "fa:16:3e:85:6f:38", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa35cf440-e5", "ovs_interfaceid": "a35cf440-e574-46d9-acb0-9602b9da7f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:6f:38,bridge_name='br-int',has_traffic_filtering=True,id=a35cf440-e574-46d9-acb0-9602b9da7f02,network=Network(64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa35cf440-e5') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG os_vif [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:6f:38,bridge_name='br-int',has_traffic_filtering=True,id=a35cf440-e574-46d9-acb0-9602b9da7f02,network=Network(64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa35cf440-e5') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48ee46df-6d51-55b0-9d4f-31ba4efd985e', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa35cf440-e5, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa35cf440-e5, col_values=(('qos', UUID('f0cfc64c-0daf-485a-a440-cfcf32538356')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa35cf440-e5, col_values=(('external_ids', {'iface-id': 'a35cf440-e574-46d9-acb0-9602b9da7f02', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:6f:38', 'vm-uuid': '2316b79b-8366-4f90-b12f-4407db67ba64'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:53 user nova-compute[75391]: INFO os_vif [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:6f:38,bridge_name='br-int',has_traffic_filtering=True,id=a35cf440-e574-46d9-acb0-9602b9da7f02,network=Network(64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa35cf440-e5')
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] No VIF found with MAC fa:16:3e:85:6f:38, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 03:02:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:54 user nova-compute[75391]: DEBUG nova.compute.manager [req-6813f38f-59dc-43b1-8c99-b3bd82f544c4 req-89773e79-3e80-4f0c-bfd0-78a147ad3a74 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received event network-vif-plugged-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:02:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6813f38f-59dc-43b1-8c99-b3bd82f544c4 req-89773e79-3e80-4f0c-bfd0-78a147ad3a74 service nova] Acquiring lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6813f38f-59dc-43b1-8c99-b3bd82f544c4 req-89773e79-3e80-4f0c-bfd0-78a147ad3a74 service nova] Lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6813f38f-59dc-43b1-8c99-b3bd82f544c4 req-89773e79-3e80-4f0c-bfd0-78a147ad3a74 service nova] Lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:54 user nova-compute[75391]: DEBUG nova.compute.manager [req-6813f38f-59dc-43b1-8c99-b3bd82f544c4 req-89773e79-3e80-4f0c-bfd0-78a147ad3a74 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] No waiting events found dispatching network-vif-plugged-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:02:54 user nova-compute[75391]: WARNING nova.compute.manager [req-6813f38f-59dc-43b1-8c99-b3bd82f544c4 req-89773e79-3e80-4f0c-bfd0-78a147ad3a74 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received unexpected event network-vif-plugged-90ba99bb-115f-4726-9944-9409490db504 for instance with vm_state rescued and task_state unrescuing.
Nov 15 03:02:54 user nova-compute[75391]: DEBUG nova.compute.manager [req-6813f38f-59dc-43b1-8c99-b3bd82f544c4 req-89773e79-3e80-4f0c-bfd0-78a147ad3a74 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received event network-vif-plugged-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:02:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6813f38f-59dc-43b1-8c99-b3bd82f544c4 req-89773e79-3e80-4f0c-bfd0-78a147ad3a74 service nova] Acquiring lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6813f38f-59dc-43b1-8c99-b3bd82f544c4 req-89773e79-3e80-4f0c-bfd0-78a147ad3a74 service nova] Lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6813f38f-59dc-43b1-8c99-b3bd82f544c4 req-89773e79-3e80-4f0c-bfd0-78a147ad3a74 service nova] Lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:54 user nova-compute[75391]: DEBUG nova.compute.manager [req-6813f38f-59dc-43b1-8c99-b3bd82f544c4 req-89773e79-3e80-4f0c-bfd0-78a147ad3a74 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] No waiting events found dispatching network-vif-plugged-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:02:54 user nova-compute[75391]: WARNING nova.compute.manager [req-6813f38f-59dc-43b1-8c99-b3bd82f544c4 req-89773e79-3e80-4f0c-bfd0-78a147ad3a74 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received unexpected event network-vif-plugged-90ba99bb-115f-4726-9944-9409490db504 for instance with vm_state rescued and task_state unrescuing.
Nov 15 03:02:55 user nova-compute[75391]: DEBUG nova.compute.manager [None req-00c03c7d-e917-46f3-aed7-d02d84df62b5 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 03:02:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:55 user nova-compute[75391]: DEBUG nova.compute.manager [req-35528d3d-68f3-45a3-a523-fe8c66b42d20 req-6a3d5a08-ac12-463a-b481-684081f9477f service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Received event network-vif-plugged-a35cf440-e574-46d9-acb0-9602b9da7f02 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:02:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-35528d3d-68f3-45a3-a523-fe8c66b42d20 req-6a3d5a08-ac12-463a-b481-684081f9477f service nova] Acquiring lock "2316b79b-8366-4f90-b12f-4407db67ba64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-35528d3d-68f3-45a3-a523-fe8c66b42d20 req-6a3d5a08-ac12-463a-b481-684081f9477f service nova] Lock "2316b79b-8366-4f90-b12f-4407db67ba64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-35528d3d-68f3-45a3-a523-fe8c66b42d20 req-6a3d5a08-ac12-463a-b481-684081f9477f service nova] Lock "2316b79b-8366-4f90-b12f-4407db67ba64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:55 user nova-compute[75391]: DEBUG nova.compute.manager [req-35528d3d-68f3-45a3-a523-fe8c66b42d20 req-6a3d5a08-ac12-463a-b481-684081f9477f service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] No waiting events found dispatching network-vif-plugged-a35cf440-e574-46d9-acb0-9602b9da7f02 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:02:55 user nova-compute[75391]: WARNING nova.compute.manager [req-35528d3d-68f3-45a3-a523-fe8c66b42d20 req-6a3d5a08-ac12-463a-b481-684081f9477f service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Received unexpected event network-vif-plugged-a35cf440-e574-46d9-acb0-9602b9da7f02 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 03:02:55 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:02:55 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:02:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-7bd332f2-0f74-4a43-96a2-2322b6cbf982" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:02:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-7bd332f2-0f74-4a43-96a2-2322b6cbf982" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:02:55 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:02:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:56 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Updating instance_info_cache with network_info: [{"id": "5ef68714-0fbe-470d-b208-7d482f023640", "address": "fa:16:3e:0f:8e:b7", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef68714-0f", "ovs_interfaceid": "5ef68714-0fbe-470d-b208-7d482f023640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:02:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-7bd332f2-0f74-4a43-96a2-2322b6cbf982" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:02:56 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:02:56 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:02:57 user nova-compute[75391]: DEBUG nova.compute.manager [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 03:02:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 03:02:57 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Instance spawned successfully.
Nov 15 03:02:57 user nova-compute[75391]: DEBUG nova.compute.manager [req-31dea4bc-03be-4312-b41a-69117efef9e8 req-ab167af8-a709-4a91-9cf4-0193c7411080 service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Received event network-vif-plugged-a35cf440-e574-46d9-acb0-9602b9da7f02 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:02:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-31dea4bc-03be-4312-b41a-69117efef9e8 req-ab167af8-a709-4a91-9cf4-0193c7411080 service nova] Acquiring lock "2316b79b-8366-4f90-b12f-4407db67ba64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:02:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-31dea4bc-03be-4312-b41a-69117efef9e8 req-ab167af8-a709-4a91-9cf4-0193c7411080 service nova] Lock "2316b79b-8366-4f90-b12f-4407db67ba64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:02:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-31dea4bc-03be-4312-b41a-69117efef9e8 req-ab167af8-a709-4a91-9cf4-0193c7411080 service nova] Lock "2316b79b-8366-4f90-b12f-4407db67ba64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:57 user nova-compute[75391]: DEBUG nova.compute.manager [req-31dea4bc-03be-4312-b41a-69117efef9e8 req-ab167af8-a709-4a91-9cf4-0193c7411080 service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] No waiting events found dispatching network-vif-plugged-a35cf440-e574-46d9-acb0-9602b9da7f02 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:02:57 user nova-compute[75391]: WARNING nova.compute.manager [req-31dea4bc-03be-4312-b41a-69117efef9e8 req-ab167af8-a709-4a91-9cf4-0193c7411080 service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Received unexpected event network-vif-plugged-a35cf440-e574-46d9-acb0-9602b9da7f02 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 03:02:57 user nova-compute[75391]: DEBUG nova.compute.manager [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 03:02:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-895c4fc5-8b11-4aad-a3b8-ad96a512eeb4 tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "2316b79b-8366-4f90-b12f-4407db67ba64" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.168s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:02:58 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:02:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:02:59 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:03:01 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:03:02 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:03:02 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:03:02 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:03:03 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:03:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:03:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:03:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:03:03 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:03:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:03:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:03:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:03:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:03:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:03:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:03:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c095d09f-2c28-447c-825a-5b7d35a1a364/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:03:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c095d09f-2c28-447c-825a-5b7d35a1a364/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:03:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c095d09f-2c28-447c-825a-5b7d35a1a364/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:03:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c095d09f-2c28-447c-825a-5b7d35a1a364/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:03:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:03:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:03:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:03:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:03:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 03:03:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:03:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:03:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:03:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:03:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/780583af-4625-4d90-9e96-6cefcd5311fb/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:03:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/780583af-4625-4d90-9e96-6cefcd5311fb/disk --force-share --output=json" returned: 0 in 0.351s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:03:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/780583af-4625-4d90-9e96-6cefcd5311fb/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:03:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/780583af-4625-4d90-9e96-6cefcd5311fb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:03:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:03:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:03:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:03:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:03:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:03:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:03:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:03:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:03:06 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 03:03:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:03:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:03:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:03:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:03:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:03:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:03:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:03:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:03:07 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:03:07 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:03:07 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8068MB free_disk=24.949905395507812GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:03:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:03:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:03:07 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9909ae6b-7900-4f71-8900-2bf25185e436 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:03:07 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 7bd332f2-0f74-4a43-96a2-2322b6cbf982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:03:07 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 2a8d7b01-d19e-4484-aa06-272de268e376 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:03:07 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance cadf93c5-d57c-4dfa-a3c6-6c1606049636 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:03:07 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 780583af-4625-4d90-9e96-6cefcd5311fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:03:07 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance bf7a7308-36a6-4a34-bde5-bacd29a77101 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:03:07 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance c095d09f-2c28-447c-825a-5b7d35a1a364 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:03:07 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 2316b79b-8366-4f90-b12f-4407db67ba64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:03:07 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:03:07 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:03:08 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Refreshing inventories for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 03:03:08 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Updating ProviderTree inventory for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 03:03:08 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Updating inventory in ProviderTree for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 03:03:08 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Refreshing aggregate associations for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e, aggregates: None {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 03:03:08 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Refreshing trait associations for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 03:03:08 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:03:08 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:03:08 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:03:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.630s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:03:08 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:03:08 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:03:08 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Cleaning up deleted instances {{(pid=75391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 03:03:08 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] There are 0 instances to clean {{(pid=75391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 03:03:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:03:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:03:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:03:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:03:17 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:03:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:03:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:03:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:03:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:03:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:03:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:03:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:03:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:03:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:03:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:03:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:03:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:03:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:03:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:03:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:03:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:03:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:03:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:03:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:03:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:03:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:03:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:03:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:03:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:03:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:03:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:03:57 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:03:57 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:03:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-2a8d7b01-d19e-4484-aa06-272de268e376" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:03:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-2a8d7b01-d19e-4484-aa06-272de268e376" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:03:57 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:03:58 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Updating instance_info_cache with network_info: [{"id": "90ba99bb-115f-4726-9944-9409490db504", "address": "fa:16:3e:31:51:9b", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ba99bb-11", "ovs_interfaceid": "90ba99bb-115f-4726-9944-9409490db504", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:03:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-2a8d7b01-d19e-4484-aa06-272de268e376" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:03:58 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:03:58 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:03:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:03:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98fe86a2-dd0c-4944-adad-08a66f21aad4 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Acquiring lock "780583af-4625-4d90-9e96-6cefcd5311fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:03:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98fe86a2-dd0c-4944-adad-08a66f21aad4 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Lock "780583af-4625-4d90-9e96-6cefcd5311fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:03:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98fe86a2-dd0c-4944-adad-08a66f21aad4 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Acquiring lock "780583af-4625-4d90-9e96-6cefcd5311fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:03:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98fe86a2-dd0c-4944-adad-08a66f21aad4 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Lock "780583af-4625-4d90-9e96-6cefcd5311fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:03:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98fe86a2-dd0c-4944-adad-08a66f21aad4 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Lock "780583af-4625-4d90-9e96-6cefcd5311fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:03:59 user nova-compute[75391]: INFO nova.compute.manager [None req-98fe86a2-dd0c-4944-adad-08a66f21aad4 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Terminating instance
Nov 15 03:03:59 user nova-compute[75391]: DEBUG nova.compute.manager [None req-98fe86a2-dd0c-4944-adad-08a66f21aad4 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 03:03:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:03:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:03:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:03:59 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:03:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:03:59 user nova-compute[75391]: DEBUG nova.compute.manager [req-2ecf78f8-493f-4035-91bc-c5616240c131 req-ffc6c8f3-91bb-477c-ba01-554a83e67859 service nova] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Received event network-vif-unplugged-ed513a43-6b15-48e4-a3ad-14c1b3b86c25 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:03:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2ecf78f8-493f-4035-91bc-c5616240c131 req-ffc6c8f3-91bb-477c-ba01-554a83e67859 service nova] Acquiring lock "780583af-4625-4d90-9e96-6cefcd5311fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:03:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2ecf78f8-493f-4035-91bc-c5616240c131 req-ffc6c8f3-91bb-477c-ba01-554a83e67859 service nova] Lock "780583af-4625-4d90-9e96-6cefcd5311fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:03:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2ecf78f8-493f-4035-91bc-c5616240c131 req-ffc6c8f3-91bb-477c-ba01-554a83e67859 service nova] Lock "780583af-4625-4d90-9e96-6cefcd5311fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:03:59 user nova-compute[75391]: DEBUG nova.compute.manager [req-2ecf78f8-493f-4035-91bc-c5616240c131 req-ffc6c8f3-91bb-477c-ba01-554a83e67859 service nova] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] No waiting events found dispatching network-vif-unplugged-ed513a43-6b15-48e4-a3ad-14c1b3b86c25 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:03:59 user nova-compute[75391]: DEBUG nova.compute.manager [req-2ecf78f8-493f-4035-91bc-c5616240c131 req-ffc6c8f3-91bb-477c-ba01-554a83e67859 service nova] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Received event network-vif-unplugged-ed513a43-6b15-48e4-a3ad-14c1b3b86c25 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 03:03:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:00 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Instance destroyed successfully.
Nov 15 03:04:00 user nova-compute[75391]: DEBUG nova.objects.instance [None req-98fe86a2-dd0c-4944-adad-08a66f21aad4 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Lazy-loading 'resources' on Instance uuid 780583af-4625-4d90-9e96-6cefcd5311fb {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:04:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-98fe86a2-dd0c-4944-adad-08a66f21aad4 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:02:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-369533408',display_name='tempest-VolumesActionsTest-instance-369533408',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-369533408',id=39,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T03:02:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eea13f2f935d479c8c629ff4e4eb06c0',ramdisk_id='',reservation_id='r-0iqqc0np',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-88225058',owner_user_name='tempest-VolumesActionsTest-88225058-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T03:02:11Z,user_data=None,user_id='6423d98b36fc4102b0d21bf5b62aa60b',uuid=780583af-4625-4d90-9e96-6cefcd5311fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed513a43-6b15-48e4-a3ad-14c1b3b86c25", "address": "fa:16:3e:c8:30:10", "network": {"id": "e8ee78cc-99a2-4e49-a06b-623741f8f139", "bridge": "br-int", "label": "tempest-VolumesActionsTest-303373147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea13f2f935d479c8c629ff4e4eb06c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped513a43-6b", "ovs_interfaceid": "ed513a43-6b15-48e4-a3ad-14c1b3b86c25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 03:04:00 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-98fe86a2-dd0c-4944-adad-08a66f21aad4 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Converting VIF {"id": "ed513a43-6b15-48e4-a3ad-14c1b3b86c25", "address": "fa:16:3e:c8:30:10", "network": {"id": "e8ee78cc-99a2-4e49-a06b-623741f8f139", "bridge": "br-int", "label": "tempest-VolumesActionsTest-303373147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea13f2f935d479c8c629ff4e4eb06c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped513a43-6b", "ovs_interfaceid": "ed513a43-6b15-48e4-a3ad-14c1b3b86c25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:04:00 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-98fe86a2-dd0c-4944-adad-08a66f21aad4 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:30:10,bridge_name='br-int',has_traffic_filtering=True,id=ed513a43-6b15-48e4-a3ad-14c1b3b86c25,network=Network(e8ee78cc-99a2-4e49-a06b-623741f8f139),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped513a43-6b') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:04:00 user nova-compute[75391]: DEBUG os_vif [None req-98fe86a2-dd0c-4944-adad-08a66f21aad4 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:30:10,bridge_name='br-int',has_traffic_filtering=True,id=ed513a43-6b15-48e4-a3ad-14c1b3b86c25,network=Network(e8ee78cc-99a2-4e49-a06b-623741f8f139),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped513a43-6b') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 03:04:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped513a43-6b, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:04:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=87974025-8b1a-4318-8724-e7ff1f0aab84) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:04:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:04:00 user nova-compute[75391]: INFO os_vif [None req-98fe86a2-dd0c-4944-adad-08a66f21aad4 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:30:10,bridge_name='br-int',has_traffic_filtering=True,id=ed513a43-6b15-48e4-a3ad-14c1b3b86c25,network=Network(e8ee78cc-99a2-4e49-a06b-623741f8f139),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped513a43-6b')
Nov 15 03:04:00 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-98fe86a2-dd0c-4944-adad-08a66f21aad4 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Deleting instance files /opt/stack/data/nova/instances/780583af-4625-4d90-9e96-6cefcd5311fb_del
Nov 15 03:04:00 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-98fe86a2-dd0c-4944-adad-08a66f21aad4 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Deletion of /opt/stack/data/nova/instances/780583af-4625-4d90-9e96-6cefcd5311fb_del complete
Nov 15 03:04:00 user nova-compute[75391]: INFO nova.compute.manager [None req-98fe86a2-dd0c-4944-adad-08a66f21aad4 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 15 03:04:00 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-98fe86a2-dd0c-4944-adad-08a66f21aad4 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 03:04:00 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 03:04:00 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 03:04:00 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:04:00 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Took 0.42 seconds to deallocate network for instance.
Nov 15 03:04:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98fe86a2-dd0c-4944-adad-08a66f21aad4 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:04:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98fe86a2-dd0c-4944-adad-08a66f21aad4 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:04:00 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-98fe86a2-dd0c-4944-adad-08a66f21aad4 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:04:00 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-98fe86a2-dd0c-4944-adad-08a66f21aad4 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:04:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98fe86a2-dd0c-4944-adad-08a66f21aad4 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:04:01 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-98fe86a2-dd0c-4944-adad-08a66f21aad4 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Deleted allocations for instance 780583af-4625-4d90-9e96-6cefcd5311fb
Nov 15 03:04:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98fe86a2-dd0c-4944-adad-08a66f21aad4 tempest-VolumesActionsTest-88225058 tempest-VolumesActionsTest-88225058-project-member] Lock "780583af-4625-4d90-9e96-6cefcd5311fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.570s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:04:01 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:04:01 user nova-compute[75391]: DEBUG nova.compute.manager [req-3264e2a3-3e8b-407f-b53c-e5af0489bff8 req-c4e5740e-e8fc-416c-ac90-e9bc48a1df97 service nova] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Received event network-vif-plugged-ed513a43-6b15-48e4-a3ad-14c1b3b86c25 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:04:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3264e2a3-3e8b-407f-b53c-e5af0489bff8 req-c4e5740e-e8fc-416c-ac90-e9bc48a1df97 service nova] Acquiring lock "780583af-4625-4d90-9e96-6cefcd5311fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:04:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3264e2a3-3e8b-407f-b53c-e5af0489bff8 req-c4e5740e-e8fc-416c-ac90-e9bc48a1df97 service nova] Lock "780583af-4625-4d90-9e96-6cefcd5311fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:04:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3264e2a3-3e8b-407f-b53c-e5af0489bff8 req-c4e5740e-e8fc-416c-ac90-e9bc48a1df97 service nova] Lock "780583af-4625-4d90-9e96-6cefcd5311fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:04:01 user nova-compute[75391]: DEBUG nova.compute.manager [req-3264e2a3-3e8b-407f-b53c-e5af0489bff8 req-c4e5740e-e8fc-416c-ac90-e9bc48a1df97 service nova] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] No waiting events found dispatching network-vif-plugged-ed513a43-6b15-48e4-a3ad-14c1b3b86c25 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:04:01 user nova-compute[75391]: WARNING nova.compute.manager [req-3264e2a3-3e8b-407f-b53c-e5af0489bff8 req-c4e5740e-e8fc-416c-ac90-e9bc48a1df97 service nova] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Received unexpected event network-vif-plugged-ed513a43-6b15-48e4-a3ad-14c1b3b86c25 for instance with vm_state deleted and task_state None.
Nov 15 03:04:01 user nova-compute[75391]: DEBUG nova.compute.manager [req-3264e2a3-3e8b-407f-b53c-e5af0489bff8 req-c4e5740e-e8fc-416c-ac90-e9bc48a1df97 service nova] [instance: 780583af-4625-4d90-9e96-6cefcd5311fb] Received event network-vif-deleted-ed513a43-6b15-48e4-a3ad-14c1b3b86c25 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:04:02 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:04:04 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:04:04 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:04:04 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:04:04 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:04:04 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:04:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:04:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:04:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:04:04 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:04:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:04:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:04:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:04:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:04:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c095d09f-2c28-447c-825a-5b7d35a1a364/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:04:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c095d09f-2c28-447c-825a-5b7d35a1a364/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:04:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c095d09f-2c28-447c-825a-5b7d35a1a364/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:04:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c095d09f-2c28-447c-825a-5b7d35a1a364/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:04:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:04:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:04:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:04:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:04:06 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 03:04:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:04:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:04:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:04:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:04:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:04:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:04:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:04:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:04:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:04:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:04:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:04:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:04:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 03:04:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:04:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:04:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:04:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:04:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:04:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:04:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:04:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:04:08 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:04:08 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:04:08 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8067MB free_disk=24.948619842529297GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:04:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:04:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:04:08 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9909ae6b-7900-4f71-8900-2bf25185e436 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:04:08 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 7bd332f2-0f74-4a43-96a2-2322b6cbf982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:04:08 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 2a8d7b01-d19e-4484-aa06-272de268e376 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:04:08 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance cadf93c5-d57c-4dfa-a3c6-6c1606049636 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:04:08 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance bf7a7308-36a6-4a34-bde5-bacd29a77101 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:04:08 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance c095d09f-2c28-447c-825a-5b7d35a1a364 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:04:08 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 2316b79b-8366-4f90-b12f-4407db67ba64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:04:08 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:04:08 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:04:08 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:04:08 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:04:08 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:04:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:04:09 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:04:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:19 user nova-compute[75391]: DEBUG nova.compute.manager [req-3bfc1cf6-e549-4c62-a2a6-69912b191cbd req-86e883c1-4f49-4615-8f9a-e4e44499648d service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received event network-changed-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:04:19 user nova-compute[75391]: DEBUG nova.compute.manager [req-3bfc1cf6-e549-4c62-a2a6-69912b191cbd req-86e883c1-4f49-4615-8f9a-e4e44499648d service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Refreshing instance network info cache due to event network-changed-53ee1144-b72a-431c-9e42-7efd212177b3. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:04:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3bfc1cf6-e549-4c62-a2a6-69912b191cbd req-86e883c1-4f49-4615-8f9a-e4e44499648d service nova] Acquiring lock "refresh_cache-bf7a7308-36a6-4a34-bde5-bacd29a77101" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:04:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3bfc1cf6-e549-4c62-a2a6-69912b191cbd req-86e883c1-4f49-4615-8f9a-e4e44499648d service nova] Acquired lock "refresh_cache-bf7a7308-36a6-4a34-bde5-bacd29a77101" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:04:19 user nova-compute[75391]: DEBUG nova.network.neutron [req-3bfc1cf6-e549-4c62-a2a6-69912b191cbd req-86e883c1-4f49-4615-8f9a-e4e44499648d service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Refreshing network info cache for port 53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:04:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:04:20 user nova-compute[75391]: DEBUG nova.network.neutron [req-3bfc1cf6-e549-4c62-a2a6-69912b191cbd req-86e883c1-4f49-4615-8f9a-e4e44499648d service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Updated VIF entry in instance network info cache for port 53ee1144-b72a-431c-9e42-7efd212177b3. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:04:20 user nova-compute[75391]: DEBUG nova.network.neutron [req-3bfc1cf6-e549-4c62-a2a6-69912b191cbd req-86e883c1-4f49-4615-8f9a-e4e44499648d service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Updating instance_info_cache with network_info: [{"id": "53ee1144-b72a-431c-9e42-7efd212177b3", "address": "fa:16:3e:98:e2:5a", "network": {"id": "434e7c61-37f4-4a23-be35-6cc6f9842cad", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1311932462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a64dab12ce74d18b3d9414595910180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee1144-b7", "ovs_interfaceid": "53ee1144-b72a-431c-9e42-7efd212177b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:04:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3bfc1cf6-e549-4c62-a2a6-69912b191cbd req-86e883c1-4f49-4615-8f9a-e4e44499648d service nova] Releasing lock "refresh_cache-bf7a7308-36a6-4a34-bde5-bacd29a77101" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:04:20 user nova-compute[75391]: DEBUG nova.compute.manager [None req-86bcbad3-ac1a-4ddb-bf30-21f760d4207e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 03:04:20 user nova-compute[75391]: INFO nova.compute.manager [None req-86bcbad3-ac1a-4ddb-bf30-21f760d4207e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] instance snapshotting
Nov 15 03:04:20 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-86bcbad3-ac1a-4ddb-bf30-21f760d4207e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Beginning live snapshot process
Nov 15 03:04:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-86bcbad3-ac1a-4ddb-bf30-21f760d4207e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json -f qcow2 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:04:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-86bcbad3-ac1a-4ddb-bf30-21f760d4207e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:04:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-86bcbad3-ac1a-4ddb-bf30-21f760d4207e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json -f qcow2 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:04:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-86bcbad3-ac1a-4ddb-bf30-21f760d4207e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:04:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-86bcbad3-ac1a-4ddb-bf30-21f760d4207e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:04:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-86bcbad3-ac1a-4ddb-bf30-21f760d4207e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.174s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:04:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-86bcbad3-ac1a-4ddb-bf30-21f760d4207e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5icdlhsk/c7fb6adc098b4616b43eeb30b3812c34.delta 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:04:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-86bcbad3-ac1a-4ddb-bf30-21f760d4207e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5icdlhsk/c7fb6adc098b4616b43eeb30b3812c34.delta 1073741824" returned: 0 in 0.048s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:04:21 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-86bcbad3-ac1a-4ddb-bf30-21f760d4207e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 03:04:22 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-86bcbad3-ac1a-4ddb-bf30-21f760d4207e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 03:04:22 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-86bcbad3-ac1a-4ddb-bf30-21f760d4207e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 03:04:22 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-86bcbad3-ac1a-4ddb-bf30-21f760d4207e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 03:04:22 user nova-compute[75391]: DEBUG nova.privsep.utils [None req-86bcbad3-ac1a-4ddb-bf30-21f760d4207e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 03:04:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-86bcbad3-ac1a-4ddb-bf30-21f760d4207e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5icdlhsk/c7fb6adc098b4616b43eeb30b3812c34.delta /opt/stack/data/nova/instances/snapshots/tmp5icdlhsk/c7fb6adc098b4616b43eeb30b3812c34 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:04:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-86bcbad3-ac1a-4ddb-bf30-21f760d4207e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5icdlhsk/c7fb6adc098b4616b43eeb30b3812c34.delta /opt/stack/data/nova/instances/snapshots/tmp5icdlhsk/c7fb6adc098b4616b43eeb30b3812c34" returned: 0 in 0.540s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:04:23 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-86bcbad3-ac1a-4ddb-bf30-21f760d4207e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Snapshot extracted, beginning image upload
Nov 15 03:04:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:26 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-86bcbad3-ac1a-4ddb-bf30-21f760d4207e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Snapshot image upload complete
Nov 15 03:04:26 user nova-compute[75391]: INFO nova.compute.manager [None req-86bcbad3-ac1a-4ddb-bf30-21f760d4207e tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Took 5.10 seconds to snapshot the instance on the hypervisor.
Nov 15 03:04:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:32 user nova-compute[75391]: DEBUG nova.compute.manager [req-6581a606-9f2b-4d17-92b4-9e2f2bc7e17e req-d872ecf2-3233-4b24-b38f-bd4a14a8f4af service nova] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Received event network-changed-890fb506-c663-42f4-88b3-e25a9b58676f {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:04:32 user nova-compute[75391]: DEBUG nova.compute.manager [req-6581a606-9f2b-4d17-92b4-9e2f2bc7e17e req-d872ecf2-3233-4b24-b38f-bd4a14a8f4af service nova] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Refreshing instance network info cache due to event network-changed-890fb506-c663-42f4-88b3-e25a9b58676f. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:04:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6581a606-9f2b-4d17-92b4-9e2f2bc7e17e req-d872ecf2-3233-4b24-b38f-bd4a14a8f4af service nova] Acquiring lock "refresh_cache-c095d09f-2c28-447c-825a-5b7d35a1a364" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:04:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6581a606-9f2b-4d17-92b4-9e2f2bc7e17e req-d872ecf2-3233-4b24-b38f-bd4a14a8f4af service nova] Acquired lock "refresh_cache-c095d09f-2c28-447c-825a-5b7d35a1a364" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:04:32 user nova-compute[75391]: DEBUG nova.network.neutron [req-6581a606-9f2b-4d17-92b4-9e2f2bc7e17e req-d872ecf2-3233-4b24-b38f-bd4a14a8f4af service nova] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Refreshing network info cache for port 890fb506-c663-42f4-88b3-e25a9b58676f {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7a9990f7-433b-4547-843b-a7e2fcaadd6c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "c095d09f-2c28-447c-825a-5b7d35a1a364" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7a9990f7-433b-4547-843b-a7e2fcaadd6c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "c095d09f-2c28-447c-825a-5b7d35a1a364" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7a9990f7-433b-4547-843b-a7e2fcaadd6c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "c095d09f-2c28-447c-825a-5b7d35a1a364-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7a9990f7-433b-4547-843b-a7e2fcaadd6c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "c095d09f-2c28-447c-825a-5b7d35a1a364-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7a9990f7-433b-4547-843b-a7e2fcaadd6c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "c095d09f-2c28-447c-825a-5b7d35a1a364-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:04:33 user nova-compute[75391]: INFO nova.compute.manager [None req-7a9990f7-433b-4547-843b-a7e2fcaadd6c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Terminating instance
Nov 15 03:04:33 user nova-compute[75391]: DEBUG nova.compute.manager [None req-7a9990f7-433b-4547-843b-a7e2fcaadd6c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG nova.network.neutron [req-6581a606-9f2b-4d17-92b4-9e2f2bc7e17e req-d872ecf2-3233-4b24-b38f-bd4a14a8f4af service nova] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Updated VIF entry in instance network info cache for port 890fb506-c663-42f4-88b3-e25a9b58676f. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG nova.network.neutron [req-6581a606-9f2b-4d17-92b4-9e2f2bc7e17e req-d872ecf2-3233-4b24-b38f-bd4a14a8f4af service nova] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Updating instance_info_cache with network_info: [{"id": "890fb506-c663-42f4-88b3-e25a9b58676f", "address": "fa:16:3e:2b:7e:33", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890fb506-c6", "ovs_interfaceid": "890fb506-c663-42f4-88b3-e25a9b58676f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6581a606-9f2b-4d17-92b4-9e2f2bc7e17e req-d872ecf2-3233-4b24-b38f-bd4a14a8f4af service nova] Releasing lock "refresh_cache-c095d09f-2c28-447c-825a-5b7d35a1a364" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-6cfe52eb-0422-40af-a506-a229fa57aa7e req-814c52a1-7c00-4c54-a621-9e71be19e86c service nova] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Received event network-vif-unplugged-890fb506-c663-42f4-88b3-e25a9b58676f {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6cfe52eb-0422-40af-a506-a229fa57aa7e req-814c52a1-7c00-4c54-a621-9e71be19e86c service nova] Acquiring lock "c095d09f-2c28-447c-825a-5b7d35a1a364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6cfe52eb-0422-40af-a506-a229fa57aa7e req-814c52a1-7c00-4c54-a621-9e71be19e86c service nova] Lock "c095d09f-2c28-447c-825a-5b7d35a1a364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6cfe52eb-0422-40af-a506-a229fa57aa7e req-814c52a1-7c00-4c54-a621-9e71be19e86c service nova] Lock "c095d09f-2c28-447c-825a-5b7d35a1a364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-6cfe52eb-0422-40af-a506-a229fa57aa7e req-814c52a1-7c00-4c54-a621-9e71be19e86c service nova] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] No waiting events found dispatching network-vif-unplugged-890fb506-c663-42f4-88b3-e25a9b58676f {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-6cfe52eb-0422-40af-a506-a229fa57aa7e req-814c52a1-7c00-4c54-a621-9e71be19e86c service nova] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Received event network-vif-unplugged-890fb506-c663-42f4-88b3-e25a9b58676f for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:33 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Instance destroyed successfully.
Nov 15 03:04:33 user nova-compute[75391]: DEBUG nova.objects.instance [None req-7a9990f7-433b-4547-843b-a7e2fcaadd6c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lazy-loading 'resources' on Instance uuid c095d09f-2c28-447c-825a-5b7d35a1a364 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-7a9990f7-433b-4547-843b-a7e2fcaadd6c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-392080998',display_name='tempest-AttachVolumeNegativeTest-server-392080998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-392080998',id=41,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWS48m79Gu7pozxl1/wnBIk1/Ui+lZj0enXXe9N18XvwhaQp+ZZegOhJueNzTyTeHWWaNP45JkpzaZ/SPJH6luzfXffCZvTQulkmJ/cmTlrp5T/S8DA1HoBxyd36bE4NQ==',key_name='tempest-keypair-1724219349',keypairs=<?>,launch_index=0,launched_at=2023-11-15T03:02:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c00f50c42754cea86c68e3e668c0180',ramdisk_id='',reservation_id='r-m50b8jwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-941502312',owner_user_name='tempest-AttachVolumeNegativeTest-941502312-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T03:02:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970046cb64de4109bb299f75172b7dd7',uuid=c095d09f-2c28-447c-825a-5b7d35a1a364,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "890fb506-c663-42f4-88b3-e25a9b58676f", "address": "fa:16:3e:2b:7e:33", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890fb506-c6", "ovs_interfaceid": "890fb506-c663-42f4-88b3-e25a9b58676f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-7a9990f7-433b-4547-843b-a7e2fcaadd6c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Converting VIF {"id": "890fb506-c663-42f4-88b3-e25a9b58676f", "address": "fa:16:3e:2b:7e:33", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890fb506-c6", "ovs_interfaceid": "890fb506-c663-42f4-88b3-e25a9b58676f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-7a9990f7-433b-4547-843b-a7e2fcaadd6c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:7e:33,bridge_name='br-int',has_traffic_filtering=True,id=890fb506-c663-42f4-88b3-e25a9b58676f,network=Network(2109b776-effc-4ec7-ac51-d0408f119253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap890fb506-c6') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG os_vif [None req-7a9990f7-433b-4547-843b-a7e2fcaadd6c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:7e:33,bridge_name='br-int',has_traffic_filtering=True,id=890fb506-c663-42f4-88b3-e25a9b58676f,network=Network(2109b776-effc-4ec7-ac51-d0408f119253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap890fb506-c6') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap890fb506-c6, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7c022449-4333-40a1-8d33-9f324943b375) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:33 user nova-compute[75391]: INFO os_vif [None req-7a9990f7-433b-4547-843b-a7e2fcaadd6c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:7e:33,bridge_name='br-int',has_traffic_filtering=True,id=890fb506-c663-42f4-88b3-e25a9b58676f,network=Network(2109b776-effc-4ec7-ac51-d0408f119253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap890fb506-c6')
Nov 15 03:04:33 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-7a9990f7-433b-4547-843b-a7e2fcaadd6c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Deleting instance files /opt/stack/data/nova/instances/c095d09f-2c28-447c-825a-5b7d35a1a364_del
Nov 15 03:04:33 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-7a9990f7-433b-4547-843b-a7e2fcaadd6c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Deletion of /opt/stack/data/nova/instances/c095d09f-2c28-447c-825a-5b7d35a1a364_del complete
Nov 15 03:04:33 user nova-compute[75391]: INFO nova.compute.manager [None req-7a9990f7-433b-4547-843b-a7e2fcaadd6c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 15 03:04:33 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-7a9990f7-433b-4547-843b-a7e2fcaadd6c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 03:04:33 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 03:04:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:34 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:04:34 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Took 0.77 seconds to deallocate network for instance.
Nov 15 03:04:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7a9990f7-433b-4547-843b-a7e2fcaadd6c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:04:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7a9990f7-433b-4547-843b-a7e2fcaadd6c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:04:34 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-7a9990f7-433b-4547-843b-a7e2fcaadd6c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:04:34 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-7a9990f7-433b-4547-843b-a7e2fcaadd6c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:04:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-84766d55-41ec-4bf4-b5b5-d3a064f33c2a tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "2316b79b-8366-4f90-b12f-4407db67ba64" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:04:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-84766d55-41ec-4bf4-b5b5-d3a064f33c2a tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "2316b79b-8366-4f90-b12f-4407db67ba64" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:04:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-84766d55-41ec-4bf4-b5b5-d3a064f33c2a tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "2316b79b-8366-4f90-b12f-4407db67ba64-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:04:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-84766d55-41ec-4bf4-b5b5-d3a064f33c2a tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "2316b79b-8366-4f90-b12f-4407db67ba64-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:04:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-84766d55-41ec-4bf4-b5b5-d3a064f33c2a tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "2316b79b-8366-4f90-b12f-4407db67ba64-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:04:35 user nova-compute[75391]: INFO nova.compute.manager [None req-84766d55-41ec-4bf4-b5b5-d3a064f33c2a tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Terminating instance
Nov 15 03:04:35 user nova-compute[75391]: DEBUG nova.compute.manager [None req-84766d55-41ec-4bf4-b5b5-d3a064f33c2a tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 03:04:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7a9990f7-433b-4547-843b-a7e2fcaadd6c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.253s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:04:35 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-7a9990f7-433b-4547-843b-a7e2fcaadd6c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Deleted allocations for instance c095d09f-2c28-447c-825a-5b7d35a1a364
Nov 15 03:04:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7a9990f7-433b-4547-843b-a7e2fcaadd6c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "c095d09f-2c28-447c-825a-5b7d35a1a364" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.896s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:04:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-0974000f-0962-439d-b618-807db2887179 req-c38722f0-7286-4b76-9017-3acc7257f44e service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Received event network-vif-unplugged-a35cf440-e574-46d9-acb0-9602b9da7f02 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:04:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0974000f-0962-439d-b618-807db2887179 req-c38722f0-7286-4b76-9017-3acc7257f44e service nova] Acquiring lock "2316b79b-8366-4f90-b12f-4407db67ba64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:04:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0974000f-0962-439d-b618-807db2887179 req-c38722f0-7286-4b76-9017-3acc7257f44e service nova] Lock "2316b79b-8366-4f90-b12f-4407db67ba64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:04:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0974000f-0962-439d-b618-807db2887179 req-c38722f0-7286-4b76-9017-3acc7257f44e service nova] Lock "2316b79b-8366-4f90-b12f-4407db67ba64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:04:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-0974000f-0962-439d-b618-807db2887179 req-c38722f0-7286-4b76-9017-3acc7257f44e service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] No waiting events found dispatching network-vif-unplugged-a35cf440-e574-46d9-acb0-9602b9da7f02 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:04:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-0974000f-0962-439d-b618-807db2887179 req-c38722f0-7286-4b76-9017-3acc7257f44e service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Received event network-vif-unplugged-a35cf440-e574-46d9-acb0-9602b9da7f02 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 03:04:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-a5c6ca69-29a0-404d-9bef-81f3baf45ce3 req-1492aa21-9044-41ca-8bd4-b9c51168f92f service nova] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Received event network-vif-plugged-890fb506-c663-42f4-88b3-e25a9b58676f {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:04:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a5c6ca69-29a0-404d-9bef-81f3baf45ce3 req-1492aa21-9044-41ca-8bd4-b9c51168f92f service nova] Acquiring lock "c095d09f-2c28-447c-825a-5b7d35a1a364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:04:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a5c6ca69-29a0-404d-9bef-81f3baf45ce3 req-1492aa21-9044-41ca-8bd4-b9c51168f92f service nova] Lock "c095d09f-2c28-447c-825a-5b7d35a1a364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:04:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a5c6ca69-29a0-404d-9bef-81f3baf45ce3 req-1492aa21-9044-41ca-8bd4-b9c51168f92f service nova] Lock "c095d09f-2c28-447c-825a-5b7d35a1a364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:04:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-a5c6ca69-29a0-404d-9bef-81f3baf45ce3 req-1492aa21-9044-41ca-8bd4-b9c51168f92f service nova] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] No waiting events found dispatching network-vif-plugged-890fb506-c663-42f4-88b3-e25a9b58676f {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:04:35 user nova-compute[75391]: WARNING nova.compute.manager [req-a5c6ca69-29a0-404d-9bef-81f3baf45ce3 req-1492aa21-9044-41ca-8bd4-b9c51168f92f service nova] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Received unexpected event network-vif-plugged-890fb506-c663-42f4-88b3-e25a9b58676f for instance with vm_state deleted and task_state None.
Nov 15 03:04:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-a5c6ca69-29a0-404d-9bef-81f3baf45ce3 req-1492aa21-9044-41ca-8bd4-b9c51168f92f service nova] [instance: c095d09f-2c28-447c-825a-5b7d35a1a364] Received event network-vif-deleted-890fb506-c663-42f4-88b3-e25a9b58676f {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:04:35 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Instance destroyed successfully.
Nov 15 03:04:35 user nova-compute[75391]: DEBUG nova.objects.instance [None req-84766d55-41ec-4bf4-b5b5-d3a064f33c2a tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lazy-loading 'resources' on Instance uuid 2316b79b-8366-4f90-b12f-4407db67ba64 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:04:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-84766d55-41ec-4bf4-b5b5-d3a064f33c2a tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T02:58:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1482534692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1482534692',id=37,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvMjjliJ566FQMHT1T/lDX3ih1jNIg/g/cs9dRru8ZvLLPpfmeNWYvht71keBrnz0Xw5g478KgMc9qZ3ErTIzYsmP8nzQ4ZT4TxL+SXFtSe+FueqF2smBhVIQUjkyVetw==',key_name='tempest-keypair-29219381',keypairs=<?>,launch_index=0,launched_at=2023-11-15T03:02:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1ec3021653b4209a509852c7a28bf46',ramdisk_id='',reservation_id='r-rksnk0uu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1315675398',owner_user_name='tempest-AttachVolumeShelveTestJSON-1315675398-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T03:02:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e55cae841f994756843bc97a063ebe86',uuid=2316b79b-8366-4f90-b12f-4407db67ba64,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a35cf440-e574-46d9-acb0-9602b9da7f02", "address": "fa:16:3e:85:6f:38", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa35cf440-e5", "ovs_interfaceid": "a35cf440-e574-46d9-acb0-9602b9da7f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 03:04:35 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-84766d55-41ec-4bf4-b5b5-d3a064f33c2a tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Converting VIF {"id": "a35cf440-e574-46d9-acb0-9602b9da7f02", "address": "fa:16:3e:85:6f:38", "network": {"id": "64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1229393698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec3021653b4209a509852c7a28bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa35cf440-e5", "ovs_interfaceid": "a35cf440-e574-46d9-acb0-9602b9da7f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:04:35 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-84766d55-41ec-4bf4-b5b5-d3a064f33c2a tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:6f:38,bridge_name='br-int',has_traffic_filtering=True,id=a35cf440-e574-46d9-acb0-9602b9da7f02,network=Network(64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa35cf440-e5') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:04:35 user nova-compute[75391]: DEBUG os_vif [None req-84766d55-41ec-4bf4-b5b5-d3a064f33c2a tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:6f:38,bridge_name='br-int',has_traffic_filtering=True,id=a35cf440-e574-46d9-acb0-9602b9da7f02,network=Network(64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa35cf440-e5') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 03:04:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa35cf440-e5, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:04:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:04:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0cfc64c-0daf-485a-a440-cfcf32538356) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:04:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:04:35 user nova-compute[75391]: INFO os_vif [None req-84766d55-41ec-4bf4-b5b5-d3a064f33c2a tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:6f:38,bridge_name='br-int',has_traffic_filtering=True,id=a35cf440-e574-46d9-acb0-9602b9da7f02,network=Network(64c3e6fd-5dd6-4942-9c53-b1546b5dc1f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa35cf440-e5')
Nov 15 03:04:35 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-84766d55-41ec-4bf4-b5b5-d3a064f33c2a tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Deleting instance files /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64_del
Nov 15 03:04:35 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-84766d55-41ec-4bf4-b5b5-d3a064f33c2a tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Deletion of /opt/stack/data/nova/instances/2316b79b-8366-4f90-b12f-4407db67ba64_del complete
Nov 15 03:04:35 user nova-compute[75391]: INFO nova.compute.manager [None req-84766d55-41ec-4bf4-b5b5-d3a064f33c2a tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 03:04:35 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-84766d55-41ec-4bf4-b5b5-d3a064f33c2a tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 03:04:35 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 03:04:35 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 03:04:36 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:04:36 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Took 0.82 seconds to deallocate network for instance.
Nov 15 03:04:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-84766d55-41ec-4bf4-b5b5-d3a064f33c2a tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:04:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-84766d55-41ec-4bf4-b5b5-d3a064f33c2a tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:04:36 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-84766d55-41ec-4bf4-b5b5-d3a064f33c2a tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:04:36 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-84766d55-41ec-4bf4-b5b5-d3a064f33c2a tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:04:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-84766d55-41ec-4bf4-b5b5-d3a064f33c2a tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.245s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:04:37 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-84766d55-41ec-4bf4-b5b5-d3a064f33c2a tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Deleted allocations for instance 2316b79b-8366-4f90-b12f-4407db67ba64
Nov 15 03:04:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-84766d55-41ec-4bf4-b5b5-d3a064f33c2a tempest-AttachVolumeShelveTestJSON-1315675398 tempest-AttachVolumeShelveTestJSON-1315675398-project-member] Lock "2316b79b-8366-4f90-b12f-4407db67ba64" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.102s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:04:37 user nova-compute[75391]: DEBUG nova.compute.manager [req-29377d74-923b-4c11-a412-3909e1d3bd40 req-90110cb5-d9f3-4dd5-81e2-d14ab262224d service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Received event network-vif-plugged-a35cf440-e574-46d9-acb0-9602b9da7f02 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:04:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-29377d74-923b-4c11-a412-3909e1d3bd40 req-90110cb5-d9f3-4dd5-81e2-d14ab262224d service nova] Acquiring lock "2316b79b-8366-4f90-b12f-4407db67ba64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:04:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-29377d74-923b-4c11-a412-3909e1d3bd40 req-90110cb5-d9f3-4dd5-81e2-d14ab262224d service nova] Lock "2316b79b-8366-4f90-b12f-4407db67ba64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:04:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-29377d74-923b-4c11-a412-3909e1d3bd40 req-90110cb5-d9f3-4dd5-81e2-d14ab262224d service nova] Lock "2316b79b-8366-4f90-b12f-4407db67ba64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:04:37 user nova-compute[75391]: DEBUG nova.compute.manager [req-29377d74-923b-4c11-a412-3909e1d3bd40 req-90110cb5-d9f3-4dd5-81e2-d14ab262224d service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] No waiting events found dispatching network-vif-plugged-a35cf440-e574-46d9-acb0-9602b9da7f02 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:04:37 user nova-compute[75391]: WARNING nova.compute.manager [req-29377d74-923b-4c11-a412-3909e1d3bd40 req-90110cb5-d9f3-4dd5-81e2-d14ab262224d service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Received unexpected event network-vif-plugged-a35cf440-e574-46d9-acb0-9602b9da7f02 for instance with vm_state deleted and task_state None.
Nov 15 03:04:37 user nova-compute[75391]: DEBUG nova.compute.manager [req-89fe9ff8-03e4-4f09-8ac7-36370a5b3456 req-e04e6f47-4492-4cbf-b633-3666a8a32ccc service nova] [instance: 2316b79b-8366-4f90-b12f-4407db67ba64] Received event network-vif-deleted-a35cf440-e574-46d9-acb0-9602b9da7f02 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:04:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:39 user nova-compute[75391]: DEBUG nova.compute.manager [req-b84c7481-d7ea-4c28-8691-0b9aaf977e01 req-2d81cdee-0e14-4e10-9692-18e7627efdc8 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received event network-changed-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:04:39 user nova-compute[75391]: DEBUG nova.compute.manager [req-b84c7481-d7ea-4c28-8691-0b9aaf977e01 req-2d81cdee-0e14-4e10-9692-18e7627efdc8 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Refreshing instance network info cache due to event network-changed-90ba99bb-115f-4726-9944-9409490db504. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:04:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b84c7481-d7ea-4c28-8691-0b9aaf977e01 req-2d81cdee-0e14-4e10-9692-18e7627efdc8 service nova] Acquiring lock "refresh_cache-2a8d7b01-d19e-4484-aa06-272de268e376" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:04:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b84c7481-d7ea-4c28-8691-0b9aaf977e01 req-2d81cdee-0e14-4e10-9692-18e7627efdc8 service nova] Acquired lock "refresh_cache-2a8d7b01-d19e-4484-aa06-272de268e376" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:04:39 user nova-compute[75391]: DEBUG nova.network.neutron [req-b84c7481-d7ea-4c28-8691-0b9aaf977e01 req-2d81cdee-0e14-4e10-9692-18e7627efdc8 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Refreshing network info cache for port 90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:04:40 user nova-compute[75391]: DEBUG nova.network.neutron [req-b84c7481-d7ea-4c28-8691-0b9aaf977e01 req-2d81cdee-0e14-4e10-9692-18e7627efdc8 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Updated VIF entry in instance network info cache for port 90ba99bb-115f-4726-9944-9409490db504. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:04:40 user nova-compute[75391]: DEBUG nova.network.neutron [req-b84c7481-d7ea-4c28-8691-0b9aaf977e01 req-2d81cdee-0e14-4e10-9692-18e7627efdc8 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Updating instance_info_cache with network_info: [{"id": "90ba99bb-115f-4726-9944-9409490db504", "address": "fa:16:3e:31:51:9b", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ba99bb-11", "ovs_interfaceid": "90ba99bb-115f-4726-9944-9409490db504", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:04:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b84c7481-d7ea-4c28-8691-0b9aaf977e01 req-2d81cdee-0e14-4e10-9692-18e7627efdc8 service nova] Releasing lock "refresh_cache-2a8d7b01-d19e-4484-aa06-272de268e376" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:04:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "2a8d7b01-d19e-4484-aa06-272de268e376" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:04:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "2a8d7b01-d19e-4484-aa06-272de268e376" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:04:40 user nova-compute[75391]: INFO nova.compute.manager [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Detaching volume 7c07a1f1-b1b6-4759-9c20-f9e04a6b968e
Nov 15 03:04:40 user nova-compute[75391]: INFO nova.virt.block_device [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Attempting to driver detach volume 7c07a1f1-b1b6-4759-9c20-f9e04a6b968e from mountpoint /dev/vdb
Nov 15 03:04:40 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Attempting to detach device vdb from instance 2a8d7b01-d19e-4484-aa06-272de268e376 from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 03:04:40 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 03:04:40 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:04:40 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 03:04:40 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 03:04:40 user nova-compute[75391]:   <serial>7c07a1f1-b1b6-4759-9c20-f9e04a6b968e</serial>
Nov 15 03:04:40 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 03:04:40 user nova-compute[75391]: </disk>
Nov 15 03:04:40 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 03:04:40 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Successfully detached device vdb from instance 2a8d7b01-d19e-4484-aa06-272de268e376 from the persistent domain config.
Nov 15 03:04:40 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2a8d7b01-d19e-4484-aa06-272de268e376 from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 03:04:40 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 03:04:40 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:04:40 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 03:04:40 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 03:04:40 user nova-compute[75391]:   <serial>7c07a1f1-b1b6-4759-9c20-f9e04a6b968e</serial>
Nov 15 03:04:40 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 03:04:40 user nova-compute[75391]: </disk>
Nov 15 03:04:40 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 03:04:40 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:41 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2a8d7b01-d19e-4484-aa06-272de268e376 {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 03:04:42 user nova-compute[75391]: DEBUG nova.compute.manager [req-9c2347a3-1ed8-4579-9b00-a107ae160623 req-56451518-10c6-478c-9aaf-c1f00ad18fd2 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received event network-changed-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:04:42 user nova-compute[75391]: DEBUG nova.compute.manager [req-9c2347a3-1ed8-4579-9b00-a107ae160623 req-56451518-10c6-478c-9aaf-c1f00ad18fd2 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Refreshing instance network info cache due to event network-changed-90ba99bb-115f-4726-9944-9409490db504. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:04:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9c2347a3-1ed8-4579-9b00-a107ae160623 req-56451518-10c6-478c-9aaf-c1f00ad18fd2 service nova] Acquiring lock "refresh_cache-2a8d7b01-d19e-4484-aa06-272de268e376" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:04:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9c2347a3-1ed8-4579-9b00-a107ae160623 req-56451518-10c6-478c-9aaf-c1f00ad18fd2 service nova] Acquired lock "refresh_cache-2a8d7b01-d19e-4484-aa06-272de268e376" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:04:42 user nova-compute[75391]: DEBUG nova.network.neutron [req-9c2347a3-1ed8-4579-9b00-a107ae160623 req-56451518-10c6-478c-9aaf-c1f00ad18fd2 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Refreshing network info cache for port 90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:04:42 user nova-compute[75391]: DEBUG nova.network.neutron [req-9c2347a3-1ed8-4579-9b00-a107ae160623 req-56451518-10c6-478c-9aaf-c1f00ad18fd2 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Updated VIF entry in instance network info cache for port 90ba99bb-115f-4726-9944-9409490db504. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:04:42 user nova-compute[75391]: DEBUG nova.network.neutron [req-9c2347a3-1ed8-4579-9b00-a107ae160623 req-56451518-10c6-478c-9aaf-c1f00ad18fd2 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Updating instance_info_cache with network_info: [{"id": "90ba99bb-115f-4726-9944-9409490db504", "address": "fa:16:3e:31:51:9b", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ba99bb-11", "ovs_interfaceid": "90ba99bb-115f-4726-9944-9409490db504", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:04:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9c2347a3-1ed8-4579-9b00-a107ae160623 req-56451518-10c6-478c-9aaf-c1f00ad18fd2 service nova] Releasing lock "refresh_cache-2a8d7b01-d19e-4484-aa06-272de268e376" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:04:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:50 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:04:58 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:04:58 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:04:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-cadf93c5-d57c-4dfa-a3c6-6c1606049636" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:04:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-cadf93c5-d57c-4dfa-a3c6-6c1606049636" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:04:58 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:04:59 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Updating instance_info_cache with network_info: [{"id": "036afc83-072c-46b1-99cb-32b6f2c13116", "address": "fa:16:3e:a6:30:ec", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap036afc83-07", "ovs_interfaceid": "036afc83-072c-46b1-99cb-32b6f2c13116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:04:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-cadf93c5-d57c-4dfa-a3c6-6c1606049636" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:04:59 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:04:59 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:05:00 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:05:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:05:01 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2a8d7b01-d19e-4484-aa06-272de268e376 is timed out.
Nov 15 03:05:01 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Successfully detached device vdb from instance 2a8d7b01-d19e-4484-aa06-272de268e376 from the live domain config.
Nov 15 03:05:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ngLYyvKl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:05:01 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:05:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6eebdcd-4968-4eef-99c7-f836702bfcbf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 03:05:01 user nova-compute[75391]: No targets found.
Nov 15 03:05:01 user nova-compute[75391]: iSNS:
Nov 15 03:05:01 user nova-compute[75391]: No targets found.
Nov 15 03:05:01 user nova-compute[75391]: STATIC:
Nov 15 03:05:01 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d
Nov 15 03:05:01 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 03:05:01 user nova-compute[75391]:                 Iface Name: default
Nov 15 03:05:01 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e
Nov 15 03:05:01 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 03:05:01 user nova-compute[75391]:                 Iface Name: default
Nov 15 03:05:01 user nova-compute[75391]: FIRMWARE:
Nov 15 03:05:01 user nova-compute[75391]: No targets found.
Nov 15 03:05:01 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 03:05:01 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 03:05:01 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdfd587-1ade-47ba-8dc4-3b4121d4263c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[df823a34-919b-418a-9e6b-824d8ee0dfbc]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e (non-flash)
Nov 15 03:05:01 user nova-compute[75391]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d (non-flash)
Nov 15 03:05:01 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e (non-flash)
Nov 15 03:05:01 user nova-compute[75391]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d (non-flash)
Nov 15 03:05:01 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62247d24d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e'): ({'sdb'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Removing single pathed devices sdb {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6195974-44eb-4748-afe2-859989486bfb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfd040b-0474-454f-a848-e20dadd00cb5]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Flushing IO for device /dev/sdb {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9527b1fb-ed0d-40ae-a21d-ecf3fd06d4df]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca472c2-9368-4c18-a1b6-94117af8def3]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a390cd8d-c907-4d1f-b0ad-8c94faa21df3]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e83776-e1c4-4e8e-bd5a-91f889896c81]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e, portal: 172.16.0.220,3260]
Nov 15 03:05:01 user nova-compute[75391]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e, portal: 172.16.0.220,3260] successful.
Nov 15 03:05:01 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c07a1f1-b1b6-4759-9c20-f9e04a6b968e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9227cd83-7542-452e-9305-39b483210f7c]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] <== disconnect_volume: return (311ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:05:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 03:05:02 user nova-compute[75391]: DEBUG nova.objects.instance [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'flavor' on Instance uuid 2a8d7b01-d19e-4484-aa06-272de268e376 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:05:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2c0f91cb-ae07-4c47-b298-3944b54ada33 tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "2a8d7b01-d19e-4484-aa06-272de268e376" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.619s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:05:02 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:05:02 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:05:05 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:05:05 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:05:05 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:05:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:05:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:05:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:05:05 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:05:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:05:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:05:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:05:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:05:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:05 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 03:05:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:08 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:05:08 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:05:08 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8462MB free_disk=24.95367431640625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:05:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:05:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:05:08 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9909ae6b-7900-4f71-8900-2bf25185e436 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:05:08 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 7bd332f2-0f74-4a43-96a2-2322b6cbf982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:05:08 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 2a8d7b01-d19e-4484-aa06-272de268e376 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:05:08 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance cadf93c5-d57c-4dfa-a3c6-6c1606049636 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:05:08 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance bf7a7308-36a6-4a34-bde5-bacd29a77101 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:05:08 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:05:08 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:05:08 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:05:08 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:05:08 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:05:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.383s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:05:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:09 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:05:09 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:05:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:24 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:05:24 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:05:24 user nova-compute[75391]: INFO nova.compute.manager [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Detaching volume 28e26499-333b-48d6-a55f-588ebe41361d
Nov 15 03:05:24 user nova-compute[75391]: INFO nova.virt.block_device [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Attempting to driver detach volume 28e26499-333b-48d6-a55f-588ebe41361d from mountpoint /dev/vdb
Nov 15 03:05:24 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Attempting to detach device vdb from instance cadf93c5-d57c-4dfa-a3c6-6c1606049636 from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 03:05:24 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 03:05:24 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:05:24 user nova-compute[75391]:   <source dev="/dev/sdc"/>
Nov 15 03:05:24 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 03:05:24 user nova-compute[75391]:   <serial>28e26499-333b-48d6-a55f-588ebe41361d</serial>
Nov 15 03:05:24 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 03:05:24 user nova-compute[75391]: </disk>
Nov 15 03:05:24 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 03:05:24 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Successfully detached device vdb from instance cadf93c5-d57c-4dfa-a3c6-6c1606049636 from the persistent domain config.
Nov 15 03:05:24 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cadf93c5-d57c-4dfa-a3c6-6c1606049636 from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 03:05:24 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 03:05:24 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:05:24 user nova-compute[75391]:   <source dev="/dev/sdc"/>
Nov 15 03:05:24 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 03:05:24 user nova-compute[75391]:   <serial>28e26499-333b-48d6-a55f-588ebe41361d</serial>
Nov 15 03:05:24 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 03:05:24 user nova-compute[75391]: </disk>
Nov 15 03:05:24 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 03:05:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cadf93c5-d57c-4dfa-a3c6-6c1606049636 {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 03:05:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:05:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-59026c82-426d-40b8-ad3d-68be3bd5d97f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "2a8d7b01-d19e-4484-aa06-272de268e376" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:05:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-59026c82-426d-40b8-ad3d-68be3bd5d97f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "2a8d7b01-d19e-4484-aa06-272de268e376" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:05:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-59026c82-426d-40b8-ad3d-68be3bd5d97f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:05:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-59026c82-426d-40b8-ad3d-68be3bd5d97f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:05:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-59026c82-426d-40b8-ad3d-68be3bd5d97f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:05:30 user nova-compute[75391]: INFO nova.compute.manager [None req-59026c82-426d-40b8-ad3d-68be3bd5d97f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Terminating instance
Nov 15 03:05:30 user nova-compute[75391]: DEBUG nova.compute.manager [None req-59026c82-426d-40b8-ad3d-68be3bd5d97f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 03:05:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:31 user nova-compute[75391]: DEBUG nova.compute.manager [req-38cd6158-464b-40ba-9edf-86030fbee458 req-7bc7b7de-01f9-4a87-a0b5-011ab66d2bfc service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received event network-vif-unplugged-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:05:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-38cd6158-464b-40ba-9edf-86030fbee458 req-7bc7b7de-01f9-4a87-a0b5-011ab66d2bfc service nova] Acquiring lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:05:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-38cd6158-464b-40ba-9edf-86030fbee458 req-7bc7b7de-01f9-4a87-a0b5-011ab66d2bfc service nova] Lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:05:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-38cd6158-464b-40ba-9edf-86030fbee458 req-7bc7b7de-01f9-4a87-a0b5-011ab66d2bfc service nova] Lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:05:31 user nova-compute[75391]: DEBUG nova.compute.manager [req-38cd6158-464b-40ba-9edf-86030fbee458 req-7bc7b7de-01f9-4a87-a0b5-011ab66d2bfc service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] No waiting events found dispatching network-vif-unplugged-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:05:31 user nova-compute[75391]: DEBUG nova.compute.manager [req-38cd6158-464b-40ba-9edf-86030fbee458 req-7bc7b7de-01f9-4a87-a0b5-011ab66d2bfc service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received event network-vif-unplugged-90ba99bb-115f-4726-9944-9409490db504 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 03:05:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:31 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Instance destroyed successfully.
Nov 15 03:05:31 user nova-compute[75391]: DEBUG nova.objects.instance [None req-59026c82-426d-40b8-ad3d-68be3bd5d97f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'resources' on Instance uuid 2a8d7b01-d19e-4484-aa06-272de268e376 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:05:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-59026c82-426d-40b8-ad3d-68be3bd5d97f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:58:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-76853416',display_name='tempest-ServerRescueNegativeTestJSON-server-76853416',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-76853416',id=36,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKhaSGqkAzqoum9cargZcVScRKDn1aseIr3GdLRDApyAQ9Xe9xaDmZe3UVdGEeCJjSw59lcw42052OFJbiRx2gsQ9lF8J0h8H1P4kefig/DmS2Avx4QZkI5VTKZo+/Bnw==',key_name='tempest-keypair-660591234',keypairs=<?>,launch_index=0,launched_at=2023-11-15T03:01:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8bfe79a4e16f4fa89437bcc50fc4b356',ramdisk_id='',reservation_id='r-13eb6cmf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-388649299',owner_user_name='tempest-ServerRescueNegativeTestJSON-388649299-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T03:02:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b3fc7a83f6c4c5baa7621163e9f62aa',uuid=2a8d7b01-d19e-4484-aa06-272de268e376,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90ba99bb-115f-4726-9944-9409490db504", "address": "fa:16:3e:31:51:9b", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ba99bb-11", "ovs_interfaceid": "90ba99bb-115f-4726-9944-9409490db504", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 03:05:31 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-59026c82-426d-40b8-ad3d-68be3bd5d97f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Converting VIF {"id": "90ba99bb-115f-4726-9944-9409490db504", "address": "fa:16:3e:31:51:9b", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ba99bb-11", "ovs_interfaceid": "90ba99bb-115f-4726-9944-9409490db504", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:05:31 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-59026c82-426d-40b8-ad3d-68be3bd5d97f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:51:9b,bridge_name='br-int',has_traffic_filtering=True,id=90ba99bb-115f-4726-9944-9409490db504,network=Network(079437cd-2e7d-40ea-98c0-24a1c9091aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ba99bb-11') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:05:31 user nova-compute[75391]: DEBUG os_vif [None req-59026c82-426d-40b8-ad3d-68be3bd5d97f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:51:9b,bridge_name='br-int',has_traffic_filtering=True,id=90ba99bb-115f-4726-9944-9409490db504,network=Network(079437cd-2e7d-40ea-98c0-24a1c9091aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ba99bb-11') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 03:05:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90ba99bb-11, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:05:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9774074-fa71-4ffc-b237-6fe33cb192a2) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:05:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:31 user nova-compute[75391]: INFO os_vif [None req-59026c82-426d-40b8-ad3d-68be3bd5d97f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:51:9b,bridge_name='br-int',has_traffic_filtering=True,id=90ba99bb-115f-4726-9944-9409490db504,network=Network(079437cd-2e7d-40ea-98c0-24a1c9091aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ba99bb-11')
Nov 15 03:05:31 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-59026c82-426d-40b8-ad3d-68be3bd5d97f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Deleting instance files /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376_del
Nov 15 03:05:31 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-59026c82-426d-40b8-ad3d-68be3bd5d97f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Deletion of /opt/stack/data/nova/instances/2a8d7b01-d19e-4484-aa06-272de268e376_del complete
Nov 15 03:05:31 user nova-compute[75391]: INFO nova.compute.manager [None req-59026c82-426d-40b8-ad3d-68be3bd5d97f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 03:05:31 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-59026c82-426d-40b8-ad3d-68be3bd5d97f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 03:05:31 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 03:05:31 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 03:05:32 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:05:32 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Took 0.71 seconds to deallocate network for instance.
Nov 15 03:05:32 user nova-compute[75391]: DEBUG nova.compute.manager [req-963cf962-63e9-4d33-aa98-3d1f39a21bdc req-faabb47a-cc12-49e8-b609-9901017d4ad4 service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received event network-vif-deleted-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:05:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-59026c82-426d-40b8-ad3d-68be3bd5d97f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:05:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-59026c82-426d-40b8-ad3d-68be3bd5d97f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:05:32 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-59026c82-426d-40b8-ad3d-68be3bd5d97f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:05:32 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-59026c82-426d-40b8-ad3d-68be3bd5d97f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:05:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-59026c82-426d-40b8-ad3d-68be3bd5d97f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:05:32 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-59026c82-426d-40b8-ad3d-68be3bd5d97f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Deleted allocations for instance 2a8d7b01-d19e-4484-aa06-272de268e376
Nov 15 03:05:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-59026c82-426d-40b8-ad3d-68be3bd5d97f tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "2a8d7b01-d19e-4484-aa06-272de268e376" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.018s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:05:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-fb6d2ffa-ca00-42ca-a571-9383a0638792 req-da858a7f-4312-47c5-a671-823ce628116e service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received event network-vif-plugged-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:05:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-fb6d2ffa-ca00-42ca-a571-9383a0638792 req-da858a7f-4312-47c5-a671-823ce628116e service nova] Acquiring lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:05:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-fb6d2ffa-ca00-42ca-a571-9383a0638792 req-da858a7f-4312-47c5-a671-823ce628116e service nova] Lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:05:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-fb6d2ffa-ca00-42ca-a571-9383a0638792 req-da858a7f-4312-47c5-a671-823ce628116e service nova] Lock "2a8d7b01-d19e-4484-aa06-272de268e376-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:05:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-fb6d2ffa-ca00-42ca-a571-9383a0638792 req-da858a7f-4312-47c5-a671-823ce628116e service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] No waiting events found dispatching network-vif-plugged-90ba99bb-115f-4726-9944-9409490db504 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:05:33 user nova-compute[75391]: WARNING nova.compute.manager [req-fb6d2ffa-ca00-42ca-a571-9383a0638792 req-da858a7f-4312-47c5-a671-823ce628116e service nova] [instance: 2a8d7b01-d19e-4484-aa06-272de268e376] Received unexpected event network-vif-plugged-90ba99bb-115f-4726-9944-9409490db504 for instance with vm_state deleted and task_state None.
Nov 15 03:05:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:05:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Acquiring lock "ef297753-f6fa-4db7-b866-bfeee166696e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:05:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Lock "ef297753-f6fa-4db7-b866-bfeee166696e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:05:42 user nova-compute[75391]: DEBUG nova.compute.manager [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 03:05:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:05:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:05:42 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 03:05:42 user nova-compute[75391]: INFO nova.compute.claims [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Claim successful on node user
Nov 15 03:05:42 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:05:42 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:05:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:05:42 user nova-compute[75391]: DEBUG nova.compute.manager [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 03:05:42 user nova-compute[75391]: DEBUG nova.compute.manager [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 03:05:42 user nova-compute[75391]: DEBUG nova.network.neutron [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 03:05:42 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 03:05:43 user nova-compute[75391]: DEBUG nova.compute.manager [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 03:05:43 user nova-compute[75391]: DEBUG nova.compute.manager [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 03:05:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 03:05:43 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Creating image(s)
Nov 15 03:05:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef297753-f6fa-4db7-b866-bfeee166696e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:05:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Lock "/opt/stack/data/nova/instances/ef297753-f6fa-4db7-b866-bfeee166696e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:05:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Lock "/opt/stack/data/nova/instances/ef297753-f6fa-4db7-b866-bfeee166696e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:05:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:43 user nova-compute[75391]: DEBUG nova.policy [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e4e7ed8ff044dbabcb7badf0dbb79fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2264d628dfc40399e0cc9910bbce7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 03:05:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.187s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:05:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:05:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.182s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/ef297753-f6fa-4db7-b866-bfeee166696e/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/ef297753-f6fa-4db7-b866-bfeee166696e/disk 1073741824" returned: 0 in 0.058s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:05:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.198s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:43 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef297753-f6fa-4db7-b866-bfeee166696e/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 03:05:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef297753-f6fa-4db7-b866-bfeee166696e/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef297753-f6fa-4db7-b866-bfeee166696e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:43 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Cannot resize image /opt/stack/data/nova/instances/ef297753-f6fa-4db7-b866-bfeee166696e/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 03:05:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 03:05:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Ensure instance console log exists: /opt/stack/data/nova/instances/ef297753-f6fa-4db7-b866-bfeee166696e/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 03:05:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:05:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:05:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:05:44 user nova-compute[75391]: DEBUG nova.network.neutron [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Successfully created port: 57c4062f-008d-4c26-b6fe-6b9acaaa3c2c {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.network.neutron [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Successfully updated port: 57c4062f-008d-4c26-b6fe-6b9acaaa3c2c {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 03:05:45 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cadf93c5-d57c-4dfa-a3c6-6c1606049636 is timed out.
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Acquiring lock "refresh_cache-ef297753-f6fa-4db7-b866-bfeee166696e" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Acquired lock "refresh_cache-ef297753-f6fa-4db7-b866-bfeee166696e" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.network.neutron [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 03:05:45 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Successfully detached device vdb from instance cadf93c5-d57c-4dfa-a3c6-6c1606049636 from the live domain config.
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJRaOUeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:05:45 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:05:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.compute.manager [req-e1429d0e-6f46-4772-90fe-29fdbbfc81db req-94e12d63-0035-40ce-b03e-4f67d04015a4 service nova] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Received event network-changed-57c4062f-008d-4c26-b6fe-6b9acaaa3c2c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.compute.manager [req-e1429d0e-6f46-4772-90fe-29fdbbfc81db req-94e12d63-0035-40ce-b03e-4f67d04015a4 service nova] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Refreshing instance network info cache due to event network-changed-57c4062f-008d-4c26-b6fe-6b9acaaa3c2c. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e1429d0e-6f46-4772-90fe-29fdbbfc81db req-94e12d63-0035-40ce-b03e-4f67d04015a4 service nova] Acquiring lock "refresh_cache-ef297753-f6fa-4db7-b866-bfeee166696e" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[801c9bee-3812-422b-885e-638fa14d67ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 03:05:45 user nova-compute[75391]: No targets found.
Nov 15 03:05:45 user nova-compute[75391]: iSNS:
Nov 15 03:05:45 user nova-compute[75391]: No targets found.
Nov 15 03:05:45 user nova-compute[75391]: STATIC:
Nov 15 03:05:45 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d
Nov 15 03:05:45 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 03:05:45 user nova-compute[75391]:                 Iface Name: default
Nov 15 03:05:45 user nova-compute[75391]: FIRMWARE:
Nov 15 03:05:45 user nova-compute[75391]: No targets found.
Nov 15 03:05:45 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 03:05:45 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 03:05:45 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b27f607-76f4-4d9c-9296-bd9347a04ed9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.network.neutron [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1ef971-be35-41c1-aac7-ba4daa9c47b1]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d (non-flash)
Nov 15 03:05:45 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d (non-flash)
Nov 15 03:05:45 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f622453eef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d'): ({'sdc'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Removing single pathed devices sdc {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4eb3899-029c-4aab-9052-07accba8f878]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[07580422-8a90-47af-a24d-213bdc123802]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Flushing IO for device /dev/sdc {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79945d4-09a7-4126-aa00-7ea853ab3e4d]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20c2c20-a4b5-421e-82c6-8bb098f98106]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] SCSI volumes sdc have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a715bf4d-6a6c-45b2-a501-eb7d92495c45]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a304551e-21a9-4439-beb1-da88c160cbf3]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d, portal: 172.16.0.220,3260]
Nov 15 03:05:45 user nova-compute[75391]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d, portal: 172.16.0.220,3260] successful.
Nov 15 03:05:45 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e26499-333b-48d6-a55f-588ebe41361d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39d20e3-7c50-4183-a66c-0427cb9f8d56]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] <== disconnect_volume: return (286ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.network.neutron [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Updating instance_info_cache with network_info: [{"id": "57c4062f-008d-4c26-b6fe-6b9acaaa3c2c", "address": "fa:16:3e:0c:a3:58", "network": {"id": "1dbbad64-77f5-47da-9da5-d219ac9e5166", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "94d41b4ea2134098830087c7a9bd0c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57c4062f-00", "ovs_interfaceid": "57c4062f-008d-4c26-b6fe-6b9acaaa3c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Releasing lock "refresh_cache-ef297753-f6fa-4db7-b866-bfeee166696e" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.compute.manager [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Instance network_info: |[{"id": "57c4062f-008d-4c26-b6fe-6b9acaaa3c2c", "address": "fa:16:3e:0c:a3:58", "network": {"id": "1dbbad64-77f5-47da-9da5-d219ac9e5166", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "94d41b4ea2134098830087c7a9bd0c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57c4062f-00", "ovs_interfaceid": "57c4062f-008d-4c26-b6fe-6b9acaaa3c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e1429d0e-6f46-4772-90fe-29fdbbfc81db req-94e12d63-0035-40ce-b03e-4f67d04015a4 service nova] Acquired lock "refresh_cache-ef297753-f6fa-4db7-b866-bfeee166696e" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.network.neutron [req-e1429d0e-6f46-4772-90fe-29fdbbfc81db req-94e12d63-0035-40ce-b03e-4f67d04015a4 service nova] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Refreshing network info cache for port 57c4062f-008d-4c26-b6fe-6b9acaaa3c2c {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Start _get_guest_xml network_info=[{"id": "57c4062f-008d-4c26-b6fe-6b9acaaa3c2c", "address": "fa:16:3e:0c:a3:58", "network": {"id": "1dbbad64-77f5-47da-9da5-d219ac9e5166", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "94d41b4ea2134098830087c7a9bd0c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57c4062f-00", "ovs_interfaceid": "57c4062f-008d-4c26-b6fe-6b9acaaa3c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 03:05:45 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:05:45 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:05:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1498347742',display_name='tempest-VolumesNegativeTest-instance-1498347742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1498347742',id=42,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2264d628dfc40399e0cc9910bbce7eb',ramdisk_id='',reservation_id='r-75fagag4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1949875658',owner_user_name='tempest-VolumesNegativeTest-1949875658-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:05:43Z,user_data=None,user_id='2e4e7ed8ff044dbabcb7badf0dbb79fe',uuid=ef297753-f6fa-4db7-b866-bfeee166696e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57c4062f-008d-4c26-b6fe-6b9acaaa3c2c", "address": "fa:16:3e:0c:a3:58", "network": {"id": "1dbbad64-77f5-47da-9da5-d219ac9e5166", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "94d41b4ea2134098830087c7a9bd0c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57c4062f-00", "ovs_interfaceid": "57c4062f-008d-4c26-b6fe-6b9acaaa3c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Converting VIF {"id": "57c4062f-008d-4c26-b6fe-6b9acaaa3c2c", "address": "fa:16:3e:0c:a3:58", "network": {"id": "1dbbad64-77f5-47da-9da5-d219ac9e5166", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "94d41b4ea2134098830087c7a9bd0c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57c4062f-00", "ovs_interfaceid": "57c4062f-008d-4c26-b6fe-6b9acaaa3c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:a3:58,bridge_name='br-int',has_traffic_filtering=True,id=57c4062f-008d-4c26-b6fe-6b9acaaa3c2c,network=Network(1dbbad64-77f5-47da-9da5-d219ac9e5166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57c4062f-00') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.objects.instance [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Lazy-loading 'pci_devices' on Instance uuid ef297753-f6fa-4db7-b866-bfeee166696e {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 03:05:45 user nova-compute[75391]:   <uuid>ef297753-f6fa-4db7-b866-bfeee166696e</uuid>
Nov 15 03:05:45 user nova-compute[75391]:   <name>instance-0000002a</name>
Nov 15 03:05:45 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 03:05:45 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 03:05:45 user nova-compute[75391]:   <metadata>
Nov 15 03:05:45 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 03:05:45 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 03:05:45 user nova-compute[75391]:       <nova:name>tempest-VolumesNegativeTest-instance-1498347742</nova:name>
Nov 15 03:05:45 user nova-compute[75391]:       <nova:creationTime>2023-11-15 03:05:45</nova:creationTime>
Nov 15 03:05:45 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 03:05:45 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 03:05:45 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 03:05:45 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 03:05:45 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 03:05:45 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 03:05:45 user nova-compute[75391]:       </nova:flavor>
Nov 15 03:05:45 user nova-compute[75391]:       <nova:owner>
Nov 15 03:05:45 user nova-compute[75391]:         <nova:user uuid="2e4e7ed8ff044dbabcb7badf0dbb79fe">tempest-VolumesNegativeTest-1949875658-project-member</nova:user>
Nov 15 03:05:45 user nova-compute[75391]:         <nova:project uuid="c2264d628dfc40399e0cc9910bbce7eb">tempest-VolumesNegativeTest-1949875658</nova:project>
Nov 15 03:05:45 user nova-compute[75391]:       </nova:owner>
Nov 15 03:05:45 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 03:05:45 user nova-compute[75391]:       <nova:ports>
Nov 15 03:05:45 user nova-compute[75391]:         <nova:port uuid="57c4062f-008d-4c26-b6fe-6b9acaaa3c2c">
Nov 15 03:05:45 user nova-compute[75391]:           <nova:ip type="fixed" address="192.168.233.28" ipVersion="4"/>
Nov 15 03:05:45 user nova-compute[75391]:         </nova:port>
Nov 15 03:05:45 user nova-compute[75391]:       </nova:ports>
Nov 15 03:05:45 user nova-compute[75391]:     </nova:instance>
Nov 15 03:05:45 user nova-compute[75391]:   </metadata>
Nov 15 03:05:45 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 03:05:45 user nova-compute[75391]:     <system>
Nov 15 03:05:45 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 03:05:45 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 03:05:45 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 03:05:45 user nova-compute[75391]:       <entry name="serial">ef297753-f6fa-4db7-b866-bfeee166696e</entry>
Nov 15 03:05:45 user nova-compute[75391]:       <entry name="uuid">ef297753-f6fa-4db7-b866-bfeee166696e</entry>
Nov 15 03:05:45 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 03:05:45 user nova-compute[75391]:     </system>
Nov 15 03:05:45 user nova-compute[75391]:   </sysinfo>
Nov 15 03:05:45 user nova-compute[75391]:   <os>
Nov 15 03:05:45 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 03:05:45 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 03:05:45 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 03:05:45 user nova-compute[75391]:   </os>
Nov 15 03:05:45 user nova-compute[75391]:   <features>
Nov 15 03:05:45 user nova-compute[75391]:     <acpi/>
Nov 15 03:05:45 user nova-compute[75391]:     <apic/>
Nov 15 03:05:45 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 03:05:45 user nova-compute[75391]:   </features>
Nov 15 03:05:45 user nova-compute[75391]:   <clock offset="utc">
Nov 15 03:05:45 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 03:05:45 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 03:05:45 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 03:05:45 user nova-compute[75391]:   </clock>
Nov 15 03:05:45 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 03:05:45 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 03:05:45 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 03:05:45 user nova-compute[75391]:   </cpu>
Nov 15 03:05:45 user nova-compute[75391]:   <devices>
Nov 15 03:05:45 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 03:05:45 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 03:05:45 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/ef297753-f6fa-4db7-b866-bfeee166696e/disk"/>
Nov 15 03:05:45 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 03:05:45 user nova-compute[75391]:     </disk>
Nov 15 03:05:45 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 03:05:45 user nova-compute[75391]:       <mac address="fa:16:3e:0c:a3:58"/>
Nov 15 03:05:45 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:05:45 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 03:05:45 user nova-compute[75391]:       <target dev="tap57c4062f-00"/>
Nov 15 03:05:45 user nova-compute[75391]:     </interface>
Nov 15 03:05:45 user nova-compute[75391]:     <serial type="pty">
Nov 15 03:05:45 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/ef297753-f6fa-4db7-b866-bfeee166696e/console.log" append="off"/>
Nov 15 03:05:45 user nova-compute[75391]:     </serial>
Nov 15 03:05:45 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 03:05:45 user nova-compute[75391]:     <video>
Nov 15 03:05:45 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:05:45 user nova-compute[75391]:     </video>
Nov 15 03:05:45 user nova-compute[75391]:     <rng model="virtio">
Nov 15 03:05:45 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 03:05:45 user nova-compute[75391]:     </rng>
Nov 15 03:05:45 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 03:05:45 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 03:05:45 user nova-compute[75391]:       <stats period="10"/>
Nov 15 03:05:45 user nova-compute[75391]:     </memballoon>
Nov 15 03:05:45 user nova-compute[75391]:   </devices>
Nov 15 03:05:45 user nova-compute[75391]: </domain>
Nov 15 03:05:45 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:05:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1498347742',display_name='tempest-VolumesNegativeTest-instance-1498347742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1498347742',id=42,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2264d628dfc40399e0cc9910bbce7eb',ramdisk_id='',reservation_id='r-75fagag4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1949875658',owner_user_name='tempest-VolumesNegativeTest-1949875658-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:05:43Z,user_data=None,user_id='2e4e7ed8ff044dbabcb7badf0dbb79fe',uuid=ef297753-f6fa-4db7-b866-bfeee166696e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57c4062f-008d-4c26-b6fe-6b9acaaa3c2c", "address": "fa:16:3e:0c:a3:58", "network": {"id": "1dbbad64-77f5-47da-9da5-d219ac9e5166", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "94d41b4ea2134098830087c7a9bd0c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57c4062f-00", "ovs_interfaceid": "57c4062f-008d-4c26-b6fe-6b9acaaa3c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Converting VIF {"id": "57c4062f-008d-4c26-b6fe-6b9acaaa3c2c", "address": "fa:16:3e:0c:a3:58", "network": {"id": "1dbbad64-77f5-47da-9da5-d219ac9e5166", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "94d41b4ea2134098830087c7a9bd0c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57c4062f-00", "ovs_interfaceid": "57c4062f-008d-4c26-b6fe-6b9acaaa3c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:a3:58,bridge_name='br-int',has_traffic_filtering=True,id=57c4062f-008d-4c26-b6fe-6b9acaaa3c2c,network=Network(1dbbad64-77f5-47da-9da5-d219ac9e5166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57c4062f-00') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG os_vif [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:a3:58,bridge_name='br-int',has_traffic_filtering=True,id=57c4062f-008d-4c26-b6fe-6b9acaaa3c2c,network=Network(1dbbad64-77f5-47da-9da5-d219ac9e5166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57c4062f-00') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f78cb2f-1d0f-539c-b4db-6b5c8770b4b9', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57c4062f-00, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57c4062f-00, col_values=(('qos', UUID('0aed72d3-26bd-44cb-a4b5-f91ef3acf739')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57c4062f-00, col_values=(('external_ids', {'iface-id': '57c4062f-008d-4c26-b6fe-6b9acaaa3c2c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:a3:58', 'vm-uuid': 'ef297753-f6fa-4db7-b866-bfeee166696e'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:45 user nova-compute[75391]: INFO os_vif [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:a3:58,bridge_name='br-int',has_traffic_filtering=True,id=57c4062f-008d-4c26-b6fe-6b9acaaa3c2c,network=Network(1dbbad64-77f5-47da-9da5-d219ac9e5166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57c4062f-00')
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] No VIF found with MAC fa:16:3e:0c:a3:58, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.network.neutron [req-e1429d0e-6f46-4772-90fe-29fdbbfc81db req-94e12d63-0035-40ce-b03e-4f67d04015a4 service nova] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Updated VIF entry in instance network info cache for port 57c4062f-008d-4c26-b6fe-6b9acaaa3c2c. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG nova.network.neutron [req-e1429d0e-6f46-4772-90fe-29fdbbfc81db req-94e12d63-0035-40ce-b03e-4f67d04015a4 service nova] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Updating instance_info_cache with network_info: [{"id": "57c4062f-008d-4c26-b6fe-6b9acaaa3c2c", "address": "fa:16:3e:0c:a3:58", "network": {"id": "1dbbad64-77f5-47da-9da5-d219ac9e5166", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "94d41b4ea2134098830087c7a9bd0c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57c4062f-00", "ovs_interfaceid": "57c4062f-008d-4c26-b6fe-6b9acaaa3c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:05:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e1429d0e-6f46-4772-90fe-29fdbbfc81db req-94e12d63-0035-40ce-b03e-4f67d04015a4 service nova] Releasing lock "refresh_cache-ef297753-f6fa-4db7-b866-bfeee166696e" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:05:46 user nova-compute[75391]: DEBUG nova.objects.instance [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lazy-loading 'flavor' on Instance uuid cadf93c5-d57c-4dfa-a3c6-6c1606049636 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:05:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5bd95324-14f9-4da4-9383-e4b7f18f3b1e tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.951s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:05:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:47 user nova-compute[75391]: DEBUG nova.compute.manager [req-c2166932-69c8-476b-abbb-60e3845d8f37 req-77ad2b8f-9269-4691-a300-c1d66c804aa5 service nova] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Received event network-vif-plugged-57c4062f-008d-4c26-b6fe-6b9acaaa3c2c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:05:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c2166932-69c8-476b-abbb-60e3845d8f37 req-77ad2b8f-9269-4691-a300-c1d66c804aa5 service nova] Acquiring lock "ef297753-f6fa-4db7-b866-bfeee166696e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:05:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c2166932-69c8-476b-abbb-60e3845d8f37 req-77ad2b8f-9269-4691-a300-c1d66c804aa5 service nova] Lock "ef297753-f6fa-4db7-b866-bfeee166696e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:05:47 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c2166932-69c8-476b-abbb-60e3845d8f37 req-77ad2b8f-9269-4691-a300-c1d66c804aa5 service nova] Lock "ef297753-f6fa-4db7-b866-bfeee166696e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:05:47 user nova-compute[75391]: DEBUG nova.compute.manager [req-c2166932-69c8-476b-abbb-60e3845d8f37 req-77ad2b8f-9269-4691-a300-c1d66c804aa5 service nova] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] No waiting events found dispatching network-vif-plugged-57c4062f-008d-4c26-b6fe-6b9acaaa3c2c {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:05:47 user nova-compute[75391]: WARNING nova.compute.manager [req-c2166932-69c8-476b-abbb-60e3845d8f37 req-77ad2b8f-9269-4691-a300-c1d66c804aa5 service nova] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Received unexpected event network-vif-plugged-57c4062f-008d-4c26-b6fe-6b9acaaa3c2c for instance with vm_state building and task_state spawning.
Nov 15 03:05:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:49 user nova-compute[75391]: DEBUG nova.compute.manager [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 03:05:49 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 03:05:49 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Instance spawned successfully.
Nov 15 03:05:49 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 03:05:49 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:05:49 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:05:49 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:05:49 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:05:49 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:05:49 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:05:49 user nova-compute[75391]: INFO nova.compute.manager [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Took 6.27 seconds to spawn the instance on the hypervisor.
Nov 15 03:05:49 user nova-compute[75391]: DEBUG nova.compute.manager [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 03:05:49 user nova-compute[75391]: DEBUG nova.compute.manager [req-8c53340b-cb51-4c2b-8155-f728e5420dde req-8393b57c-491b-492c-b20e-58121e427c8d service nova] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Received event network-vif-plugged-57c4062f-008d-4c26-b6fe-6b9acaaa3c2c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:05:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8c53340b-cb51-4c2b-8155-f728e5420dde req-8393b57c-491b-492c-b20e-58121e427c8d service nova] Acquiring lock "ef297753-f6fa-4db7-b866-bfeee166696e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:05:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8c53340b-cb51-4c2b-8155-f728e5420dde req-8393b57c-491b-492c-b20e-58121e427c8d service nova] Lock "ef297753-f6fa-4db7-b866-bfeee166696e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:05:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8c53340b-cb51-4c2b-8155-f728e5420dde req-8393b57c-491b-492c-b20e-58121e427c8d service nova] Lock "ef297753-f6fa-4db7-b866-bfeee166696e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:05:49 user nova-compute[75391]: DEBUG nova.compute.manager [req-8c53340b-cb51-4c2b-8155-f728e5420dde req-8393b57c-491b-492c-b20e-58121e427c8d service nova] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] No waiting events found dispatching network-vif-plugged-57c4062f-008d-4c26-b6fe-6b9acaaa3c2c {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:05:49 user nova-compute[75391]: WARNING nova.compute.manager [req-8c53340b-cb51-4c2b-8155-f728e5420dde req-8393b57c-491b-492c-b20e-58121e427c8d service nova] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Received unexpected event network-vif-plugged-57c4062f-008d-4c26-b6fe-6b9acaaa3c2c for instance with vm_state building and task_state spawning.
Nov 15 03:05:49 user nova-compute[75391]: INFO nova.compute.manager [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Took 6.90 seconds to build instance.
Nov 15 03:05:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-bce44f82-9bd8-45b4-bd8b-116726285178 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Lock "ef297753-f6fa-4db7-b866-bfeee166696e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.987s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:05:50 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:05:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:00 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:06:00 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:06:00 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:06:00 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 03:06:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-9909ae6b-7900-4f71-8900-2bf25185e436" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:06:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-9909ae6b-7900-4f71-8900-2bf25185e436" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:06:00 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:06:00 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lazy-loading 'info_cache' on Instance uuid 9909ae6b-7900-4f71-8900-2bf25185e436 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:06:01 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Updating instance_info_cache with network_info: [{"id": "45919066-22c9-4df6-b411-e07851e743b6", "address": "fa:16:3e:86:62:a8", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45919066-22", "ovs_interfaceid": "45919066-22c9-4df6-b411-e07851e743b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:06:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-9909ae6b-7900-4f71-8900-2bf25185e436" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:06:01 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:06:01 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:06:02 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:06:03 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:06:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:06 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:06:06 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:06:06 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:06:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:06:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:06:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:06:06 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:06:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef297753-f6fa-4db7-b866-bfeee166696e/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef297753-f6fa-4db7-b866-bfeee166696e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef297753-f6fa-4db7-b866-bfeee166696e/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef297753-f6fa-4db7-b866-bfeee166696e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:09 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:06:09 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:06:09 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8397MB free_disk=24.94241714477539GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:06:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:06:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:06:09 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9909ae6b-7900-4f71-8900-2bf25185e436 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:06:09 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 7bd332f2-0f74-4a43-96a2-2322b6cbf982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:06:09 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance cadf93c5-d57c-4dfa-a3c6-6c1606049636 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:06:09 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance bf7a7308-36a6-4a34-bde5-bacd29a77101 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:06:09 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance ef297753-f6fa-4db7-b866-bfeee166696e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:06:09 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:06:09 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:06:09 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:06:09 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:06:09 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:06:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.327s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:06:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:10 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:06:10 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:06:10 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:06:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Acquiring lock "bf7a7308-36a6-4a34-bde5-bacd29a77101" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:06:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:06:12 user nova-compute[75391]: DEBUG nova.objects.instance [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lazy-loading 'flavor' on Instance uuid bf7a7308-36a6-4a34-bde5-bacd29a77101 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:06:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:06:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Acquiring lock "bf7a7308-36a6-4a34-bde5-bacd29a77101" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:06:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:06:12 user nova-compute[75391]: INFO nova.compute.manager [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Attaching volume cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 to /dev/vdb
Nov 15 03:06:12 user nova-compute[75391]: DEBUG os_brick.utils [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:06:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:12 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefd0977-69dc-4673-bd77-860f3dc9023d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:06:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:12 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a066dfc6-a42b-4228-b15a-f500a574f1a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:06:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:12 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6593e9e6-847b-4ea5-8132-9c7187266319]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:06:12 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9857b27b-6c4f-48e8-a2b9-224175fd2f01]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:06:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:06:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 03:06:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:06:12 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 03:06:12 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7555e8a1-31f5-4873-86d8-7ebe8ca2d5d6]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:06:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 03:06:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 03:06:12 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 03:06:12 user nova-compute[75391]: DEBUG os_brick.utils [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:06:12 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Updating existing volume attachment record: 044324fe-9979-455d-bb67-4ce56a124c04 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 03:06:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-80346ece-8fed-4b64-96a9-7314538002fc tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:06:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-80346ece-8fed-4b64-96a9-7314538002fc tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:06:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-80346ece-8fed-4b64-96a9-7314538002fc tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:06:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-80346ece-8fed-4b64-96a9-7314538002fc tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:06:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-80346ece-8fed-4b64-96a9-7314538002fc tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:06:14 user nova-compute[75391]: INFO nova.compute.manager [None req-80346ece-8fed-4b64-96a9-7314538002fc tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Terminating instance
Nov 15 03:06:14 user nova-compute[75391]: DEBUG nova.compute.manager [None req-80346ece-8fed-4b64-96a9-7314538002fc tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 03:06:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:15 user nova-compute[75391]: DEBUG nova.compute.manager [req-1d0ce50e-b2ef-4328-b8fb-f01e879ac9ad req-99f64c36-c51b-4605-8192-8efb1c26618a service nova] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Received event network-vif-unplugged-036afc83-072c-46b1-99cb-32b6f2c13116 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:06:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1d0ce50e-b2ef-4328-b8fb-f01e879ac9ad req-99f64c36-c51b-4605-8192-8efb1c26618a service nova] Acquiring lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:06:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1d0ce50e-b2ef-4328-b8fb-f01e879ac9ad req-99f64c36-c51b-4605-8192-8efb1c26618a service nova] Lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:06:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1d0ce50e-b2ef-4328-b8fb-f01e879ac9ad req-99f64c36-c51b-4605-8192-8efb1c26618a service nova] Lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:06:15 user nova-compute[75391]: DEBUG nova.compute.manager [req-1d0ce50e-b2ef-4328-b8fb-f01e879ac9ad req-99f64c36-c51b-4605-8192-8efb1c26618a service nova] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] No waiting events found dispatching network-vif-unplugged-036afc83-072c-46b1-99cb-32b6f2c13116 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:06:15 user nova-compute[75391]: DEBUG nova.compute.manager [req-1d0ce50e-b2ef-4328-b8fb-f01e879ac9ad req-99f64c36-c51b-4605-8192-8efb1c26618a service nova] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Received event network-vif-unplugged-036afc83-072c-46b1-99cb-32b6f2c13116 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 03:06:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:15 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Instance destroyed successfully.
Nov 15 03:06:15 user nova-compute[75391]: DEBUG nova.objects.instance [None req-80346ece-8fed-4b64-96a9-7314538002fc tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lazy-loading 'resources' on Instance uuid cadf93c5-d57c-4dfa-a3c6-6c1606049636 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:06:15 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-80346ece-8fed-4b64-96a9-7314538002fc tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-252680332',display_name='tempest-AttachVolumeNegativeTest-server-252680332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-252680332',id=38,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyA1KGmQqqfACIAcNTk2m7DanMOx/n/v5oIX0fCEcxACGGfop3mLmkV/o60yuGNocC94ci4fJLbQz1p8ufd6WXTP/s0lSwjiDiHagWApIdZ7pfR8SvBUs0xm5Wki4j3Aw==',key_name='tempest-keypair-1702890038',keypairs=<?>,launch_index=0,launched_at=2023-11-15T03:00:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c00f50c42754cea86c68e3e668c0180',ramdisk_id='',reservation_id='r-pb0urvz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-941502312',owner_user_name='tempest-AttachVolumeNegativeTest-941502312-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T03:00:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970046cb64de4109bb299f75172b7dd7',uuid=cadf93c5-d57c-4dfa-a3c6-6c1606049636,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "036afc83-072c-46b1-99cb-32b6f2c13116", "address": "fa:16:3e:a6:30:ec", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap036afc83-07", "ovs_interfaceid": "036afc83-072c-46b1-99cb-32b6f2c13116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 03:06:15 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-80346ece-8fed-4b64-96a9-7314538002fc tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Converting VIF {"id": "036afc83-072c-46b1-99cb-32b6f2c13116", "address": "fa:16:3e:a6:30:ec", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap036afc83-07", "ovs_interfaceid": "036afc83-072c-46b1-99cb-32b6f2c13116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:06:15 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-80346ece-8fed-4b64-96a9-7314538002fc tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:30:ec,bridge_name='br-int',has_traffic_filtering=True,id=036afc83-072c-46b1-99cb-32b6f2c13116,network=Network(2109b776-effc-4ec7-ac51-d0408f119253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap036afc83-07') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:06:15 user nova-compute[75391]: DEBUG os_vif [None req-80346ece-8fed-4b64-96a9-7314538002fc tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:30:ec,bridge_name='br-int',has_traffic_filtering=True,id=036afc83-072c-46b1-99cb-32b6f2c13116,network=Network(2109b776-effc-4ec7-ac51-d0408f119253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap036afc83-07') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 03:06:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap036afc83-07, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:06:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:06:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=44fd52c8-d53c-4caf-9aab-8ffcd8e4765a) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:06:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:06:15 user nova-compute[75391]: INFO os_vif [None req-80346ece-8fed-4b64-96a9-7314538002fc tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:30:ec,bridge_name='br-int',has_traffic_filtering=True,id=036afc83-072c-46b1-99cb-32b6f2c13116,network=Network(2109b776-effc-4ec7-ac51-d0408f119253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap036afc83-07')
Nov 15 03:06:15 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-80346ece-8fed-4b64-96a9-7314538002fc tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Deleting instance files /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636_del
Nov 15 03:06:15 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-80346ece-8fed-4b64-96a9-7314538002fc tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Deletion of /opt/stack/data/nova/instances/cadf93c5-d57c-4dfa-a3c6-6c1606049636_del complete
Nov 15 03:06:15 user nova-compute[75391]: INFO nova.compute.manager [None req-80346ece-8fed-4b64-96a9-7314538002fc tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 03:06:15 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-80346ece-8fed-4b64-96a9-7314538002fc tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 03:06:15 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 03:06:15 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 03:06:16 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:06:16 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Took 0.79 seconds to deallocate network for instance.
Nov 15 03:06:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-80346ece-8fed-4b64-96a9-7314538002fc tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:06:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-80346ece-8fed-4b64-96a9-7314538002fc tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:06:16 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-80346ece-8fed-4b64-96a9-7314538002fc tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:06:16 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-80346ece-8fed-4b64-96a9-7314538002fc tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:06:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-80346ece-8fed-4b64-96a9-7314538002fc tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.227s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:06:16 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-80346ece-8fed-4b64-96a9-7314538002fc tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Deleted allocations for instance cadf93c5-d57c-4dfa-a3c6-6c1606049636
Nov 15 03:06:16 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 03:06:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IeVBgqNx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:06:16 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:06:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:06:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:06:16 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:06:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:06:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:06:16 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 03:06:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-80346ece-8fed-4b64-96a9-7314538002fc tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.048s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:06:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:16 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cbf364-96c4-42e0-8f59-3afe07631e2c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:06:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 03:06:16 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:06:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:16 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab08562-20c9-4d02-ba42-73e77fcbf4b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:06:16 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6] added
Nov 15 03:06:16 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:06:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb03174b-5fae-4638-b350-86a9b7de8556]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60f8265-6673-4883-8724-27454b7c7e80]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IeVBgqNx {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IeVBgqNx" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a91be7-0469-4762-a354-fc63f1c8a931]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IeVBgqNx'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6741ce0b-5381-4215-a81c-b19dc8f4a8d9]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83d3dc7-c946-4cb5-8a0d-de5439b07bf3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 03:06:17 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 03:06:17 user nova-compute[75391]:  {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:06:17 user nova-compute[75391]: WARNING os_brick.initiator.connectors.iscsi [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 03:06:17 user nova-compute[75391]: 
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a2b6a7-625c-438a-900f-be1b2ce754fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6, portal: 172.16.0.220,3260]
Nov 15 03:06:17 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6, portal: 172.16.0.220,3260] successful.
Nov 15 03:06:17 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08798e5-f37e-4c90-8203-4d6cf9881bb2]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5753162-2e6d-4f5f-86de-cd1bc68093b7]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 (non-flash)
Nov 15 03:06:17 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 (non-flash)
Nov 15 03:06:17 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b76d0d6-919e-454d-9cff-7915e7055075]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IeVBgqNx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG nova.compute.manager [req-3754f794-145f-47c2-b5f3-b48a4277e418 req-6c6807df-1991-4d64-8e73-4d89f261348a service nova] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Received event network-vif-plugged-036afc83-072c-46b1-99cb-32b6f2c13116 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3754f794-145f-47c2-b5f3-b48a4277e418 req-6c6807df-1991-4d64-8e73-4d89f261348a service nova] Acquiring lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3754f794-145f-47c2-b5f3-b48a4277e418 req-6c6807df-1991-4d64-8e73-4d89f261348a service nova] Lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3754f794-145f-47c2-b5f3-b48a4277e418 req-6c6807df-1991-4d64-8e73-4d89f261348a service nova] Lock "cadf93c5-d57c-4dfa-a3c6-6c1606049636-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:06:17 user nova-compute[75391]: DEBUG nova.compute.manager [req-3754f794-145f-47c2-b5f3-b48a4277e418 req-6c6807df-1991-4d64-8e73-4d89f261348a service nova] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] No waiting events found dispatching network-vif-plugged-036afc83-072c-46b1-99cb-32b6f2c13116 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:06:17 user nova-compute[75391]: WARNING nova.compute.manager [req-3754f794-145f-47c2-b5f3-b48a4277e418 req-6c6807df-1991-4d64-8e73-4d89f261348a service nova] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Received unexpected event network-vif-plugged-036afc83-072c-46b1-99cb-32b6f2c13116 for instance with vm_state deleted and task_state None.
Nov 15 03:06:17 user nova-compute[75391]: DEBUG nova.compute.manager [req-3754f794-145f-47c2-b5f3-b48a4277e418 req-6c6807df-1991-4d64-8e73-4d89f261348a service nova] [instance: cadf93c5-d57c-4dfa-a3c6-6c1606049636] Received event network-vif-deleted-036afc83-072c-46b1-99cb-32b6f2c13116 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:06:18 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:06:18 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23836366438313661', 'path': '/dev/sdb'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:06:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836366438313661', 'path': '/dev/sdb'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 03:06:18 user nova-compute[75391]: DEBUG nova.objects.instance [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lazy-loading 'flavor' on Instance uuid bf7a7308-36a6-4a34-bde5-bacd29a77101 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:06:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 03:06:18 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:06:18 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 03:06:18 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 03:06:18 user nova-compute[75391]:   <serial>cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6</serial>
Nov 15 03:06:18 user nova-compute[75391]: </disk>
Nov 15 03:06:18 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 03:06:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:06:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:06:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] No VIF found with MAC fa:16:3e:98:e2:5a, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 03:06:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0eeb4651-abe6-4ae0-a770-2f4bb2b38ce5 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.434s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:06:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:19 user nova-compute[75391]: INFO nova.compute.manager [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Rescuing
Nov 15 03:06:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Acquiring lock "refresh_cache-bf7a7308-36a6-4a34-bde5-bacd29a77101" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:06:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Acquired lock "refresh_cache-bf7a7308-36a6-4a34-bde5-bacd29a77101" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:06:19 user nova-compute[75391]: DEBUG nova.network.neutron [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 03:06:19 user nova-compute[75391]: DEBUG nova.network.neutron [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Updating instance_info_cache with network_info: [{"id": "53ee1144-b72a-431c-9e42-7efd212177b3", "address": "fa:16:3e:98:e2:5a", "network": {"id": "434e7c61-37f4-4a23-be35-6cc6f9842cad", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1311932462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a64dab12ce74d18b3d9414595910180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee1144-b7", "ovs_interfaceid": "53ee1144-b72a-431c-9e42-7efd212177b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:06:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Releasing lock "refresh_cache-bf7a7308-36a6-4a34-bde5-bacd29a77101" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:06:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:20 user nova-compute[75391]: DEBUG nova.compute.manager [req-6ac7bb62-3290-46b5-9628-a70a84641f21 req-cba64427-3afb-4ba7-a02f-02d2502fb9c3 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received event network-vif-unplugged-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:06:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6ac7bb62-3290-46b5-9628-a70a84641f21 req-cba64427-3afb-4ba7-a02f-02d2502fb9c3 service nova] Acquiring lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:06:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6ac7bb62-3290-46b5-9628-a70a84641f21 req-cba64427-3afb-4ba7-a02f-02d2502fb9c3 service nova] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:06:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6ac7bb62-3290-46b5-9628-a70a84641f21 req-cba64427-3afb-4ba7-a02f-02d2502fb9c3 service nova] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:06:20 user nova-compute[75391]: DEBUG nova.compute.manager [req-6ac7bb62-3290-46b5-9628-a70a84641f21 req-cba64427-3afb-4ba7-a02f-02d2502fb9c3 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] No waiting events found dispatching network-vif-unplugged-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:06:20 user nova-compute[75391]: WARNING nova.compute.manager [req-6ac7bb62-3290-46b5-9628-a70a84641f21 req-cba64427-3afb-4ba7-a02f-02d2502fb9c3 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received unexpected event network-vif-unplugged-53ee1144-b72a-431c-9e42-7efd212177b3 for instance with vm_state active and task_state rescuing.
Nov 15 03:06:20 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Instance destroyed successfully.
Nov 15 03:06:20 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Attempting a stable device rescue
Nov 15 03:06:20 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75391) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 03:06:20 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Instance directory exists: not creating {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 03:06:20 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Creating image(s)
Nov 15 03:06:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:06:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "/opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:06:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "/opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:06:20 user nova-compute[75391]: DEBUG nova.objects.instance [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lazy-loading 'trusted_certs' on Instance uuid bf7a7308-36a6-4a34-bde5-bacd29a77101 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:06:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Acquiring lock "619ea27fe4302fc35ff86456fb3dfd1eeb6d7c68" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:06:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "619ea27fe4302fc35ff86456fb3dfd1eeb6d7c68" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:06:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/619ea27fe4302fc35ff86456fb3dfd1eeb6d7c68.part --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/619ea27fe4302fc35ff86456fb3dfd1eeb6d7c68.part --force-share --output=json" returned: 0 in 0.178s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:21 user nova-compute[75391]: DEBUG nova.virt.images [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] 7437a59d-c14a-4c10-8d71-6c52fc5facee was qcow2, converting to raw {{(pid=75391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 03:06:21 user nova-compute[75391]: DEBUG nova.privsep.utils [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 03:06:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/619ea27fe4302fc35ff86456fb3dfd1eeb6d7c68.part /opt/stack/data/nova/instances/_base/619ea27fe4302fc35ff86456fb3dfd1eeb6d7c68.converted {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:22 user nova-compute[75391]: DEBUG nova.compute.manager [req-01c72207-e0de-45cb-b5ed-bd6085068f80 req-439c2e95-9d33-44a2-9763-5f76f3494981 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received event network-vif-plugged-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:06:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-01c72207-e0de-45cb-b5ed-bd6085068f80 req-439c2e95-9d33-44a2-9763-5f76f3494981 service nova] Acquiring lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:06:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-01c72207-e0de-45cb-b5ed-bd6085068f80 req-439c2e95-9d33-44a2-9763-5f76f3494981 service nova] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:06:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-01c72207-e0de-45cb-b5ed-bd6085068f80 req-439c2e95-9d33-44a2-9763-5f76f3494981 service nova] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:06:22 user nova-compute[75391]: DEBUG nova.compute.manager [req-01c72207-e0de-45cb-b5ed-bd6085068f80 req-439c2e95-9d33-44a2-9763-5f76f3494981 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] No waiting events found dispatching network-vif-plugged-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:06:22 user nova-compute[75391]: WARNING nova.compute.manager [req-01c72207-e0de-45cb-b5ed-bd6085068f80 req-439c2e95-9d33-44a2-9763-5f76f3494981 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received unexpected event network-vif-plugged-53ee1144-b72a-431c-9e42-7efd212177b3 for instance with vm_state active and task_state rescuing.
Nov 15 03:06:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/619ea27fe4302fc35ff86456fb3dfd1eeb6d7c68.part /opt/stack/data/nova/instances/_base/619ea27fe4302fc35ff86456fb3dfd1eeb6d7c68.converted" returned: 0 in 0.614s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/619ea27fe4302fc35ff86456fb3dfd1eeb6d7c68.converted --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/619ea27fe4302fc35ff86456fb3dfd1eeb6d7c68.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "619ea27fe4302fc35ff86456fb3dfd1eeb6d7c68" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.142s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:06:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Acquiring lock "619ea27fe4302fc35ff86456fb3dfd1eeb6d7c68" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:06:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "619ea27fe4302fc35ff86456fb3dfd1eeb6d7c68" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:06:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/619ea27fe4302fc35ff86456fb3dfd1eeb6d7c68 --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/619ea27fe4302fc35ff86456fb3dfd1eeb6d7c68 --force-share --output=json" returned: 0 in 0.185s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/619ea27fe4302fc35ff86456fb3dfd1eeb6d7c68,backing_fmt=raw /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk.rescue {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/619ea27fe4302fc35ff86456fb3dfd1eeb6d7c68,backing_fmt=raw /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk.rescue" returned: 0 in 0.055s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "619ea27fe4302fc35ff86456fb3dfd1eeb6d7c68" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.objects.instance [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lazy-loading 'migration_context' on Instance uuid bf7a7308-36a6-4a34-bde5-bacd29a77101 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.objects.base [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Object Instance<bf7a7308-36a6-4a34-bde5-bacd29a77101> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Start _get_guest_xml network_info=[{"id": "53ee1144-b72a-431c-9e42-7efd212177b3", "address": "fa:16:3e:98:e2:5a", "network": {"id": "434e7c61-37f4-4a23-be35-6cc6f9842cad", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1311932462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1311932462-network", "vif_mac": "fa:16:3e:98:e2:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a64dab12ce74d18b3d9414595910180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee1144-b7", "ovs_interfaceid": "53ee1144-b72a-431c-9e42-7efd212177b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7437a59d-c14a-4c10-8d71-6c52fc5facee', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '044324fe-9979-455d-bb67-4ce56a124c04', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IeVBgqNx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'bf7a7308-36a6-4a34-bde5-bacd29a77101', 'attached_at': '', 'detached_at': '', 'volume_id': 'cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6', 'serial': 'cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6'}, 'volume_type': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.objects.instance [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lazy-loading 'resources' on Instance uuid bf7a7308-36a6-4a34-bde5-bacd29a77101 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.objects.base [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Object Instance<bf7a7308-36a6-4a34-bde5-bacd29a77101> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.objects.instance [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lazy-loading 'numa_topology' on Instance uuid bf7a7308-36a6-4a34-bde5-bacd29a77101 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.objects.base [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Object Instance<bf7a7308-36a6-4a34-bde5-bacd29a77101> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 03:06:23 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:06:23 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.objects.instance [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lazy-loading 'vcpu_model' on Instance uuid bf7a7308-36a6-4a34-bde5-bacd29a77101 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.objects.base [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Object Instance<bf7a7308-36a6-4a34-bde5-bacd29a77101> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IeVBgqNx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:06:23 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:06:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:06:23 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:06:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:06:23 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 03:06:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[783be957-0554-4434-9348-3095554e6e99]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = IeVBgqNx\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 03:06:23 user nova-compute[75391]: node.name = iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6
Nov 15 03:06:23 user nova-compute[75391]: node.tpgt = -1
Nov 15 03:06:23 user nova-compute[75391]: node.startup = automatic
Nov 15 03:06:23 user nova-compute[75391]: node.leading_login = No
Nov 15 03:06:23 user nova-compute[75391]: iface.iscsi_ifacename = default
Nov 15 03:06:23 user nova-compute[75391]: iface.net_ifacename = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.ipaddress = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.prefix_len = 0
Nov 15 03:06:23 user nova-compute[75391]: iface.hwaddress = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.transport_name = tcp
Nov 15 03:06:23 user nova-compute[75391]: iface.initiatorname = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.state = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.vlan_id = 0
Nov 15 03:06:23 user nova-compute[75391]: iface.vlan_priority = 0
Nov 15 03:06:23 user nova-compute[75391]: iface.vlan_state = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.iface_num = 0
Nov 15 03:06:23 user nova-compute[75391]: iface.mtu = 0
Nov 15 03:06:23 user nova-compute[75391]: iface.port = 0
Nov 15 03:06:23 user nova-compute[75391]: iface.bootproto = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.subnet_mask = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.gateway = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.dhcp_alt_client_id = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.dhcp_dns = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.dhcp_learn_iqn = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.dhcp_vendor_id_state = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.dhcp_vendor_id = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.dhcp_slp_da = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.fragmentation = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.gratuitous_arp = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.incoming_forwarding = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.tos_state = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.tos = 0
Nov 15 03:06:23 user nova-compute[75391]: iface.ttl = 0
Nov 15 03:06:23 user nova-compute[75391]: iface.delayed_ack = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.tcp_nagle = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.tcp_wsf_state = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.tcp_wsf = 0
Nov 15 03:06:23 user nova-compute[75391]: iface.tcp_timer_scale = 0
Nov 15 03:06:23 user nova-compute[75391]: iface.tcp_timestamp = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.redirect = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.def_task_mgmt_timeout = 0
Nov 15 03:06:23 user nova-compute[75391]: iface.header_digest = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.data_digest = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.immediate_data = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.initial_r2t = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.data_seq_inorder = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.data_pdu_inorder = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.erl = 0
Nov 15 03:06:23 user nova-compute[75391]: iface.max_receive_data_len = 0
Nov 15 03:06:23 user nova-compute[75391]: iface.first_burst_len = 0
Nov 15 03:06:23 user nova-compute[75391]: iface.max_outstanding_r2t = 0
Nov 15 03:06:23 user nova-compute[75391]: iface.max_burst_len = 0
Nov 15 03:06:23 user nova-compute[75391]: iface.chap_auth = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.bidi_chap = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.strict_login_compliance = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.discovery_auth = <empty>
Nov 15 03:06:23 user nova-compute[75391]: iface.discovery_logout = <empty>
Nov 15 03:06:23 user nova-compute[75391]: node.discovery_address = <empty>
Nov 15 03:06:23 user nova-compute[75391]: node.discovery_port = 0
Nov 15 03:06:23 user nova-compute[75391]: node.discovery_type = static
Nov 15 03:06:23 user nova-compute[75391]: node.session.initial_cmdsn = 0
Nov 15 03:06:23 user nova-compute[75391]: node.session.initial_login_retry_max = 8
Nov 15 03:06:23 user nova-compute[75391]: node.session.xmit_thread_priority = -20
Nov 15 03:06:23 user nova-compute[75391]: node.session.cmds_max = 128
Nov 15 03:06:23 user nova-compute[75391]: node.session.queue_depth = 32
Nov 15 03:06:23 user nova-compute[75391]: node.session.nr_sessions = 1
Nov 15 03:06:23 user nova-compute[75391]: node.session.auth.authmethod = CHAP
Nov 15 03:06:23 user nova-compute[75391]: node.session.auth.username = IeVBgqNx
Nov 15 03:06:23 user nova-compute[75391]: node.session.auth.password = ***
Nov 15 03:06:23 user nova-compute[75391]: node.session.auth.username_in = <empty>
Nov 15 03:06:23 user nova-compute[75391]: node.session.auth.password_in = <empty>
Nov 15 03:06:23 user nova-compute[75391]: node.session.auth.chap_algs = MD5
Nov 15 03:06:23 user nova-compute[75391]: node.session.timeo.replacement_timeout = 120
Nov 15 03:06:23 user nova-compute[75391]: node.session.err_timeo.abort_timeout = 15
Nov 15 03:06:23 user nova-compute[75391]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 03:06:23 user nova-compute[75391]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 03:06:23 user nova-compute[75391]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 03:06:23 user nova-compute[75391]: node.session.iscsi.FastAbort = Yes
Nov 15 03:06:23 user nova-compute[75391]: node.session.iscsi.InitialR2T = No
Nov 15 03:06:23 user nova-compute[75391]: node.session.iscsi.ImmediateData = Yes
Nov 15 03:06:23 user nova-compute[75391]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 03:06:23 user nova-compute[75391]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 03:06:23 user nova-compute[75391]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 03:06:23 user nova-compute[75391]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 03:06:23 user nova-compute[75391]: node.session.iscsi.MaxConnections = 1
Nov 15 03:06:23 user nova-compute[75391]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 03:06:23 user nova-compute[75391]: node.session.iscsi.ERL = 0
Nov 15 03:06:23 user nova-compute[75391]: node.session.scan = manual
Nov 15 03:06:23 user nova-compute[75391]: node.session.reopen_max = 0
Nov 15 03:06:23 user nova-compute[75391]: node.conn[0].address = 172.16.0.220
Nov 15 03:06:23 user nova-compute[75391]: node.conn[0].port = 3260
Nov 15 03:06:23 user nova-compute[75391]: node.conn[0].startup = manual
Nov 15 03:06:23 user nova-compute[75391]: node.conn[0].tcp.window_size = 524288
Nov 15 03:06:23 user nova-compute[75391]: node.conn[0].tcp.type_of_service = 0
Nov 15 03:06:23 user nova-compute[75391]: node.conn[0].timeo.logout_timeout = 15
Nov 15 03:06:23 user nova-compute[75391]: node.conn[0].timeo.login_timeout = 15
Nov 15 03:06:23 user nova-compute[75391]: node.conn[0].timeo.auth_timeout = 45
Nov 15 03:06:23 user nova-compute[75391]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 03:06:23 user nova-compute[75391]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 03:06:23 user nova-compute[75391]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 03:06:23 user nova-compute[75391]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 03:06:23 user nova-compute[75391]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 03:06:23 user nova-compute[75391]: node.conn[0].iscsi.DataDigest = None
Nov 15 03:06:23 user nova-compute[75391]: node.conn[0].iscsi.IFMarker = No
Nov 15 03:06:23 user nova-compute[75391]: node.conn[0].iscsi.OFMarker = No
Nov 15 03:06:23 user nova-compute[75391]: # END RECORD
Nov 15 03:06:23 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fb5bbc-dbb5-4f23-9e39-3dc551fc2cf9]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbaf978-890e-40a7-b025-b78d7a515413]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IeVBgqNx {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IeVBgqNx" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbed656b-451c-43f7-bc13-fc842e147db7]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IeVBgqNx'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ec0fcf-537f-471f-b9e7-97cc3346ae5f]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fef99c-1325-4b8f-9958-d3351cc32d96]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 (non-flash)
Nov 15 03:06:23 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 (non-flash)
Nov 15 03:06:23 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.157s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] HCTL ('33', '0', '0', 0) found on session 53 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b056485c-e3e9-44bd-95a9-cfccd77f70a5]: (4, ('0 0 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Searching for a device in session 53 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IeVBgqNx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.184s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] <== connect_volume: return (185ms) {'type': 'block', 'scsi_wwn': '23836366438313661', 'path': '/dev/sdb'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836366438313661', 'path': '/dev/sdb'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:02:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1144670272',display_name='tempest-ServerStableDeviceRescueTest-server-1144670272',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1144670272',id=40,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMF+BI5+VcRTfw7TjGfQSa5zuNaSx3cK49go9Lazpbp+FSmkfPXXz0+tU5ZPdsXBgHoz5XxyPQPvegViPYNbaX34RcJtjgnqsfR1T88wVqzXO6jm1bMSLFqh9Q165b4ybA==',key_name='tempest-keypair-1852285092',keypairs=<?>,launch_index=0,launched_at=2023-11-15T03:02:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a64dab12ce74d18b3d9414595910180',ramdisk_id='',reservation_id='r-e107dfhn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-370419686',owner_user_name='tempest-ServerStableDeviceRescueTest-370419686-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:04:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcd0fbcb04e84312b99a82f772a17159',uuid=bf7a7308-36a6-4a34-bde5-bacd29a77101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53ee1144-b72a-431c-9e42-7efd212177b3", "address": "fa:16:3e:98:e2:5a", "network": {"id": "434e7c61-37f4-4a23-be35-6cc6f9842cad", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1311932462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1311932462-network", "vif_mac": "fa:16:3e:98:e2:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a64dab12ce74d18b3d9414595910180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee1144-b7", "ovs_interfaceid": "53ee1144-b72a-431c-9e42-7efd212177b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Converting VIF {"id": "53ee1144-b72a-431c-9e42-7efd212177b3", "address": "fa:16:3e:98:e2:5a", "network": {"id": "434e7c61-37f4-4a23-be35-6cc6f9842cad", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1311932462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1311932462-network", "vif_mac": "fa:16:3e:98:e2:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a64dab12ce74d18b3d9414595910180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee1144-b7", "ovs_interfaceid": "53ee1144-b72a-431c-9e42-7efd212177b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:e2:5a,bridge_name='br-int',has_traffic_filtering=True,id=53ee1144-b72a-431c-9e42-7efd212177b3,network=Network(434e7c61-37f4-4a23-be35-6cc6f9842cad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ee1144-b7') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.objects.instance [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lazy-loading 'pci_devices' on Instance uuid bf7a7308-36a6-4a34-bde5-bacd29a77101 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.objects.base [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Object Instance<bf7a7308-36a6-4a34-bde5-bacd29a77101> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75391) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] End _get_guest_xml xml=<domain type="kvm">
Nov 15 03:06:23 user nova-compute[75391]:   <uuid>bf7a7308-36a6-4a34-bde5-bacd29a77101</uuid>
Nov 15 03:06:23 user nova-compute[75391]:   <name>instance-00000028</name>
Nov 15 03:06:23 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 03:06:23 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 03:06:23 user nova-compute[75391]:   <metadata>
Nov 15 03:06:23 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 03:06:23 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 03:06:23 user nova-compute[75391]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1144670272</nova:name>
Nov 15 03:06:23 user nova-compute[75391]:       <nova:creationTime>2023-11-15 03:06:23</nova:creationTime>
Nov 15 03:06:23 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 03:06:23 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 03:06:23 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 03:06:23 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 03:06:23 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 03:06:23 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 03:06:23 user nova-compute[75391]:       </nova:flavor>
Nov 15 03:06:23 user nova-compute[75391]:       <nova:owner>
Nov 15 03:06:23 user nova-compute[75391]:         <nova:user uuid="bcd0fbcb04e84312b99a82f772a17159">tempest-ServerStableDeviceRescueTest-370419686-project-member</nova:user>
Nov 15 03:06:23 user nova-compute[75391]:         <nova:project uuid="2a64dab12ce74d18b3d9414595910180">tempest-ServerStableDeviceRescueTest-370419686</nova:project>
Nov 15 03:06:23 user nova-compute[75391]:       </nova:owner>
Nov 15 03:06:23 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 03:06:23 user nova-compute[75391]:       <nova:ports>
Nov 15 03:06:23 user nova-compute[75391]:         <nova:port uuid="53ee1144-b72a-431c-9e42-7efd212177b3">
Nov 15 03:06:23 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 03:06:23 user nova-compute[75391]:         </nova:port>
Nov 15 03:06:23 user nova-compute[75391]:       </nova:ports>
Nov 15 03:06:23 user nova-compute[75391]:     </nova:instance>
Nov 15 03:06:23 user nova-compute[75391]:   </metadata>
Nov 15 03:06:23 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 03:06:23 user nova-compute[75391]:     <system>
Nov 15 03:06:23 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 03:06:23 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 03:06:23 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 03:06:23 user nova-compute[75391]:       <entry name="serial">bf7a7308-36a6-4a34-bde5-bacd29a77101</entry>
Nov 15 03:06:23 user nova-compute[75391]:       <entry name="uuid">bf7a7308-36a6-4a34-bde5-bacd29a77101</entry>
Nov 15 03:06:23 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 03:06:23 user nova-compute[75391]:     </system>
Nov 15 03:06:23 user nova-compute[75391]:   </sysinfo>
Nov 15 03:06:23 user nova-compute[75391]:   <os>
Nov 15 03:06:23 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 03:06:23 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 03:06:23 user nova-compute[75391]:   </os>
Nov 15 03:06:23 user nova-compute[75391]:   <features>
Nov 15 03:06:23 user nova-compute[75391]:     <acpi/>
Nov 15 03:06:23 user nova-compute[75391]:     <apic/>
Nov 15 03:06:23 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 03:06:23 user nova-compute[75391]:   </features>
Nov 15 03:06:23 user nova-compute[75391]:   <clock offset="utc">
Nov 15 03:06:23 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 03:06:23 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 03:06:23 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 03:06:23 user nova-compute[75391]:   </clock>
Nov 15 03:06:23 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 03:06:23 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 03:06:23 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 03:06:23 user nova-compute[75391]:   </cpu>
Nov 15 03:06:23 user nova-compute[75391]:   <devices>
Nov 15 03:06:23 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 03:06:23 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 03:06:23 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk"/>
Nov 15 03:06:23 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 03:06:23 user nova-compute[75391]:     </disk>
Nov 15 03:06:23 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 03:06:23 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:06:23 user nova-compute[75391]:       <source dev="/dev/sdb"/>
Nov 15 03:06:23 user nova-compute[75391]:       <target dev="vdb" bus="virtio"/>
Nov 15 03:06:23 user nova-compute[75391]:       <serial>cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6</serial>
Nov 15 03:06:23 user nova-compute[75391]:     </disk>
Nov 15 03:06:23 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 03:06:23 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 03:06:23 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk.rescue"/>
Nov 15 03:06:23 user nova-compute[75391]:       <target dev="vdc" bus="virtio"/>
Nov 15 03:06:23 user nova-compute[75391]:       <boot order="1"/>
Nov 15 03:06:23 user nova-compute[75391]:     </disk>
Nov 15 03:06:23 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 03:06:23 user nova-compute[75391]:       <mac address="fa:16:3e:98:e2:5a"/>
Nov 15 03:06:23 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:06:23 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 03:06:23 user nova-compute[75391]:       <target dev="tap53ee1144-b7"/>
Nov 15 03:06:23 user nova-compute[75391]:     </interface>
Nov 15 03:06:23 user nova-compute[75391]:     <serial type="pty">
Nov 15 03:06:23 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/console.log" append="off"/>
Nov 15 03:06:23 user nova-compute[75391]:     </serial>
Nov 15 03:06:23 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 03:06:23 user nova-compute[75391]:     <video>
Nov 15 03:06:23 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:06:23 user nova-compute[75391]:     </video>
Nov 15 03:06:23 user nova-compute[75391]:     <rng model="virtio">
Nov 15 03:06:23 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 03:06:23 user nova-compute[75391]:     </rng>
Nov 15 03:06:23 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 03:06:23 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 03:06:23 user nova-compute[75391]:       <stats period="10"/>
Nov 15 03:06:23 user nova-compute[75391]:     </memballoon>
Nov 15 03:06:23 user nova-compute[75391]:   </devices>
Nov 15 03:06:23 user nova-compute[75391]: </domain>
Nov 15 03:06:23 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 03:06:23 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Instance destroyed successfully.
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:06:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] No VIF found with MAC fa:16:3e:98:e2:5a, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 03:06:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:24 user nova-compute[75391]: DEBUG nova.compute.manager [req-1444586a-6dc2-4394-b6e4-63189ba80ba6 req-6615864e-71d4-4565-8e9c-3dfd0ae6f1d1 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received event network-vif-plugged-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:06:24 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1444586a-6dc2-4394-b6e4-63189ba80ba6 req-6615864e-71d4-4565-8e9c-3dfd0ae6f1d1 service nova] Acquiring lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:06:24 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1444586a-6dc2-4394-b6e4-63189ba80ba6 req-6615864e-71d4-4565-8e9c-3dfd0ae6f1d1 service nova] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:06:24 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1444586a-6dc2-4394-b6e4-63189ba80ba6 req-6615864e-71d4-4565-8e9c-3dfd0ae6f1d1 service nova] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:06:24 user nova-compute[75391]: DEBUG nova.compute.manager [req-1444586a-6dc2-4394-b6e4-63189ba80ba6 req-6615864e-71d4-4565-8e9c-3dfd0ae6f1d1 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] No waiting events found dispatching network-vif-plugged-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:06:24 user nova-compute[75391]: WARNING nova.compute.manager [req-1444586a-6dc2-4394-b6e4-63189ba80ba6 req-6615864e-71d4-4565-8e9c-3dfd0ae6f1d1 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received unexpected event network-vif-plugged-53ee1144-b72a-431c-9e42-7efd212177b3 for instance with vm_state active and task_state rescuing.
Nov 15 03:06:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-e23abf14-ce9f-47b5-9e63-c77bb9c80e8f req-8d086c97-8a48-4922-9c83-d7e377c1ca71 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received event network-vif-plugged-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:06:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e23abf14-ce9f-47b5-9e63-c77bb9c80e8f req-8d086c97-8a48-4922-9c83-d7e377c1ca71 service nova] Acquiring lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:06:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e23abf14-ce9f-47b5-9e63-c77bb9c80e8f req-8d086c97-8a48-4922-9c83-d7e377c1ca71 service nova] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:06:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e23abf14-ce9f-47b5-9e63-c77bb9c80e8f req-8d086c97-8a48-4922-9c83-d7e377c1ca71 service nova] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:06:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-e23abf14-ce9f-47b5-9e63-c77bb9c80e8f req-8d086c97-8a48-4922-9c83-d7e377c1ca71 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] No waiting events found dispatching network-vif-plugged-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:06:27 user nova-compute[75391]: WARNING nova.compute.manager [req-e23abf14-ce9f-47b5-9e63-c77bb9c80e8f req-8d086c97-8a48-4922-9c83-d7e377c1ca71 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received unexpected event network-vif-plugged-53ee1144-b72a-431c-9e42-7efd212177b3 for instance with vm_state active and task_state rescuing.
Nov 15 03:06:27 user nova-compute[75391]: DEBUG nova.compute.manager [None req-1901c1db-95cd-472c-97bb-a5912bd49868 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 03:06:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a410906c-8f1f-420b-82c3-bee8c759a67d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:06:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a410906c-8f1f-420b-82c3-bee8c759a67d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:06:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a410906c-8f1f-420b-82c3-bee8c759a67d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:06:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a410906c-8f1f-420b-82c3-bee8c759a67d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:06:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a410906c-8f1f-420b-82c3-bee8c759a67d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:06:27 user nova-compute[75391]: INFO nova.compute.manager [None req-a410906c-8f1f-420b-82c3-bee8c759a67d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Terminating instance
Nov 15 03:06:27 user nova-compute[75391]: DEBUG nova.compute.manager [None req-a410906c-8f1f-420b-82c3-bee8c759a67d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 03:06:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-da30de01-11ad-461e-898e-6e579238aa46 req-fea40fd0-5fa9-430b-938a-06903c2724ce service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Received event network-vif-unplugged-5ef68714-0fbe-470d-b208-7d482f023640 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:06:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-da30de01-11ad-461e-898e-6e579238aa46 req-fea40fd0-5fa9-430b-938a-06903c2724ce service nova] Acquiring lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:06:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-da30de01-11ad-461e-898e-6e579238aa46 req-fea40fd0-5fa9-430b-938a-06903c2724ce service nova] Lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:06:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-da30de01-11ad-461e-898e-6e579238aa46 req-fea40fd0-5fa9-430b-938a-06903c2724ce service nova] Lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:06:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-da30de01-11ad-461e-898e-6e579238aa46 req-fea40fd0-5fa9-430b-938a-06903c2724ce service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] No waiting events found dispatching network-vif-unplugged-5ef68714-0fbe-470d-b208-7d482f023640 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:06:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-da30de01-11ad-461e-898e-6e579238aa46 req-fea40fd0-5fa9-430b-938a-06903c2724ce service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Received event network-vif-unplugged-5ef68714-0fbe-470d-b208-7d482f023640 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 03:06:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:28 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Instance destroyed successfully.
Nov 15 03:06:28 user nova-compute[75391]: DEBUG nova.objects.instance [None req-a410906c-8f1f-420b-82c3-bee8c759a67d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'resources' on Instance uuid 7bd332f2-0f74-4a43-96a2-2322b6cbf982 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:06:28 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-a410906c-8f1f-420b-82c3-bee8c759a67d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-411570943',display_name='tempest-ServerRescueNegativeTestJSON-server-411570943',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-411570943',id=27,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:52:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8bfe79a4e16f4fa89437bcc50fc4b356',ramdisk_id='',reservation_id='r-9ge07iwt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-388649299',owner_user_name='tempest-ServerRescueNegativeTestJSON-388649299-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:52:22Z,user_data=None,user_id='9b3fc7a83f6c4c5baa7621163e9f62aa',uuid=7bd332f2-0f74-4a43-96a2-2322b6cbf982,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "5ef68714-0fbe-470d-b208-7d482f023640", "address": "fa:16:3e:0f:8e:b7", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef68714-0f", "ovs_interfaceid": "5ef68714-0fbe-470d-b208-7d482f023640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 03:06:28 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-a410906c-8f1f-420b-82c3-bee8c759a67d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Converting VIF {"id": "5ef68714-0fbe-470d-b208-7d482f023640", "address": "fa:16:3e:0f:8e:b7", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef68714-0f", "ovs_interfaceid": "5ef68714-0fbe-470d-b208-7d482f023640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:06:28 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-a410906c-8f1f-420b-82c3-bee8c759a67d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:8e:b7,bridge_name='br-int',has_traffic_filtering=True,id=5ef68714-0fbe-470d-b208-7d482f023640,network=Network(079437cd-2e7d-40ea-98c0-24a1c9091aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef68714-0f') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:06:28 user nova-compute[75391]: DEBUG os_vif [None req-a410906c-8f1f-420b-82c3-bee8c759a67d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:8e:b7,bridge_name='br-int',has_traffic_filtering=True,id=5ef68714-0fbe-470d-b208-7d482f023640,network=Network(079437cd-2e7d-40ea-98c0-24a1c9091aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef68714-0f') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 03:06:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ef68714-0f, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:06:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc56f703-5027-439d-a88e-06cf9054617e) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:06:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:06:28 user nova-compute[75391]: INFO os_vif [None req-a410906c-8f1f-420b-82c3-bee8c759a67d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:8e:b7,bridge_name='br-int',has_traffic_filtering=True,id=5ef68714-0fbe-470d-b208-7d482f023640,network=Network(079437cd-2e7d-40ea-98c0-24a1c9091aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef68714-0f')
Nov 15 03:06:28 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-a410906c-8f1f-420b-82c3-bee8c759a67d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Deleting instance files /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982_del
Nov 15 03:06:28 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-a410906c-8f1f-420b-82c3-bee8c759a67d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Deletion of /opt/stack/data/nova/instances/7bd332f2-0f74-4a43-96a2-2322b6cbf982_del complete
Nov 15 03:06:28 user nova-compute[75391]: INFO nova.compute.manager [None req-a410906c-8f1f-420b-82c3-bee8c759a67d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 15 03:06:28 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-a410906c-8f1f-420b-82c3-bee8c759a67d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 03:06:28 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 03:06:28 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 03:06:28 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:06:28 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Took 0.47 seconds to deallocate network for instance.
Nov 15 03:06:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a410906c-8f1f-420b-82c3-bee8c759a67d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:06:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a410906c-8f1f-420b-82c3-bee8c759a67d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.005s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:06:28 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-a410906c-8f1f-420b-82c3-bee8c759a67d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:06:28 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-a410906c-8f1f-420b-82c3-bee8c759a67d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:06:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a410906c-8f1f-420b-82c3-bee8c759a67d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:06:28 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-a410906c-8f1f-420b-82c3-bee8c759a67d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Deleted allocations for instance 7bd332f2-0f74-4a43-96a2-2322b6cbf982
Nov 15 03:06:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-a410906c-8f1f-420b-82c3-bee8c759a67d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.541s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:06:29 user nova-compute[75391]: DEBUG nova.compute.manager [req-6f973e74-3b76-4a54-8065-8a55f1035452 req-bd42a21a-93ed-45b2-a925-5c7d02238573 service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Received event network-vif-deleted-5ef68714-0fbe-470d-b208-7d482f023640 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:06:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:29 user nova-compute[75391]: DEBUG nova.compute.manager [req-05e5837a-b7fa-4896-9b6b-8f58a4032805 req-d55d662f-a240-43e2-8c2c-7aaef152b7d6 service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Received event network-vif-plugged-5ef68714-0fbe-470d-b208-7d482f023640 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:06:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-05e5837a-b7fa-4896-9b6b-8f58a4032805 req-d55d662f-a240-43e2-8c2c-7aaef152b7d6 service nova] Acquiring lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:06:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-05e5837a-b7fa-4896-9b6b-8f58a4032805 req-d55d662f-a240-43e2-8c2c-7aaef152b7d6 service nova] Lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:06:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-05e5837a-b7fa-4896-9b6b-8f58a4032805 req-d55d662f-a240-43e2-8c2c-7aaef152b7d6 service nova] Lock "7bd332f2-0f74-4a43-96a2-2322b6cbf982-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:06:29 user nova-compute[75391]: DEBUG nova.compute.manager [req-05e5837a-b7fa-4896-9b6b-8f58a4032805 req-d55d662f-a240-43e2-8c2c-7aaef152b7d6 service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] No waiting events found dispatching network-vif-plugged-5ef68714-0fbe-470d-b208-7d482f023640 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:06:29 user nova-compute[75391]: WARNING nova.compute.manager [req-05e5837a-b7fa-4896-9b6b-8f58a4032805 req-d55d662f-a240-43e2-8c2c-7aaef152b7d6 service nova] [instance: 7bd332f2-0f74-4a43-96a2-2322b6cbf982] Received unexpected event network-vif-plugged-5ef68714-0fbe-470d-b208-7d482f023640 for instance with vm_state deleted and task_state None.
Nov 15 03:06:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:06:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:06:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:06:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:06:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:06:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:06:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:00 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:07:00 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:07:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-bf7a7308-36a6-4a34-bde5-bacd29a77101" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:07:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-bf7a7308-36a6-4a34-bde5-bacd29a77101" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:07:00 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:07:01 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Updating instance_info_cache with network_info: [{"id": "53ee1144-b72a-431c-9e42-7efd212177b3", "address": "fa:16:3e:98:e2:5a", "network": {"id": "434e7c61-37f4-4a23-be35-6cc6f9842cad", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1311932462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a64dab12ce74d18b3d9414595910180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee1144-b7", "ovs_interfaceid": "53ee1144-b72a-431c-9e42-7efd212177b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:07:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-bf7a7308-36a6-4a34-bde5-bacd29a77101" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:07:01 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:07:01 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:07:01 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:07:02 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:07:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:03 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:07:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:07 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:07:07 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:07:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:07:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:07:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:07:07 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:07:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:07:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:07:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:07:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:07:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef297753-f6fa-4db7-b866-bfeee166696e/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:07:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:07:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:07:08 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 03:07:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef297753-f6fa-4db7-b866-bfeee166696e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:07:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef297753-f6fa-4db7-b866-bfeee166696e/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:07:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:07:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:07:08 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 03:07:08 user nova-compute[75391]: INFO nova.compute.claims [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Claim successful on node user
Nov 15 03:07:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef297753-f6fa-4db7-b866-bfeee166696e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:07:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:07:08 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:07:08 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:07:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:07:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:07:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.340s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:07:08 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 03:07:08 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 03:07:08 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 03:07:08 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 03:07:08 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 03:07:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:07:08 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 03:07:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG nova.policy [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '970046cb64de4109bb299f75172b7dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c00f50c42754cea86c68e3e668c0180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 03:07:09 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Creating image(s)
Nov 15 03:07:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "/opt/stack/data/nova/instances/6036730b-2c7e-4ea9-95f2-9a40eab2fdce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "/opt/stack/data/nova/instances/6036730b-2c7e-4ea9-95f2-9a40eab2fdce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "/opt/stack/data/nova/instances/6036730b-2c7e-4ea9-95f2-9a40eab2fdce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.168s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.429s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/6036730b-2c7e-4ea9-95f2-9a40eab2fdce/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:07:09 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:07:09 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:07:09 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8621MB free_disk=24.899250030517578GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/6036730b-2c7e-4ea9-95f2-9a40eab2fdce/disk 1073741824" returned: 0 in 0.052s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.484s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 9909ae6b-7900-4f71-8900-2bf25185e436 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance bf7a7308-36a6-4a34-bde5-bacd29a77101 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance ef297753-f6fa-4db7-b866-bfeee166696e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6036730b-2c7e-4ea9-95f2-9a40eab2fdce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.181s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6036730b-2c7e-4ea9-95f2-9a40eab2fdce/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6036730b-2c7e-4ea9-95f2-9a40eab2fdce/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:07:09 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Successfully created port: 32e2af6e-cb96-4616-9dab-781cc8560957 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 03:07:10 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:07:10 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:07:10 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6036730b-2c7e-4ea9-95f2-9a40eab2fdce/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:07:10 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Cannot resize image /opt/stack/data/nova/instances/6036730b-2c7e-4ea9-95f2-9a40eab2fdce/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 03:07:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 03:07:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Ensure instance console log exists: /opt/stack/data/nova/instances/6036730b-2c7e-4ea9-95f2-9a40eab2fdce/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 03:07:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:07:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:07:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:07:10 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:07:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.386s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:07:10 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Successfully updated port: 32e2af6e-cb96-4616-9dab-781cc8560957 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 03:07:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "refresh_cache-6036730b-2c7e-4ea9-95f2-9a40eab2fdce" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:07:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquired lock "refresh_cache-6036730b-2c7e-4ea9-95f2-9a40eab2fdce" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:07:10 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 03:07:10 user nova-compute[75391]: DEBUG nova.compute.manager [req-fd99383f-c8e3-4534-92c7-dcd2944a8ce2 req-65ae3d11-a059-4e6e-9b91-e90492fd2ecc service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Received event network-changed-32e2af6e-cb96-4616-9dab-781cc8560957 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:07:10 user nova-compute[75391]: DEBUG nova.compute.manager [req-fd99383f-c8e3-4534-92c7-dcd2944a8ce2 req-65ae3d11-a059-4e6e-9b91-e90492fd2ecc service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Refreshing instance network info cache due to event network-changed-32e2af6e-cb96-4616-9dab-781cc8560957. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:07:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-fd99383f-c8e3-4534-92c7-dcd2944a8ce2 req-65ae3d11-a059-4e6e-9b91-e90492fd2ecc service nova] Acquiring lock "refresh_cache-6036730b-2c7e-4ea9-95f2-9a40eab2fdce" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:07:10 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.network.neutron [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Updating instance_info_cache with network_info: [{"id": "32e2af6e-cb96-4616-9dab-781cc8560957", "address": "fa:16:3e:fe:fc:98", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e2af6e-cb", "ovs_interfaceid": "32e2af6e-cb96-4616-9dab-781cc8560957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Releasing lock "refresh_cache-6036730b-2c7e-4ea9-95f2-9a40eab2fdce" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Instance network_info: |[{"id": "32e2af6e-cb96-4616-9dab-781cc8560957", "address": "fa:16:3e:fe:fc:98", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e2af6e-cb", "ovs_interfaceid": "32e2af6e-cb96-4616-9dab-781cc8560957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-fd99383f-c8e3-4534-92c7-dcd2944a8ce2 req-65ae3d11-a059-4e6e-9b91-e90492fd2ecc service nova] Acquired lock "refresh_cache-6036730b-2c7e-4ea9-95f2-9a40eab2fdce" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.network.neutron [req-fd99383f-c8e3-4534-92c7-dcd2944a8ce2 req-65ae3d11-a059-4e6e-9b91-e90492fd2ecc service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Refreshing network info cache for port 32e2af6e-cb96-4616-9dab-781cc8560957 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Start _get_guest_xml network_info=[{"id": "32e2af6e-cb96-4616-9dab-781cc8560957", "address": "fa:16:3e:fe:fc:98", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e2af6e-cb", "ovs_interfaceid": "32e2af6e-cb96-4616-9dab-781cc8560957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 03:07:11 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:07:11 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:07:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-40782949',display_name='tempest-AttachVolumeNegativeTest-server-40782949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-40782949',id=43,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdUzY3K5Wiq/L5No0OnvghflSShzVifWBi0J9hWhzRyRhPp+uw6P3AHX1VqI4Bn3kUV2juaidCRjlk2EFT3cy/braym449kBgfhAcIP/fkGcm3pLQIohtn9YFWPDakElA==',key_name='tempest-keypair-1185316086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c00f50c42754cea86c68e3e668c0180',ramdisk_id='',reservation_id='r-1p03303o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-941502312',owner_user_name='tempest-AttachVolumeNegativeTest-941502312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:07:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970046cb64de4109bb299f75172b7dd7',uuid=6036730b-2c7e-4ea9-95f2-9a40eab2fdce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32e2af6e-cb96-4616-9dab-781cc8560957", "address": "fa:16:3e:fe:fc:98", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e2af6e-cb", "ovs_interfaceid": "32e2af6e-cb96-4616-9dab-781cc8560957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Converting VIF {"id": "32e2af6e-cb96-4616-9dab-781cc8560957", "address": "fa:16:3e:fe:fc:98", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e2af6e-cb", "ovs_interfaceid": "32e2af6e-cb96-4616-9dab-781cc8560957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:fc:98,bridge_name='br-int',has_traffic_filtering=True,id=32e2af6e-cb96-4616-9dab-781cc8560957,network=Network(2109b776-effc-4ec7-ac51-d0408f119253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e2af6e-cb') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.objects.instance [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lazy-loading 'pci_devices' on Instance uuid 6036730b-2c7e-4ea9-95f2-9a40eab2fdce {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] End _get_guest_xml xml=<domain type="kvm">
Nov 15 03:07:11 user nova-compute[75391]:   <uuid>6036730b-2c7e-4ea9-95f2-9a40eab2fdce</uuid>
Nov 15 03:07:11 user nova-compute[75391]:   <name>instance-0000002b</name>
Nov 15 03:07:11 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 03:07:11 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 03:07:11 user nova-compute[75391]:   <metadata>
Nov 15 03:07:11 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 03:07:11 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 03:07:11 user nova-compute[75391]:       <nova:name>tempest-AttachVolumeNegativeTest-server-40782949</nova:name>
Nov 15 03:07:11 user nova-compute[75391]:       <nova:creationTime>2023-11-15 03:07:11</nova:creationTime>
Nov 15 03:07:11 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 03:07:11 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 03:07:11 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 03:07:11 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 03:07:11 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 03:07:11 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 03:07:11 user nova-compute[75391]:       </nova:flavor>
Nov 15 03:07:11 user nova-compute[75391]:       <nova:owner>
Nov 15 03:07:11 user nova-compute[75391]:         <nova:user uuid="970046cb64de4109bb299f75172b7dd7">tempest-AttachVolumeNegativeTest-941502312-project-member</nova:user>
Nov 15 03:07:11 user nova-compute[75391]:         <nova:project uuid="9c00f50c42754cea86c68e3e668c0180">tempest-AttachVolumeNegativeTest-941502312</nova:project>
Nov 15 03:07:11 user nova-compute[75391]:       </nova:owner>
Nov 15 03:07:11 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 03:07:11 user nova-compute[75391]:       <nova:ports>
Nov 15 03:07:11 user nova-compute[75391]:         <nova:port uuid="32e2af6e-cb96-4616-9dab-781cc8560957">
Nov 15 03:07:11 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 03:07:11 user nova-compute[75391]:         </nova:port>
Nov 15 03:07:11 user nova-compute[75391]:       </nova:ports>
Nov 15 03:07:11 user nova-compute[75391]:     </nova:instance>
Nov 15 03:07:11 user nova-compute[75391]:   </metadata>
Nov 15 03:07:11 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 03:07:11 user nova-compute[75391]:     <system>
Nov 15 03:07:11 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 03:07:11 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 03:07:11 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 03:07:11 user nova-compute[75391]:       <entry name="serial">6036730b-2c7e-4ea9-95f2-9a40eab2fdce</entry>
Nov 15 03:07:11 user nova-compute[75391]:       <entry name="uuid">6036730b-2c7e-4ea9-95f2-9a40eab2fdce</entry>
Nov 15 03:07:11 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 03:07:11 user nova-compute[75391]:     </system>
Nov 15 03:07:11 user nova-compute[75391]:   </sysinfo>
Nov 15 03:07:11 user nova-compute[75391]:   <os>
Nov 15 03:07:11 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 03:07:11 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 03:07:11 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 03:07:11 user nova-compute[75391]:   </os>
Nov 15 03:07:11 user nova-compute[75391]:   <features>
Nov 15 03:07:11 user nova-compute[75391]:     <acpi/>
Nov 15 03:07:11 user nova-compute[75391]:     <apic/>
Nov 15 03:07:11 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 03:07:11 user nova-compute[75391]:   </features>
Nov 15 03:07:11 user nova-compute[75391]:   <clock offset="utc">
Nov 15 03:07:11 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 03:07:11 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 03:07:11 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 03:07:11 user nova-compute[75391]:   </clock>
Nov 15 03:07:11 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 03:07:11 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 03:07:11 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 03:07:11 user nova-compute[75391]:   </cpu>
Nov 15 03:07:11 user nova-compute[75391]:   <devices>
Nov 15 03:07:11 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 03:07:11 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 03:07:11 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/6036730b-2c7e-4ea9-95f2-9a40eab2fdce/disk"/>
Nov 15 03:07:11 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 03:07:11 user nova-compute[75391]:     </disk>
Nov 15 03:07:11 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 03:07:11 user nova-compute[75391]:       <mac address="fa:16:3e:fe:fc:98"/>
Nov 15 03:07:11 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:07:11 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 03:07:11 user nova-compute[75391]:       <target dev="tap32e2af6e-cb"/>
Nov 15 03:07:11 user nova-compute[75391]:     </interface>
Nov 15 03:07:11 user nova-compute[75391]:     <serial type="pty">
Nov 15 03:07:11 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/6036730b-2c7e-4ea9-95f2-9a40eab2fdce/console.log" append="off"/>
Nov 15 03:07:11 user nova-compute[75391]:     </serial>
Nov 15 03:07:11 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 03:07:11 user nova-compute[75391]:     <video>
Nov 15 03:07:11 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:07:11 user nova-compute[75391]:     </video>
Nov 15 03:07:11 user nova-compute[75391]:     <rng model="virtio">
Nov 15 03:07:11 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 03:07:11 user nova-compute[75391]:     </rng>
Nov 15 03:07:11 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 03:07:11 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 03:07:11 user nova-compute[75391]:       <stats period="10"/>
Nov 15 03:07:11 user nova-compute[75391]:     </memballoon>
Nov 15 03:07:11 user nova-compute[75391]:   </devices>
Nov 15 03:07:11 user nova-compute[75391]: </domain>
Nov 15 03:07:11 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:07:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-40782949',display_name='tempest-AttachVolumeNegativeTest-server-40782949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-40782949',id=43,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdUzY3K5Wiq/L5No0OnvghflSShzVifWBi0J9hWhzRyRhPp+uw6P3AHX1VqI4Bn3kUV2juaidCRjlk2EFT3cy/braym449kBgfhAcIP/fkGcm3pLQIohtn9YFWPDakElA==',key_name='tempest-keypair-1185316086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c00f50c42754cea86c68e3e668c0180',ramdisk_id='',reservation_id='r-1p03303o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-941502312',owner_user_name='tempest-AttachVolumeNegativeTest-941502312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:07:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970046cb64de4109bb299f75172b7dd7',uuid=6036730b-2c7e-4ea9-95f2-9a40eab2fdce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32e2af6e-cb96-4616-9dab-781cc8560957", "address": "fa:16:3e:fe:fc:98", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e2af6e-cb", "ovs_interfaceid": "32e2af6e-cb96-4616-9dab-781cc8560957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Converting VIF {"id": "32e2af6e-cb96-4616-9dab-781cc8560957", "address": "fa:16:3e:fe:fc:98", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e2af6e-cb", "ovs_interfaceid": "32e2af6e-cb96-4616-9dab-781cc8560957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:fc:98,bridge_name='br-int',has_traffic_filtering=True,id=32e2af6e-cb96-4616-9dab-781cc8560957,network=Network(2109b776-effc-4ec7-ac51-d0408f119253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e2af6e-cb') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG os_vif [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:fc:98,bridge_name='br-int',has_traffic_filtering=True,id=32e2af6e-cb96-4616-9dab-781cc8560957,network=Network(2109b776-effc-4ec7-ac51-d0408f119253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e2af6e-cb') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98ba1dec-94be-5979-b349-abd1a81933d6', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32e2af6e-cb, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap32e2af6e-cb, col_values=(('qos', UUID('ca1580bf-c2a1-4fe6-87eb-f71d9ea85394')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap32e2af6e-cb, col_values=(('external_ids', {'iface-id': '32e2af6e-cb96-4616-9dab-781cc8560957', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:fc:98', 'vm-uuid': '6036730b-2c7e-4ea9-95f2-9a40eab2fdce'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:11 user nova-compute[75391]: INFO os_vif [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:fc:98,bridge_name='br-int',has_traffic_filtering=True,id=32e2af6e-cb96-4616-9dab-781cc8560957,network=Network(2109b776-effc-4ec7-ac51-d0408f119253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e2af6e-cb')
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] No VIF found with MAC fa:16:3e:fe:fc:98, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.network.neutron [req-fd99383f-c8e3-4534-92c7-dcd2944a8ce2 req-65ae3d11-a059-4e6e-9b91-e90492fd2ecc service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Updated VIF entry in instance network info cache for port 32e2af6e-cb96-4616-9dab-781cc8560957. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG nova.network.neutron [req-fd99383f-c8e3-4534-92c7-dcd2944a8ce2 req-65ae3d11-a059-4e6e-9b91-e90492fd2ecc service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Updating instance_info_cache with network_info: [{"id": "32e2af6e-cb96-4616-9dab-781cc8560957", "address": "fa:16:3e:fe:fc:98", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e2af6e-cb", "ovs_interfaceid": "32e2af6e-cb96-4616-9dab-781cc8560957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:07:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-fd99383f-c8e3-4534-92c7-dcd2944a8ce2 req-65ae3d11-a059-4e6e-9b91-e90492fd2ecc service nova] Releasing lock "refresh_cache-6036730b-2c7e-4ea9-95f2-9a40eab2fdce" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:07:12 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:07:12 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:07:12 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:07:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-ede3295d-f9f3-4f61-b661-d4f8ca18f9b8 req-5bdc5d5a-a91f-412e-9a1e-8171304bf539 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Received event network-vif-plugged-32e2af6e-cb96-4616-9dab-781cc8560957 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:07:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ede3295d-f9f3-4f61-b661-d4f8ca18f9b8 req-5bdc5d5a-a91f-412e-9a1e-8171304bf539 service nova] Acquiring lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:07:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ede3295d-f9f3-4f61-b661-d4f8ca18f9b8 req-5bdc5d5a-a91f-412e-9a1e-8171304bf539 service nova] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:07:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ede3295d-f9f3-4f61-b661-d4f8ca18f9b8 req-5bdc5d5a-a91f-412e-9a1e-8171304bf539 service nova] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:07:12 user nova-compute[75391]: DEBUG nova.compute.manager [req-ede3295d-f9f3-4f61-b661-d4f8ca18f9b8 req-5bdc5d5a-a91f-412e-9a1e-8171304bf539 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] No waiting events found dispatching network-vif-plugged-32e2af6e-cb96-4616-9dab-781cc8560957 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:07:12 user nova-compute[75391]: WARNING nova.compute.manager [req-ede3295d-f9f3-4f61-b661-d4f8ca18f9b8 req-5bdc5d5a-a91f-412e-9a1e-8171304bf539 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Received unexpected event network-vif-plugged-32e2af6e-cb96-4616-9dab-781cc8560957 for instance with vm_state building and task_state spawning.
Nov 15 03:07:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:14 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 03:07:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 03:07:14 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Instance spawned successfully.
Nov 15 03:07:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 03:07:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:07:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:07:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:07:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:07:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:07:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:07:14 user nova-compute[75391]: INFO nova.compute.manager [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Took 5.52 seconds to spawn the instance on the hypervisor.
Nov 15 03:07:14 user nova-compute[75391]: DEBUG nova.compute.manager [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 03:07:14 user nova-compute[75391]: INFO nova.compute.manager [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Took 6.22 seconds to build instance.
Nov 15 03:07:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-ba326563-d6f2-439f-acb1-8589686a9846 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.336s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:07:14 user nova-compute[75391]: DEBUG nova.compute.manager [req-90523c69-bed7-4e49-bc2d-78c288707d5d req-be993b85-cc9f-499d-8feb-e5ea44db33e5 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Received event network-vif-plugged-32e2af6e-cb96-4616-9dab-781cc8560957 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:07:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-90523c69-bed7-4e49-bc2d-78c288707d5d req-be993b85-cc9f-499d-8feb-e5ea44db33e5 service nova] Acquiring lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:07:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-90523c69-bed7-4e49-bc2d-78c288707d5d req-be993b85-cc9f-499d-8feb-e5ea44db33e5 service nova] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:07:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-90523c69-bed7-4e49-bc2d-78c288707d5d req-be993b85-cc9f-499d-8feb-e5ea44db33e5 service nova] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:07:14 user nova-compute[75391]: DEBUG nova.compute.manager [req-90523c69-bed7-4e49-bc2d-78c288707d5d req-be993b85-cc9f-499d-8feb-e5ea44db33e5 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] No waiting events found dispatching network-vif-plugged-32e2af6e-cb96-4616-9dab-781cc8560957 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:07:14 user nova-compute[75391]: WARNING nova.compute.manager [req-90523c69-bed7-4e49-bc2d-78c288707d5d req-be993b85-cc9f-499d-8feb-e5ea44db33e5 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Received unexpected event network-vif-plugged-32e2af6e-cb96-4616-9dab-781cc8560957 for instance with vm_state active and task_state None.
Nov 15 03:07:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4c6d0ce4-1038-4507-ba0e-391bc47c875d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "9909ae6b-7900-4f71-8900-2bf25185e436" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:07:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4c6d0ce4-1038-4507-ba0e-391bc47c875d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "9909ae6b-7900-4f71-8900-2bf25185e436" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:07:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4c6d0ce4-1038-4507-ba0e-391bc47c875d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:07:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4c6d0ce4-1038-4507-ba0e-391bc47c875d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:07:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4c6d0ce4-1038-4507-ba0e-391bc47c875d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:07:18 user nova-compute[75391]: INFO nova.compute.manager [None req-4c6d0ce4-1038-4507-ba0e-391bc47c875d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Terminating instance
Nov 15 03:07:18 user nova-compute[75391]: DEBUG nova.compute.manager [None req-4c6d0ce4-1038-4507-ba0e-391bc47c875d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 03:07:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:18 user nova-compute[75391]: DEBUG nova.compute.manager [req-1d42d6a6-cedf-405d-ab10-df2d696aad31 req-c9a6ebd7-7e49-40e0-96bf-7469904eb419 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Received event network-vif-unplugged-45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:07:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1d42d6a6-cedf-405d-ab10-df2d696aad31 req-c9a6ebd7-7e49-40e0-96bf-7469904eb419 service nova] Acquiring lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:07:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1d42d6a6-cedf-405d-ab10-df2d696aad31 req-c9a6ebd7-7e49-40e0-96bf-7469904eb419 service nova] Lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:07:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-1d42d6a6-cedf-405d-ab10-df2d696aad31 req-c9a6ebd7-7e49-40e0-96bf-7469904eb419 service nova] Lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:07:18 user nova-compute[75391]: DEBUG nova.compute.manager [req-1d42d6a6-cedf-405d-ab10-df2d696aad31 req-c9a6ebd7-7e49-40e0-96bf-7469904eb419 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] No waiting events found dispatching network-vif-unplugged-45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:07:18 user nova-compute[75391]: DEBUG nova.compute.manager [req-1d42d6a6-cedf-405d-ab10-df2d696aad31 req-c9a6ebd7-7e49-40e0-96bf-7469904eb419 service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Received event network-vif-unplugged-45919066-22c9-4df6-b411-e07851e743b6 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 03:07:18 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Instance destroyed successfully.
Nov 15 03:07:18 user nova-compute[75391]: DEBUG nova.objects.instance [None req-4c6d0ce4-1038-4507-ba0e-391bc47c875d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lazy-loading 'resources' on Instance uuid 9909ae6b-7900-4f71-8900-2bf25185e436 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:07:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-4c6d0ce4-1038-4507-ba0e-391bc47c875d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2116588976',display_name='tempest-ServerRescueNegativeTestJSON-server-2116588976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2116588976',id=26,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:55:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8bfe79a4e16f4fa89437bcc50fc4b356',ramdisk_id='',reservation_id='r-68s69sl3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-388649299',owner_user_name='tempest-ServerRescueNegativeTestJSON-388649299-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:57:09Z,user_data=None,user_id='9b3fc7a83f6c4c5baa7621163e9f62aa',uuid=9909ae6b-7900-4f71-8900-2bf25185e436,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45919066-22c9-4df6-b411-e07851e743b6", "address": "fa:16:3e:86:62:a8", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45919066-22", "ovs_interfaceid": "45919066-22c9-4df6-b411-e07851e743b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 03:07:18 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-4c6d0ce4-1038-4507-ba0e-391bc47c875d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Converting VIF {"id": "45919066-22c9-4df6-b411-e07851e743b6", "address": "fa:16:3e:86:62:a8", "network": {"id": "079437cd-2e7d-40ea-98c0-24a1c9091aa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-640407640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bfe79a4e16f4fa89437bcc50fc4b356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45919066-22", "ovs_interfaceid": "45919066-22c9-4df6-b411-e07851e743b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:07:18 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-4c6d0ce4-1038-4507-ba0e-391bc47c875d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:62:a8,bridge_name='br-int',has_traffic_filtering=True,id=45919066-22c9-4df6-b411-e07851e743b6,network=Network(079437cd-2e7d-40ea-98c0-24a1c9091aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45919066-22') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:07:18 user nova-compute[75391]: DEBUG os_vif [None req-4c6d0ce4-1038-4507-ba0e-391bc47c875d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:62:a8,bridge_name='br-int',has_traffic_filtering=True,id=45919066-22c9-4df6-b411-e07851e743b6,network=Network(079437cd-2e7d-40ea-98c0-24a1c9091aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45919066-22') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 03:07:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45919066-22, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:07:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:07:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b55a2e5-dd9f-4191-89fc-730efb292d29) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:07:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:07:18 user nova-compute[75391]: INFO os_vif [None req-4c6d0ce4-1038-4507-ba0e-391bc47c875d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:62:a8,bridge_name='br-int',has_traffic_filtering=True,id=45919066-22c9-4df6-b411-e07851e743b6,network=Network(079437cd-2e7d-40ea-98c0-24a1c9091aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45919066-22')
Nov 15 03:07:18 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-4c6d0ce4-1038-4507-ba0e-391bc47c875d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Deleting instance files /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436_del
Nov 15 03:07:18 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-4c6d0ce4-1038-4507-ba0e-391bc47c875d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Deletion of /opt/stack/data/nova/instances/9909ae6b-7900-4f71-8900-2bf25185e436_del complete
Nov 15 03:07:19 user nova-compute[75391]: INFO nova.compute.manager [None req-4c6d0ce4-1038-4507-ba0e-391bc47c875d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 03:07:19 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-4c6d0ce4-1038-4507-ba0e-391bc47c875d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 03:07:19 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 03:07:19 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 03:07:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:19 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:07:19 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Took 0.45 seconds to deallocate network for instance.
Nov 15 03:07:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4c6d0ce4-1038-4507-ba0e-391bc47c875d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:07:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4c6d0ce4-1038-4507-ba0e-391bc47c875d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:07:19 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-4c6d0ce4-1038-4507-ba0e-391bc47c875d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:07:19 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-4c6d0ce4-1038-4507-ba0e-391bc47c875d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:07:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4c6d0ce4-1038-4507-ba0e-391bc47c875d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:07:19 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-4c6d0ce4-1038-4507-ba0e-391bc47c875d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Deleted allocations for instance 9909ae6b-7900-4f71-8900-2bf25185e436
Nov 15 03:07:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4c6d0ce4-1038-4507-ba0e-391bc47c875d tempest-ServerRescueNegativeTestJSON-388649299 tempest-ServerRescueNegativeTestJSON-388649299-project-member] Lock "9909ae6b-7900-4f71-8900-2bf25185e436" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.686s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:07:20 user nova-compute[75391]: DEBUG nova.compute.manager [req-a0bd5fb7-696e-4736-85e0-0756138cd4ab req-ece95aa6-c1e2-429c-822a-39a5d7d0784b service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Received event network-vif-plugged-45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:07:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a0bd5fb7-696e-4736-85e0-0756138cd4ab req-ece95aa6-c1e2-429c-822a-39a5d7d0784b service nova] Acquiring lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:07:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a0bd5fb7-696e-4736-85e0-0756138cd4ab req-ece95aa6-c1e2-429c-822a-39a5d7d0784b service nova] Lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:07:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a0bd5fb7-696e-4736-85e0-0756138cd4ab req-ece95aa6-c1e2-429c-822a-39a5d7d0784b service nova] Lock "9909ae6b-7900-4f71-8900-2bf25185e436-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:07:20 user nova-compute[75391]: DEBUG nova.compute.manager [req-a0bd5fb7-696e-4736-85e0-0756138cd4ab req-ece95aa6-c1e2-429c-822a-39a5d7d0784b service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] No waiting events found dispatching network-vif-plugged-45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:07:20 user nova-compute[75391]: WARNING nova.compute.manager [req-a0bd5fb7-696e-4736-85e0-0756138cd4ab req-ece95aa6-c1e2-429c-822a-39a5d7d0784b service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Received unexpected event network-vif-plugged-45919066-22c9-4df6-b411-e07851e743b6 for instance with vm_state deleted and task_state None.
Nov 15 03:07:20 user nova-compute[75391]: DEBUG nova.compute.manager [req-a0bd5fb7-696e-4736-85e0-0756138cd4ab req-ece95aa6-c1e2-429c-822a-39a5d7d0784b service nova] [instance: 9909ae6b-7900-4f71-8900-2bf25185e436] Received event network-vif-deleted-45919066-22c9-4df6-b411-e07851e743b6 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:07:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-58884bdd-2eb5-4ec0-a1da-235b07b95b25 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Acquiring lock "ef297753-f6fa-4db7-b866-bfeee166696e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:07:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-58884bdd-2eb5-4ec0-a1da-235b07b95b25 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Lock "ef297753-f6fa-4db7-b866-bfeee166696e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:07:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-58884bdd-2eb5-4ec0-a1da-235b07b95b25 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Acquiring lock "ef297753-f6fa-4db7-b866-bfeee166696e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:07:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-58884bdd-2eb5-4ec0-a1da-235b07b95b25 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Lock "ef297753-f6fa-4db7-b866-bfeee166696e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:07:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-58884bdd-2eb5-4ec0-a1da-235b07b95b25 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Lock "ef297753-f6fa-4db7-b866-bfeee166696e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:07:32 user nova-compute[75391]: INFO nova.compute.manager [None req-58884bdd-2eb5-4ec0-a1da-235b07b95b25 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Terminating instance
Nov 15 03:07:32 user nova-compute[75391]: DEBUG nova.compute.manager [None req-58884bdd-2eb5-4ec0-a1da-235b07b95b25 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 03:07:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:32 user nova-compute[75391]: DEBUG nova.compute.manager [req-2dffdd42-a2f4-46e8-b2b7-d5042b068332 req-afa2a527-a3a2-4deb-86dc-ee666e1e3946 service nova] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Received event network-vif-unplugged-57c4062f-008d-4c26-b6fe-6b9acaaa3c2c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:07:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2dffdd42-a2f4-46e8-b2b7-d5042b068332 req-afa2a527-a3a2-4deb-86dc-ee666e1e3946 service nova] Acquiring lock "ef297753-f6fa-4db7-b866-bfeee166696e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:07:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2dffdd42-a2f4-46e8-b2b7-d5042b068332 req-afa2a527-a3a2-4deb-86dc-ee666e1e3946 service nova] Lock "ef297753-f6fa-4db7-b866-bfeee166696e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:07:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2dffdd42-a2f4-46e8-b2b7-d5042b068332 req-afa2a527-a3a2-4deb-86dc-ee666e1e3946 service nova] Lock "ef297753-f6fa-4db7-b866-bfeee166696e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:07:32 user nova-compute[75391]: DEBUG nova.compute.manager [req-2dffdd42-a2f4-46e8-b2b7-d5042b068332 req-afa2a527-a3a2-4deb-86dc-ee666e1e3946 service nova] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] No waiting events found dispatching network-vif-unplugged-57c4062f-008d-4c26-b6fe-6b9acaaa3c2c {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:07:32 user nova-compute[75391]: DEBUG nova.compute.manager [req-2dffdd42-a2f4-46e8-b2b7-d5042b068332 req-afa2a527-a3a2-4deb-86dc-ee666e1e3946 service nova] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Received event network-vif-unplugged-57c4062f-008d-4c26-b6fe-6b9acaaa3c2c for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 03:07:33 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Instance destroyed successfully.
Nov 15 03:07:33 user nova-compute[75391]: DEBUG nova.objects.instance [None req-58884bdd-2eb5-4ec0-a1da-235b07b95b25 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Lazy-loading 'resources' on Instance uuid ef297753-f6fa-4db7-b866-bfeee166696e {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:07:33 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-58884bdd-2eb5-4ec0-a1da-235b07b95b25 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:05:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1498347742',display_name='tempest-VolumesNegativeTest-instance-1498347742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1498347742',id=42,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T03:05:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2264d628dfc40399e0cc9910bbce7eb',ramdisk_id='',reservation_id='r-75fagag4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1949875658',owner_user_name='tempest-VolumesNegativeTest-1949875658-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T03:05:49Z,user_data=None,user_id='2e4e7ed8ff044dbabcb7badf0dbb79fe',uuid=ef297753-f6fa-4db7-b866-bfeee166696e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57c4062f-008d-4c26-b6fe-6b9acaaa3c2c", "address": "fa:16:3e:0c:a3:58", "network": {"id": "1dbbad64-77f5-47da-9da5-d219ac9e5166", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "94d41b4ea2134098830087c7a9bd0c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57c4062f-00", "ovs_interfaceid": "57c4062f-008d-4c26-b6fe-6b9acaaa3c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 03:07:33 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-58884bdd-2eb5-4ec0-a1da-235b07b95b25 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Converting VIF {"id": "57c4062f-008d-4c26-b6fe-6b9acaaa3c2c", "address": "fa:16:3e:0c:a3:58", "network": {"id": "1dbbad64-77f5-47da-9da5-d219ac9e5166", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "94d41b4ea2134098830087c7a9bd0c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57c4062f-00", "ovs_interfaceid": "57c4062f-008d-4c26-b6fe-6b9acaaa3c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:07:33 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-58884bdd-2eb5-4ec0-a1da-235b07b95b25 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:a3:58,bridge_name='br-int',has_traffic_filtering=True,id=57c4062f-008d-4c26-b6fe-6b9acaaa3c2c,network=Network(1dbbad64-77f5-47da-9da5-d219ac9e5166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57c4062f-00') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:07:33 user nova-compute[75391]: DEBUG os_vif [None req-58884bdd-2eb5-4ec0-a1da-235b07b95b25 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:a3:58,bridge_name='br-int',has_traffic_filtering=True,id=57c4062f-008d-4c26-b6fe-6b9acaaa3c2c,network=Network(1dbbad64-77f5-47da-9da5-d219ac9e5166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57c4062f-00') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 03:07:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57c4062f-00, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:07:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:07:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0aed72d3-26bd-44cb-a4b5-f91ef3acf739) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:07:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:33 user nova-compute[75391]: INFO os_vif [None req-58884bdd-2eb5-4ec0-a1da-235b07b95b25 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:a3:58,bridge_name='br-int',has_traffic_filtering=True,id=57c4062f-008d-4c26-b6fe-6b9acaaa3c2c,network=Network(1dbbad64-77f5-47da-9da5-d219ac9e5166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57c4062f-00')
Nov 15 03:07:33 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-58884bdd-2eb5-4ec0-a1da-235b07b95b25 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Deleting instance files /opt/stack/data/nova/instances/ef297753-f6fa-4db7-b866-bfeee166696e_del
Nov 15 03:07:33 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-58884bdd-2eb5-4ec0-a1da-235b07b95b25 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Deletion of /opt/stack/data/nova/instances/ef297753-f6fa-4db7-b866-bfeee166696e_del complete
Nov 15 03:07:33 user nova-compute[75391]: INFO nova.compute.manager [None req-58884bdd-2eb5-4ec0-a1da-235b07b95b25 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Took 0.82 seconds to destroy the instance on the hypervisor.
Nov 15 03:07:33 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-58884bdd-2eb5-4ec0-a1da-235b07b95b25 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 03:07:33 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 03:07:33 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 03:07:33 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:07:33 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Took 0.44 seconds to deallocate network for instance.
Nov 15 03:07:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-58884bdd-2eb5-4ec0-a1da-235b07b95b25 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:07:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-58884bdd-2eb5-4ec0-a1da-235b07b95b25 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:07:33 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-58884bdd-2eb5-4ec0-a1da-235b07b95b25 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:07:33 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-58884bdd-2eb5-4ec0-a1da-235b07b95b25 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:07:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-58884bdd-2eb5-4ec0-a1da-235b07b95b25 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:07:33 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-58884bdd-2eb5-4ec0-a1da-235b07b95b25 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Deleted allocations for instance ef297753-f6fa-4db7-b866-bfeee166696e
Nov 15 03:07:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-58884bdd-2eb5-4ec0-a1da-235b07b95b25 tempest-VolumesNegativeTest-1949875658 tempest-VolumesNegativeTest-1949875658-project-member] Lock "ef297753-f6fa-4db7-b866-bfeee166696e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.615s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:07:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:34 user nova-compute[75391]: DEBUG nova.compute.manager [req-99bb58a5-198a-4974-b497-50e9f99bb900 req-a6f4d48f-4fa6-46e4-9b76-3d0e77a484c9 service nova] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Received event network-vif-plugged-57c4062f-008d-4c26-b6fe-6b9acaaa3c2c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:07:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-99bb58a5-198a-4974-b497-50e9f99bb900 req-a6f4d48f-4fa6-46e4-9b76-3d0e77a484c9 service nova] Acquiring lock "ef297753-f6fa-4db7-b866-bfeee166696e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:07:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-99bb58a5-198a-4974-b497-50e9f99bb900 req-a6f4d48f-4fa6-46e4-9b76-3d0e77a484c9 service nova] Lock "ef297753-f6fa-4db7-b866-bfeee166696e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:07:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-99bb58a5-198a-4974-b497-50e9f99bb900 req-a6f4d48f-4fa6-46e4-9b76-3d0e77a484c9 service nova] Lock "ef297753-f6fa-4db7-b866-bfeee166696e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:07:34 user nova-compute[75391]: DEBUG nova.compute.manager [req-99bb58a5-198a-4974-b497-50e9f99bb900 req-a6f4d48f-4fa6-46e4-9b76-3d0e77a484c9 service nova] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] No waiting events found dispatching network-vif-plugged-57c4062f-008d-4c26-b6fe-6b9acaaa3c2c {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:07:34 user nova-compute[75391]: WARNING nova.compute.manager [req-99bb58a5-198a-4974-b497-50e9f99bb900 req-a6f4d48f-4fa6-46e4-9b76-3d0e77a484c9 service nova] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Received unexpected event network-vif-plugged-57c4062f-008d-4c26-b6fe-6b9acaaa3c2c for instance with vm_state deleted and task_state None.
Nov 15 03:07:34 user nova-compute[75391]: DEBUG nova.compute.manager [req-99bb58a5-198a-4974-b497-50e9f99bb900 req-a6f4d48f-4fa6-46e4-9b76-3d0e77a484c9 service nova] [instance: ef297753-f6fa-4db7-b866-bfeee166696e] Received event network-vif-deleted-57c4062f-008d-4c26-b6fe-6b9acaaa3c2c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:07:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:07:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:07:53 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:07:53 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 03:07:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:08:01 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:08:02 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:08:02 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:08:02 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Didn't find any instances for network info cache update. {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 03:08:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:08:03 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:08:04 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:08:05 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:08:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:08:08 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:08:08 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:08:08 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:08:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:08:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:08:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:08:08 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:08:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6036730b-2c7e-4ea9-95f2-9a40eab2fdce/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:08:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6036730b-2c7e-4ea9-95f2-9a40eab2fdce/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:08:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6036730b-2c7e-4ea9-95f2-9a40eab2fdce/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:08:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6036730b-2c7e-4ea9-95f2-9a40eab2fdce/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:08:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:08:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:08:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:08:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:08:09 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 03:08:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:08:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:08:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk.rescue --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:08:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:08:10 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:08:10 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:08:10 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8729MB free_disk=24.909870147705078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:08:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:08:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:08:10 user nova-compute[75391]: INFO nova.compute.manager [None req-1b4555ae-54cf-4e7c-995e-b20418187b23 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Unrescuing
Nov 15 03:08:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1b4555ae-54cf-4e7c-995e-b20418187b23 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Acquiring lock "refresh_cache-bf7a7308-36a6-4a34-bde5-bacd29a77101" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:08:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1b4555ae-54cf-4e7c-995e-b20418187b23 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Acquired lock "refresh_cache-bf7a7308-36a6-4a34-bde5-bacd29a77101" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:08:10 user nova-compute[75391]: DEBUG nova.network.neutron [None req-1b4555ae-54cf-4e7c-995e-b20418187b23 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 03:08:10 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance bf7a7308-36a6-4a34-bde5-bacd29a77101 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:08:10 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6036730b-2c7e-4ea9-95f2-9a40eab2fdce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:08:10 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:08:10 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:08:10 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Refreshing inventories for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 03:08:10 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Updating ProviderTree inventory for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 03:08:10 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Updating inventory in ProviderTree for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 03:08:10 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Refreshing aggregate associations for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e, aggregates: None {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 03:08:10 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Refreshing trait associations for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 03:08:10 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:08:10 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:08:10 user nova-compute[75391]: DEBUG nova.network.neutron [None req-1b4555ae-54cf-4e7c-995e-b20418187b23 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Updating instance_info_cache with network_info: [{"id": "53ee1144-b72a-431c-9e42-7efd212177b3", "address": "fa:16:3e:98:e2:5a", "network": {"id": "434e7c61-37f4-4a23-be35-6cc6f9842cad", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1311932462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a64dab12ce74d18b3d9414595910180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee1144-b7", "ovs_interfaceid": "53ee1144-b72a-431c-9e42-7efd212177b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:08:10 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:08:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.510s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:08:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1b4555ae-54cf-4e7c-995e-b20418187b23 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Releasing lock "refresh_cache-bf7a7308-36a6-4a34-bde5-bacd29a77101" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:08:10 user nova-compute[75391]: DEBUG nova.objects.instance [None req-1b4555ae-54cf-4e7c-995e-b20418187b23 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lazy-loading 'flavor' on Instance uuid bf7a7308-36a6-4a34-bde5-bacd29a77101 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:08:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:11 user nova-compute[75391]: DEBUG nova.compute.manager [req-2a1c933e-d2cb-4a3c-83cf-c095a0caba20 req-fd2cd7d0-fca8-44f2-a3c7-d15ed45e4710 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received event network-vif-unplugged-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:08:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2a1c933e-d2cb-4a3c-83cf-c095a0caba20 req-fd2cd7d0-fca8-44f2-a3c7-d15ed45e4710 service nova] Acquiring lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:08:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2a1c933e-d2cb-4a3c-83cf-c095a0caba20 req-fd2cd7d0-fca8-44f2-a3c7-d15ed45e4710 service nova] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:08:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2a1c933e-d2cb-4a3c-83cf-c095a0caba20 req-fd2cd7d0-fca8-44f2-a3c7-d15ed45e4710 service nova] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:08:11 user nova-compute[75391]: DEBUG nova.compute.manager [req-2a1c933e-d2cb-4a3c-83cf-c095a0caba20 req-fd2cd7d0-fca8-44f2-a3c7-d15ed45e4710 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] No waiting events found dispatching network-vif-unplugged-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:08:11 user nova-compute[75391]: WARNING nova.compute.manager [req-2a1c933e-d2cb-4a3c-83cf-c095a0caba20 req-fd2cd7d0-fca8-44f2-a3c7-d15ed45e4710 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received unexpected event network-vif-unplugged-53ee1144-b72a-431c-9e42-7efd212177b3 for instance with vm_state rescued and task_state unrescuing.
Nov 15 03:08:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:11 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Instance destroyed successfully.
Nov 15 03:08:11 user nova-compute[75391]: DEBUG nova.compute.manager [req-44f70b14-d15a-48ac-88df-54a3c755cea4 req-47495325-0a7d-4b87-8a82-40651ab72b65 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received event network-changed-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:08:11 user nova-compute[75391]: DEBUG nova.compute.manager [req-44f70b14-d15a-48ac-88df-54a3c755cea4 req-47495325-0a7d-4b87-8a82-40651ab72b65 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Refreshing instance network info cache due to event network-changed-53ee1144-b72a-431c-9e42-7efd212177b3. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:08:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-44f70b14-d15a-48ac-88df-54a3c755cea4 req-47495325-0a7d-4b87-8a82-40651ab72b65 service nova] Acquiring lock "refresh_cache-bf7a7308-36a6-4a34-bde5-bacd29a77101" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:08:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-44f70b14-d15a-48ac-88df-54a3c755cea4 req-47495325-0a7d-4b87-8a82-40651ab72b65 service nova] Acquired lock "refresh_cache-bf7a7308-36a6-4a34-bde5-bacd29a77101" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:08:11 user nova-compute[75391]: DEBUG nova.network.neutron [req-44f70b14-d15a-48ac-88df-54a3c755cea4 req-47495325-0a7d-4b87-8a82-40651ab72b65 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Refreshing network info cache for port 53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:08:12 user nova-compute[75391]: DEBUG nova.network.neutron [req-44f70b14-d15a-48ac-88df-54a3c755cea4 req-47495325-0a7d-4b87-8a82-40651ab72b65 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Updated VIF entry in instance network info cache for port 53ee1144-b72a-431c-9e42-7efd212177b3. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:08:12 user nova-compute[75391]: DEBUG nova.network.neutron [req-44f70b14-d15a-48ac-88df-54a3c755cea4 req-47495325-0a7d-4b87-8a82-40651ab72b65 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Updating instance_info_cache with network_info: [{"id": "53ee1144-b72a-431c-9e42-7efd212177b3", "address": "fa:16:3e:98:e2:5a", "network": {"id": "434e7c61-37f4-4a23-be35-6cc6f9842cad", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1311932462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a64dab12ce74d18b3d9414595910180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee1144-b7", "ovs_interfaceid": "53ee1144-b72a-431c-9e42-7efd212177b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:08:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-44f70b14-d15a-48ac-88df-54a3c755cea4 req-47495325-0a7d-4b87-8a82-40651ab72b65 service nova] Releasing lock "refresh_cache-bf7a7308-36a6-4a34-bde5-bacd29a77101" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:08:12 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:08:12 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:08:12 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:08:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:13 user nova-compute[75391]: DEBUG nova.compute.manager [req-e8985280-0aab-4d0b-92d7-9359e0abc6e2 req-61bc3db9-0100-4036-9472-d4ac4e59d684 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received event network-vif-plugged-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:08:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e8985280-0aab-4d0b-92d7-9359e0abc6e2 req-61bc3db9-0100-4036-9472-d4ac4e59d684 service nova] Acquiring lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:08:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e8985280-0aab-4d0b-92d7-9359e0abc6e2 req-61bc3db9-0100-4036-9472-d4ac4e59d684 service nova] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:08:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e8985280-0aab-4d0b-92d7-9359e0abc6e2 req-61bc3db9-0100-4036-9472-d4ac4e59d684 service nova] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:08:13 user nova-compute[75391]: DEBUG nova.compute.manager [req-e8985280-0aab-4d0b-92d7-9359e0abc6e2 req-61bc3db9-0100-4036-9472-d4ac4e59d684 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] No waiting events found dispatching network-vif-plugged-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:08:13 user nova-compute[75391]: WARNING nova.compute.manager [req-e8985280-0aab-4d0b-92d7-9359e0abc6e2 req-61bc3db9-0100-4036-9472-d4ac4e59d684 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received unexpected event network-vif-plugged-53ee1144-b72a-431c-9e42-7efd212177b3 for instance with vm_state rescued and task_state unrescuing.
Nov 15 03:08:13 user nova-compute[75391]: DEBUG nova.compute.manager [req-e8985280-0aab-4d0b-92d7-9359e0abc6e2 req-61bc3db9-0100-4036-9472-d4ac4e59d684 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received event network-vif-plugged-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:08:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e8985280-0aab-4d0b-92d7-9359e0abc6e2 req-61bc3db9-0100-4036-9472-d4ac4e59d684 service nova] Acquiring lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:08:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e8985280-0aab-4d0b-92d7-9359e0abc6e2 req-61bc3db9-0100-4036-9472-d4ac4e59d684 service nova] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:08:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e8985280-0aab-4d0b-92d7-9359e0abc6e2 req-61bc3db9-0100-4036-9472-d4ac4e59d684 service nova] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:08:13 user nova-compute[75391]: DEBUG nova.compute.manager [req-e8985280-0aab-4d0b-92d7-9359e0abc6e2 req-61bc3db9-0100-4036-9472-d4ac4e59d684 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] No waiting events found dispatching network-vif-plugged-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:08:13 user nova-compute[75391]: WARNING nova.compute.manager [req-e8985280-0aab-4d0b-92d7-9359e0abc6e2 req-61bc3db9-0100-4036-9472-d4ac4e59d684 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received unexpected event network-vif-plugged-53ee1144-b72a-431c-9e42-7efd212177b3 for instance with vm_state rescued and task_state unrescuing.
Nov 15 03:08:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:13 user nova-compute[75391]: DEBUG nova.compute.manager [req-9dc5d520-5c25-4be8-9b8c-d3a5511219f3 req-d223327f-8207-4ecb-8bad-fe526fa37e9b service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received event network-changed-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:08:13 user nova-compute[75391]: DEBUG nova.compute.manager [req-9dc5d520-5c25-4be8-9b8c-d3a5511219f3 req-d223327f-8207-4ecb-8bad-fe526fa37e9b service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Refreshing instance network info cache due to event network-changed-53ee1144-b72a-431c-9e42-7efd212177b3. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:08:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9dc5d520-5c25-4be8-9b8c-d3a5511219f3 req-d223327f-8207-4ecb-8bad-fe526fa37e9b service nova] Acquiring lock "refresh_cache-bf7a7308-36a6-4a34-bde5-bacd29a77101" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:08:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9dc5d520-5c25-4be8-9b8c-d3a5511219f3 req-d223327f-8207-4ecb-8bad-fe526fa37e9b service nova] Acquired lock "refresh_cache-bf7a7308-36a6-4a34-bde5-bacd29a77101" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:08:13 user nova-compute[75391]: DEBUG nova.network.neutron [req-9dc5d520-5c25-4be8-9b8c-d3a5511219f3 req-d223327f-8207-4ecb-8bad-fe526fa37e9b service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Refreshing network info cache for port 53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:08:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:14 user nova-compute[75391]: DEBUG nova.network.neutron [req-9dc5d520-5c25-4be8-9b8c-d3a5511219f3 req-d223327f-8207-4ecb-8bad-fe526fa37e9b service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Updated VIF entry in instance network info cache for port 53ee1144-b72a-431c-9e42-7efd212177b3. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:08:14 user nova-compute[75391]: DEBUG nova.network.neutron [req-9dc5d520-5c25-4be8-9b8c-d3a5511219f3 req-d223327f-8207-4ecb-8bad-fe526fa37e9b service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Updating instance_info_cache with network_info: [{"id": "53ee1144-b72a-431c-9e42-7efd212177b3", "address": "fa:16:3e:98:e2:5a", "network": {"id": "434e7c61-37f4-4a23-be35-6cc6f9842cad", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1311932462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a64dab12ce74d18b3d9414595910180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee1144-b7", "ovs_interfaceid": "53ee1144-b72a-431c-9e42-7efd212177b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:08:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-9dc5d520-5c25-4be8-9b8c-d3a5511219f3 req-d223327f-8207-4ecb-8bad-fe526fa37e9b service nova] Releasing lock "refresh_cache-bf7a7308-36a6-4a34-bde5-bacd29a77101" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:08:15 user nova-compute[75391]: DEBUG nova.compute.manager [None req-1b4555ae-54cf-4e7c-995e-b20418187b23 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 03:08:15 user nova-compute[75391]: DEBUG nova.compute.manager [req-6b01b03c-14f1-4ff1-98ca-b8ac55d19a44 req-e9010e17-6aa1-4f45-b174-f2877a8ed882 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received event network-vif-plugged-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:08:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6b01b03c-14f1-4ff1-98ca-b8ac55d19a44 req-e9010e17-6aa1-4f45-b174-f2877a8ed882 service nova] Acquiring lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:08:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6b01b03c-14f1-4ff1-98ca-b8ac55d19a44 req-e9010e17-6aa1-4f45-b174-f2877a8ed882 service nova] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:08:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-6b01b03c-14f1-4ff1-98ca-b8ac55d19a44 req-e9010e17-6aa1-4f45-b174-f2877a8ed882 service nova] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:08:15 user nova-compute[75391]: DEBUG nova.compute.manager [req-6b01b03c-14f1-4ff1-98ca-b8ac55d19a44 req-e9010e17-6aa1-4f45-b174-f2877a8ed882 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] No waiting events found dispatching network-vif-plugged-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:08:15 user nova-compute[75391]: WARNING nova.compute.manager [req-6b01b03c-14f1-4ff1-98ca-b8ac55d19a44 req-e9010e17-6aa1-4f45-b174-f2877a8ed882 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received unexpected event network-vif-plugged-53ee1144-b72a-431c-9e42-7efd212177b3 for instance with vm_state active and task_state None.
Nov 15 03:08:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:19 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:08:19 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Cleaning up deleted instances {{(pid=75391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 03:08:19 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] There are 0 instances to clean {{(pid=75391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 03:08:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:24 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:08:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Acquiring lock "bf7a7308-36a6-4a34-bde5-bacd29a77101" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:08:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:08:43 user nova-compute[75391]: INFO nova.compute.manager [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Detaching volume cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6
Nov 15 03:08:43 user nova-compute[75391]: INFO nova.virt.block_device [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Attempting to driver detach volume cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 from mountpoint /dev/vdb
Nov 15 03:08:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Attempting to detach device vdb from instance bf7a7308-36a6-4a34-bde5-bacd29a77101 from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 03:08:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 03:08:43 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:08:43 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 03:08:43 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 03:08:43 user nova-compute[75391]:   <serial>cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6</serial>
Nov 15 03:08:43 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 03:08:43 user nova-compute[75391]: </disk>
Nov 15 03:08:43 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 03:08:43 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Successfully detached device vdb from instance bf7a7308-36a6-4a34-bde5-bacd29a77101 from the persistent domain config.
Nov 15 03:08:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bf7a7308-36a6-4a34-bde5-bacd29a77101 from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 03:08:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 03:08:43 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:08:43 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 03:08:43 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 03:08:43 user nova-compute[75391]:   <serial>cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6</serial>
Nov 15 03:08:43 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 03:08:43 user nova-compute[75391]: </disk>
Nov 15 03:08:43 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 03:08:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:44 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bf7a7308-36a6-4a34-bde5-bacd29a77101 {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 03:08:47 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:08:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:08:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:08:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:08:59 user nova-compute[75391]: DEBUG nova.compute.manager [req-944e7421-f816-411a-a5ee-ae20cd41992f req-39f9d809-6b2d-4ea3-a77d-1afe850f0801 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Received event network-changed-32e2af6e-cb96-4616-9dab-781cc8560957 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:08:59 user nova-compute[75391]: DEBUG nova.compute.manager [req-944e7421-f816-411a-a5ee-ae20cd41992f req-39f9d809-6b2d-4ea3-a77d-1afe850f0801 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Refreshing instance network info cache due to event network-changed-32e2af6e-cb96-4616-9dab-781cc8560957. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:08:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-944e7421-f816-411a-a5ee-ae20cd41992f req-39f9d809-6b2d-4ea3-a77d-1afe850f0801 service nova] Acquiring lock "refresh_cache-6036730b-2c7e-4ea9-95f2-9a40eab2fdce" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:08:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-944e7421-f816-411a-a5ee-ae20cd41992f req-39f9d809-6b2d-4ea3-a77d-1afe850f0801 service nova] Acquired lock "refresh_cache-6036730b-2c7e-4ea9-95f2-9a40eab2fdce" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:08:59 user nova-compute[75391]: DEBUG nova.network.neutron [req-944e7421-f816-411a-a5ee-ae20cd41992f req-39f9d809-6b2d-4ea3-a77d-1afe850f0801 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Refreshing network info cache for port 32e2af6e-cb96-4616-9dab-781cc8560957 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:08:59 user nova-compute[75391]: DEBUG nova.network.neutron [req-944e7421-f816-411a-a5ee-ae20cd41992f req-39f9d809-6b2d-4ea3-a77d-1afe850f0801 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Updated VIF entry in instance network info cache for port 32e2af6e-cb96-4616-9dab-781cc8560957. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:08:59 user nova-compute[75391]: DEBUG nova.network.neutron [req-944e7421-f816-411a-a5ee-ae20cd41992f req-39f9d809-6b2d-4ea3-a77d-1afe850f0801 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Updating instance_info_cache with network_info: [{"id": "32e2af6e-cb96-4616-9dab-781cc8560957", "address": "fa:16:3e:fe:fc:98", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e2af6e-cb", "ovs_interfaceid": "32e2af6e-cb96-4616-9dab-781cc8560957", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:08:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-944e7421-f816-411a-a5ee-ae20cd41992f req-39f9d809-6b2d-4ea3-a77d-1afe850f0801 service nova] Releasing lock "refresh_cache-6036730b-2c7e-4ea9-95f2-9a40eab2fdce" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:09:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:09:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:09:01 user nova-compute[75391]: DEBUG nova.objects.instance [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lazy-loading 'flavor' on Instance uuid 6036730b-2c7e-4ea9-95f2-9a40eab2fdce {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:09:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:09:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:09:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:09:01 user nova-compute[75391]: INFO nova.compute.manager [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Attaching volume 9e0dd236-0270-4c46-87e2-6c64157770a6 to /dev/vdb
Nov 15 03:09:01 user nova-compute[75391]: DEBUG os_brick.utils [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:09:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fabe8d8-cc25-4bbc-a462-f1f67a09c2f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[de13f1e4-b9d8-4eb8-8453-e10462277a6b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf7f8e4-f783-45b9-89fe-aad177276f65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c16167-4272-4387-a628-dd8a1c543267]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:09:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 03:09:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:01 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:09:01 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 03:09:01 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e5e891-5fef-44d4-9c0e-11f14a2c78ce]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 03:09:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 03:09:01 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 03:09:01 user nova-compute[75391]: DEBUG os_brick.utils [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:09:01 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Updating existing volume attachment record: 924c0314-3b59-4df7-8e85-b04197611d00 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 03:09:01 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:09:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:09:03 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:09:03 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:09:03 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:09:03 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 03:09:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-bf7a7308-36a6-4a34-bde5-bacd29a77101" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:09:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-bf7a7308-36a6-4a34-bde5-bacd29a77101" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:09:03 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:09:03 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lazy-loading 'info_cache' on Instance uuid bf7a7308-36a6-4a34-bde5-bacd29a77101 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Updating instance_info_cache with network_info: [{"id": "53ee1144-b72a-431c-9e42-7efd212177b3", "address": "fa:16:3e:98:e2:5a", "network": {"id": "434e7c61-37f4-4a23-be35-6cc6f9842cad", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1311932462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a64dab12ce74d18b3d9414595910180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee1144-b7", "ovs_interfaceid": "53ee1144-b72a-431c-9e42-7efd212177b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:09:04 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bf7a7308-36a6-4a34-bde5-bacd29a77101 is timed out.
Nov 15 03:09:04 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Successfully detached device vdb from instance bf7a7308-36a6-4a34-bde5-bacd29a77101 from the live domain config.
Nov 15 03:09:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IeVBgqNx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:09:04 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:09:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-bf7a7308-36a6-4a34-bde5-bacd29a77101" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a179029f-a66f-4b2b-a429-eb113759f2b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 03:09:04 user nova-compute[75391]: No targets found.
Nov 15 03:09:04 user nova-compute[75391]: iSNS:
Nov 15 03:09:04 user nova-compute[75391]: No targets found.
Nov 15 03:09:04 user nova-compute[75391]: STATIC:
Nov 15 03:09:04 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6
Nov 15 03:09:04 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 03:09:04 user nova-compute[75391]:                 Iface Name: default
Nov 15 03:09:04 user nova-compute[75391]: FIRMWARE:
Nov 15 03:09:04 user nova-compute[75391]: No targets found.
Nov 15 03:09:04 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 03:09:04 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 03:09:04 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[256a9297-dd45-4f5c-bfe5-431a0b17818a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdb983d-dde8-4a40-8ba1-47ac56a55151]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 (non-flash)
Nov 15 03:09:04 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 (non-flash)
Nov 15 03:09:04 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f622463cf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6'): ({'sdb'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Removing single pathed devices sdb {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5501b9-5363-4be9-8a37-c3ffd507d491]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c4b9a6-110e-4d3e-8cfd-b8595e92b16b]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Flushing IO for device /dev/sdb {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72af053-f07c-4f31-9de9-9576edd7e1e3]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe32eb0-9708-4b50-ad7f-5ca8cc60ef6f]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf405309-eedc-461c-b38d-87d657365652]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2c81ef-bb2e-4e12-8028-97cd63be3f5e]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6, portal: 172.16.0.220,3260]
Nov 15 03:09:04 user nova-compute[75391]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6, portal: 172.16.0.220,3260] successful.
Nov 15 03:09:04 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6a293a-fa4b-4fb4-a92f-39dc4b927bc6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7549f83-06cf-41e5-b03b-4ff3078f54ef]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] <== disconnect_volume: return (311ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:09:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 03:09:05 user nova-compute[75391]: DEBUG nova.objects.instance [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lazy-loading 'flavor' on Instance uuid bf7a7308-36a6-4a34-bde5-bacd29a77101 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:09:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5a3a81f9-834f-4fb1-a259-acd7e86ea581 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.630s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:09:05 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'afszAeIZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:09:06 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:09:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:09:06 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:09:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:09:06 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2da01c3-a37e-4b85-b6f1-ce50a61c508b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 03:09:06 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98d9a07-c2bb-4386-96c0-80d47d2f8ee7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6] added
Nov 15 03:09:06 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8faa4f-ffd6-4a45-9561-0ede4b942ed2]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[06922751-d93e-4229-9f27-560d82bc3742]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v afszAeIZ {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v afszAeIZ" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b66d3f-df67-4aa6-a259-71a86e22029d]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'afszAeIZ'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[961175f2-1815-454e-b652-5a68eca9b733]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[36390f68-c035-4a77-8ee2-809f938fb6a7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 03:09:06 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 03:09:06 user nova-compute[75391]:  {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:09:06 user nova-compute[75391]: WARNING os_brick.initiator.connectors.iscsi [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 03:09:06 user nova-compute[75391]: 
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[89afd731-325d-4e6b-965f-0d3e5cd9420a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6, portal: 172.16.0.220,3260]
Nov 15 03:09:06 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6, portal: 172.16.0.220,3260] successful.
Nov 15 03:09:06 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c45ed71-6c2f-46f5-84fd-670736109a0e]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2499cb4b-7ecf-4e35-bf52-8060361c060f]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6 (non-flash)
Nov 15 03:09:06 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6 (non-flash)
Nov 15 03:09:06 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c95f5e-6185-4b59-89d2-3bd93645c7fe]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 03:09:06 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:09:07 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 03:09:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'afszAeIZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 03:09:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:09:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26637633737373731', 'path': '/dev/sdb'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:09:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637633737373731', 'path': '/dev/sdb'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 03:09:07 user nova-compute[75391]: DEBUG nova.objects.instance [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lazy-loading 'flavor' on Instance uuid 6036730b-2c7e-4ea9-95f2-9a40eab2fdce {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:09:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 03:09:07 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:09:07 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 03:09:07 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 03:09:07 user nova-compute[75391]:   <serial>9e0dd236-0270-4c46-87e2-6c64157770a6</serial>
Nov 15 03:09:07 user nova-compute[75391]: </disk>
Nov 15 03:09:07 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 03:09:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:09:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:09:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] No VIF found with MAC fa:16:3e:fe:fc:98, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 03:09:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-c9bef43d-de58-416f-9cdc-f34dec26ee3c tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.614s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:09:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:09:08 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:09:08 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:09:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:09:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:09:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:09:08 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:09:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6036730b-2c7e-4ea9-95f2-9a40eab2fdce/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6036730b-2c7e-4ea9-95f2-9a40eab2fdce/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6036730b-2c7e-4ea9-95f2-9a40eab2fdce/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:09:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6036730b-2c7e-4ea9-95f2-9a40eab2fdce/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:09 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 03:09:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:09 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:09:09 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:09:09 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8859MB free_disk=24.898563385009766GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:09:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:09:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:09:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:09:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:09:09 user nova-compute[75391]: INFO nova.compute.manager [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Detaching volume 9e0dd236-0270-4c46-87e2-6c64157770a6
Nov 15 03:09:10 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance bf7a7308-36a6-4a34-bde5-bacd29a77101 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:09:10 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6036730b-2c7e-4ea9-95f2-9a40eab2fdce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:09:10 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:09:10 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:09:10 user nova-compute[75391]: INFO nova.virt.block_device [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Attempting to driver detach volume 9e0dd236-0270-4c46-87e2-6c64157770a6 from mountpoint /dev/vdb
Nov 15 03:09:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Attempting to detach device vdb from instance 6036730b-2c7e-4ea9-95f2-9a40eab2fdce from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 03:09:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 03:09:10 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:09:10 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 03:09:10 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 03:09:10 user nova-compute[75391]:   <serial>9e0dd236-0270-4c46-87e2-6c64157770a6</serial>
Nov 15 03:09:10 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 03:09:10 user nova-compute[75391]: </disk>
Nov 15 03:09:10 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 03:09:10 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Successfully detached device vdb from instance 6036730b-2c7e-4ea9-95f2-9a40eab2fdce from the persistent domain config.
Nov 15 03:09:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6036730b-2c7e-4ea9-95f2-9a40eab2fdce from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 03:09:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 03:09:10 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:09:10 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 03:09:10 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 03:09:10 user nova-compute[75391]:   <serial>9e0dd236-0270-4c46-87e2-6c64157770a6</serial>
Nov 15 03:09:10 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 03:09:10 user nova-compute[75391]: </disk>
Nov 15 03:09:10 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 03:09:10 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:09:10 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:09:10 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:09:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:09:10 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6036730b-2c7e-4ea9-95f2-9a40eab2fdce {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 03:09:10 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_power_states {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:09:10 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid bf7a7308-36a6-4a34-bde5-bacd29a77101 {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 03:09:10 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid 6036730b-2c7e-4ea9-95f2-9a40eab2fdce {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 03:09:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "bf7a7308-36a6-4a34-bde5-bacd29a77101" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:09:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:09:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:09:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:09:12 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:09:12 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:09:12 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:09:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:09:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:09:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:09:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:09:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:09:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:09:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:09:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:09:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:09:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:09:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:09:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:09:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:09:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:09:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:09:30 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6036730b-2c7e-4ea9-95f2-9a40eab2fdce is timed out.
Nov 15 03:09:30 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Successfully detached device vdb from instance 6036730b-2c7e-4ea9-95f2-9a40eab2fdce from the live domain config.
Nov 15 03:09:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'afszAeIZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:09:30 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:09:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd25ac3-5f19-4ec8-b9e5-2362ca07fee4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 03:09:30 user nova-compute[75391]: No targets found.
Nov 15 03:09:30 user nova-compute[75391]: iSNS:
Nov 15 03:09:30 user nova-compute[75391]: No targets found.
Nov 15 03:09:30 user nova-compute[75391]: STATIC:
Nov 15 03:09:30 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6
Nov 15 03:09:30 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 03:09:30 user nova-compute[75391]:                 Iface Name: default
Nov 15 03:09:30 user nova-compute[75391]: FIRMWARE:
Nov 15 03:09:30 user nova-compute[75391]: No targets found.
Nov 15 03:09:30 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 03:09:30 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 03:09:30 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b437141-f291-4799-bd2b-37139adf48e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13f404f-5266-4941-a136-f5a3b2546ec4]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6 (non-flash)
Nov 15 03:09:30 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6 (non-flash)
Nov 15 03:09:30 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f622453d1b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6'): ({'sdb'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Removing single pathed devices sdb {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffb0c0c-b56a-4929-9a49-99d4f70f79bd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b4af90-3931-4ea4-9192-1d136c82ad0e]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Flushing IO for device /dev/sdb {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a589440c-1daa-4f99-a458-0ea9508d7765]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e3b6ff-dedb-4a62-ad16-0eee911e87c1]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[da59a92b-c55f-4416-92e4-2ff64f42cfc1]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52c3737-5573-49cb-b7c7-6c854dbca97f]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6, portal: 172.16.0.220,3260]
Nov 15 03:09:30 user nova-compute[75391]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6, portal: 172.16.0.220,3260] successful.
Nov 15 03:09:30 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e0dd236-0270-4c46-87e2-6c64157770a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f23708-20d1-45bb-a7ec-17ed411dfb58]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] <== disconnect_volume: return (264ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:09:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 03:09:31 user nova-compute[75391]: DEBUG nova.objects.instance [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lazy-loading 'flavor' on Instance uuid 6036730b-2c7e-4ea9-95f2-9a40eab2fdce {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:09:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e309056f-4dcd-47a1-bac8-5571c32e4fb5 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.573s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:09:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 21.004s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:09:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:09:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:09:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:09:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f3be9362-6930-4d71-9660-e09c03804163 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Acquiring lock "bf7a7308-36a6-4a34-bde5-bacd29a77101" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:09:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f3be9362-6930-4d71-9660-e09c03804163 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:09:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f3be9362-6930-4d71-9660-e09c03804163 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Acquiring lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:09:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f3be9362-6930-4d71-9660-e09c03804163 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:09:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f3be9362-6930-4d71-9660-e09c03804163 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:09:34 user nova-compute[75391]: INFO nova.compute.manager [None req-f3be9362-6930-4d71-9660-e09c03804163 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Terminating instance
Nov 15 03:09:34 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f3be9362-6930-4d71-9660-e09c03804163 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 03:09:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:09:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:09:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:09:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:09:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:09:34 user nova-compute[75391]: DEBUG nova.compute.manager [req-8b795165-21e4-4984-9724-9a01b9406bb9 req-efa449d3-3539-40cf-9128-eab1261bebe1 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received event network-vif-unplugged-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:09:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8b795165-21e4-4984-9724-9a01b9406bb9 req-efa449d3-3539-40cf-9128-eab1261bebe1 service nova] Acquiring lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:09:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8b795165-21e4-4984-9724-9a01b9406bb9 req-efa449d3-3539-40cf-9128-eab1261bebe1 service nova] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:09:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8b795165-21e4-4984-9724-9a01b9406bb9 req-efa449d3-3539-40cf-9128-eab1261bebe1 service nova] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:09:34 user nova-compute[75391]: DEBUG nova.compute.manager [req-8b795165-21e4-4984-9724-9a01b9406bb9 req-efa449d3-3539-40cf-9128-eab1261bebe1 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] No waiting events found dispatching network-vif-unplugged-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:09:34 user nova-compute[75391]: DEBUG nova.compute.manager [req-8b795165-21e4-4984-9724-9a01b9406bb9 req-efa449d3-3539-40cf-9128-eab1261bebe1 service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received event network-vif-unplugged-53ee1144-b72a-431c-9e42-7efd212177b3 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 03:09:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:09:35 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Instance destroyed successfully.
Nov 15 03:09:35 user nova-compute[75391]: DEBUG nova.objects.instance [None req-f3be9362-6930-4d71-9660-e09c03804163 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lazy-loading 'resources' on Instance uuid bf7a7308-36a6-4a34-bde5-bacd29a77101 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:09:35 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-f3be9362-6930-4d71-9660-e09c03804163 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:02:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1144670272',display_name='tempest-ServerStableDeviceRescueTest-server-1144670272',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1144670272',id=40,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMF+BI5+VcRTfw7TjGfQSa5zuNaSx3cK49go9Lazpbp+FSmkfPXXz0+tU5ZPdsXBgHoz5XxyPQPvegViPYNbaX34RcJtjgnqsfR1T88wVqzXO6jm1bMSLFqh9Q165b4ybA==',key_name='tempest-keypair-1852285092',keypairs=<?>,launch_index=0,launched_at=2023-11-15T03:06:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a64dab12ce74d18b3d9414595910180',ramdisk_id='',reservation_id='r-e107dfhn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-370419686',owner_user_name='tempest-ServerStableDeviceRescueTest-370419686-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T03:08:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcd0fbcb04e84312b99a82f772a17159',uuid=bf7a7308-36a6-4a34-bde5-bacd29a77101,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53ee1144-b72a-431c-9e42-7efd212177b3", "address": "fa:16:3e:98:e2:5a", "network": {"id": "434e7c61-37f4-4a23-be35-6cc6f9842cad", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1311932462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a64dab12ce74d18b3d9414595910180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee1144-b7", "ovs_interfaceid": "53ee1144-b72a-431c-9e42-7efd212177b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 03:09:35 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f3be9362-6930-4d71-9660-e09c03804163 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Converting VIF {"id": "53ee1144-b72a-431c-9e42-7efd212177b3", "address": "fa:16:3e:98:e2:5a", "network": {"id": "434e7c61-37f4-4a23-be35-6cc6f9842cad", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1311932462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a64dab12ce74d18b3d9414595910180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ee1144-b7", "ovs_interfaceid": "53ee1144-b72a-431c-9e42-7efd212177b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:09:35 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f3be9362-6930-4d71-9660-e09c03804163 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:e2:5a,bridge_name='br-int',has_traffic_filtering=True,id=53ee1144-b72a-431c-9e42-7efd212177b3,network=Network(434e7c61-37f4-4a23-be35-6cc6f9842cad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ee1144-b7') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:09:35 user nova-compute[75391]: DEBUG os_vif [None req-f3be9362-6930-4d71-9660-e09c03804163 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:e2:5a,bridge_name='br-int',has_traffic_filtering=True,id=53ee1144-b72a-431c-9e42-7efd212177b3,network=Network(434e7c61-37f4-4a23-be35-6cc6f9842cad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ee1144-b7') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 03:09:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:09:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53ee1144-b7, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:09:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:09:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:09:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:09:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5079a97-bbd4-442c-a867-22ad1aabac08) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:09:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:09:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:09:35 user nova-compute[75391]: INFO os_vif [None req-f3be9362-6930-4d71-9660-e09c03804163 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:e2:5a,bridge_name='br-int',has_traffic_filtering=True,id=53ee1144-b72a-431c-9e42-7efd212177b3,network=Network(434e7c61-37f4-4a23-be35-6cc6f9842cad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ee1144-b7')
Nov 15 03:09:35 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-f3be9362-6930-4d71-9660-e09c03804163 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Deleting instance files /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101_del
Nov 15 03:09:35 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-f3be9362-6930-4d71-9660-e09c03804163 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Deletion of /opt/stack/data/nova/instances/bf7a7308-36a6-4a34-bde5-bacd29a77101_del complete
Nov 15 03:09:35 user nova-compute[75391]: INFO nova.compute.manager [None req-f3be9362-6930-4d71-9660-e09c03804163 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 15 03:09:35 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-f3be9362-6930-4d71-9660-e09c03804163 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 03:09:35 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 03:09:35 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 03:09:35 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:09:35 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Took 0.63 seconds to deallocate network for instance.
Nov 15 03:09:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f3be9362-6930-4d71-9660-e09c03804163 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:09:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f3be9362-6930-4d71-9660-e09c03804163 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:09:35 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-f3be9362-6930-4d71-9660-e09c03804163 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:09:36 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-f3be9362-6930-4d71-9660-e09c03804163 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:09:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f3be9362-6930-4d71-9660-e09c03804163 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:09:36 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-f3be9362-6930-4d71-9660-e09c03804163 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Deleted allocations for instance bf7a7308-36a6-4a34-bde5-bacd29a77101
Nov 15 03:09:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f3be9362-6930-4d71-9660-e09c03804163 tempest-ServerStableDeviceRescueTest-370419686 tempest-ServerStableDeviceRescueTest-370419686-project-member] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.863s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:09:36 user nova-compute[75391]: DEBUG nova.compute.manager [req-e02bc578-c877-4c18-803a-9180c8a4d5bf req-da39fe5b-32c3-4f96-a81c-7edd6feff33a service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received event network-vif-plugged-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:09:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e02bc578-c877-4c18-803a-9180c8a4d5bf req-da39fe5b-32c3-4f96-a81c-7edd6feff33a service nova] Acquiring lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:09:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e02bc578-c877-4c18-803a-9180c8a4d5bf req-da39fe5b-32c3-4f96-a81c-7edd6feff33a service nova] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:09:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e02bc578-c877-4c18-803a-9180c8a4d5bf req-da39fe5b-32c3-4f96-a81c-7edd6feff33a service nova] Lock "bf7a7308-36a6-4a34-bde5-bacd29a77101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:09:36 user nova-compute[75391]: DEBUG nova.compute.manager [req-e02bc578-c877-4c18-803a-9180c8a4d5bf req-da39fe5b-32c3-4f96-a81c-7edd6feff33a service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] No waiting events found dispatching network-vif-plugged-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:09:36 user nova-compute[75391]: WARNING nova.compute.manager [req-e02bc578-c877-4c18-803a-9180c8a4d5bf req-da39fe5b-32c3-4f96-a81c-7edd6feff33a service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received unexpected event network-vif-plugged-53ee1144-b72a-431c-9e42-7efd212177b3 for instance with vm_state deleted and task_state None.
Nov 15 03:09:36 user nova-compute[75391]: DEBUG nova.compute.manager [req-e02bc578-c877-4c18-803a-9180c8a4d5bf req-da39fe5b-32c3-4f96-a81c-7edd6feff33a service nova] [instance: bf7a7308-36a6-4a34-bde5-bacd29a77101] Received event network-vif-deleted-53ee1144-b72a-431c-9e42-7efd212177b3 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:09:40 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:09:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:09:50 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:09:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:09:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:09:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:09:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:09:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:09:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:09:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-32c621d1-fdef-4aa1-87ca-34c42e7e3215 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:09:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-32c621d1-fdef-4aa1-87ca-34c42e7e3215 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:09:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-32c621d1-fdef-4aa1-87ca-34c42e7e3215 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:09:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-32c621d1-fdef-4aa1-87ca-34c42e7e3215 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:09:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-32c621d1-fdef-4aa1-87ca-34c42e7e3215 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:09:59 user nova-compute[75391]: INFO nova.compute.manager [None req-32c621d1-fdef-4aa1-87ca-34c42e7e3215 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Terminating instance
Nov 15 03:09:59 user nova-compute[75391]: DEBUG nova.compute.manager [None req-32c621d1-fdef-4aa1-87ca-34c42e7e3215 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG nova.compute.manager [req-8baa20f9-8c19-40b4-9dba-ccd8c44d0e00 req-6a58731d-eabf-482c-bb75-ccbf99e25c07 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Received event network-vif-unplugged-32e2af6e-cb96-4616-9dab-781cc8560957 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8baa20f9-8c19-40b4-9dba-ccd8c44d0e00 req-6a58731d-eabf-482c-bb75-ccbf99e25c07 service nova] Acquiring lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8baa20f9-8c19-40b4-9dba-ccd8c44d0e00 req-6a58731d-eabf-482c-bb75-ccbf99e25c07 service nova] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8baa20f9-8c19-40b4-9dba-ccd8c44d0e00 req-6a58731d-eabf-482c-bb75-ccbf99e25c07 service nova] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG nova.compute.manager [req-8baa20f9-8c19-40b4-9dba-ccd8c44d0e00 req-6a58731d-eabf-482c-bb75-ccbf99e25c07 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] No waiting events found dispatching network-vif-unplugged-32e2af6e-cb96-4616-9dab-781cc8560957 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG nova.compute.manager [req-8baa20f9-8c19-40b4-9dba-ccd8c44d0e00 req-6a58731d-eabf-482c-bb75-ccbf99e25c07 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Received event network-vif-unplugged-32e2af6e-cb96-4616-9dab-781cc8560957 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:00 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Instance destroyed successfully.
Nov 15 03:10:00 user nova-compute[75391]: DEBUG nova.objects.instance [None req-32c621d1-fdef-4aa1-87ca-34c42e7e3215 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lazy-loading 'resources' on Instance uuid 6036730b-2c7e-4ea9-95f2-9a40eab2fdce {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-32c621d1-fdef-4aa1-87ca-34c42e7e3215 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:07:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-40782949',display_name='tempest-AttachVolumeNegativeTest-server-40782949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-40782949',id=43,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdUzY3K5Wiq/L5No0OnvghflSShzVifWBi0J9hWhzRyRhPp+uw6P3AHX1VqI4Bn3kUV2juaidCRjlk2EFT3cy/braym449kBgfhAcIP/fkGcm3pLQIohtn9YFWPDakElA==',key_name='tempest-keypair-1185316086',keypairs=<?>,launch_index=0,launched_at=2023-11-15T03:07:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c00f50c42754cea86c68e3e668c0180',ramdisk_id='',reservation_id='r-1p03303o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-941502312',owner_user_name='tempest-AttachVolumeNegativeTest-941502312-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T03:07:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970046cb64de4109bb299f75172b7dd7',uuid=6036730b-2c7e-4ea9-95f2-9a40eab2fdce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32e2af6e-cb96-4616-9dab-781cc8560957", "address": "fa:16:3e:fe:fc:98", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e2af6e-cb", "ovs_interfaceid": "32e2af6e-cb96-4616-9dab-781cc8560957", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-32c621d1-fdef-4aa1-87ca-34c42e7e3215 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Converting VIF {"id": "32e2af6e-cb96-4616-9dab-781cc8560957", "address": "fa:16:3e:fe:fc:98", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e2af6e-cb", "ovs_interfaceid": "32e2af6e-cb96-4616-9dab-781cc8560957", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-32c621d1-fdef-4aa1-87ca-34c42e7e3215 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:fc:98,bridge_name='br-int',has_traffic_filtering=True,id=32e2af6e-cb96-4616-9dab-781cc8560957,network=Network(2109b776-effc-4ec7-ac51-d0408f119253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e2af6e-cb') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG os_vif [None req-32c621d1-fdef-4aa1-87ca-34c42e7e3215 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:fc:98,bridge_name='br-int',has_traffic_filtering=True,id=32e2af6e-cb96-4616-9dab-781cc8560957,network=Network(2109b776-effc-4ec7-ac51-d0408f119253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e2af6e-cb') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32e2af6e-cb, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca1580bf-c2a1-4fe6-87eb-f71d9ea85394) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:10:00 user nova-compute[75391]: INFO os_vif [None req-32c621d1-fdef-4aa1-87ca-34c42e7e3215 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:fc:98,bridge_name='br-int',has_traffic_filtering=True,id=32e2af6e-cb96-4616-9dab-781cc8560957,network=Network(2109b776-effc-4ec7-ac51-d0408f119253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e2af6e-cb')
Nov 15 03:10:00 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-32c621d1-fdef-4aa1-87ca-34c42e7e3215 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Deleting instance files /opt/stack/data/nova/instances/6036730b-2c7e-4ea9-95f2-9a40eab2fdce_del
Nov 15 03:10:00 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-32c621d1-fdef-4aa1-87ca-34c42e7e3215 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Deletion of /opt/stack/data/nova/instances/6036730b-2c7e-4ea9-95f2-9a40eab2fdce_del complete
Nov 15 03:10:00 user nova-compute[75391]: INFO nova.compute.manager [None req-32c621d1-fdef-4aa1-87ca-34c42e7e3215 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 15 03:10:00 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-32c621d1-fdef-4aa1-87ca-34c42e7e3215 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 03:10:00 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 03:10:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:01 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:10:01 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Took 0.70 seconds to deallocate network for instance.
Nov 15 03:10:01 user nova-compute[75391]: DEBUG nova.compute.manager [req-151d6e6a-3446-43f4-990a-f9c03319e341 req-05264075-81bf-4861-8dd5-fdd88de65057 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Received event network-vif-deleted-32e2af6e-cb96-4616-9dab-781cc8560957 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:10:01 user nova-compute[75391]: INFO nova.compute.manager [req-151d6e6a-3446-43f4-990a-f9c03319e341 req-05264075-81bf-4861-8dd5-fdd88de65057 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Neutron deleted interface 32e2af6e-cb96-4616-9dab-781cc8560957; detaching it from the instance and deleting it from the info cache
Nov 15 03:10:01 user nova-compute[75391]: DEBUG nova.network.neutron [req-151d6e6a-3446-43f4-990a-f9c03319e341 req-05264075-81bf-4861-8dd5-fdd88de65057 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:10:01 user nova-compute[75391]: DEBUG nova.compute.manager [req-151d6e6a-3446-43f4-990a-f9c03319e341 req-05264075-81bf-4861-8dd5-fdd88de65057 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Detach interface failed, port_id=32e2af6e-cb96-4616-9dab-781cc8560957, reason: Instance 6036730b-2c7e-4ea9-95f2-9a40eab2fdce could not be found. {{(pid=75391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 03:10:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-32c621d1-fdef-4aa1-87ca-34c42e7e3215 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:10:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-32c621d1-fdef-4aa1-87ca-34c42e7e3215 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:10:01 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-32c621d1-fdef-4aa1-87ca-34c42e7e3215 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:10:01 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-32c621d1-fdef-4aa1-87ca-34c42e7e3215 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:10:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-32c621d1-fdef-4aa1-87ca-34c42e7e3215 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.117s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:10:01 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-32c621d1-fdef-4aa1-87ca-34c42e7e3215 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Deleted allocations for instance 6036730b-2c7e-4ea9-95f2-9a40eab2fdce
Nov 15 03:10:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-32c621d1-fdef-4aa1-87ca-34c42e7e3215 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.872s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:10:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Received event network-vif-plugged-32e2af6e-cb96-4616-9dab-781cc8560957 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:10:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] Acquiring lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:10:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:10:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:10:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] No waiting events found dispatching network-vif-plugged-32e2af6e-cb96-4616-9dab-781cc8560957 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:10:02 user nova-compute[75391]: WARNING nova.compute.manager [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Received unexpected event network-vif-plugged-32e2af6e-cb96-4616-9dab-781cc8560957 for instance with vm_state deleted and task_state None.
Nov 15 03:10:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Received event network-vif-plugged-32e2af6e-cb96-4616-9dab-781cc8560957 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:10:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] Acquiring lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:10:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:10:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:10:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] No waiting events found dispatching network-vif-plugged-32e2af6e-cb96-4616-9dab-781cc8560957 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:10:02 user nova-compute[75391]: WARNING nova.compute.manager [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Received unexpected event network-vif-plugged-32e2af6e-cb96-4616-9dab-781cc8560957 for instance with vm_state deleted and task_state None.
Nov 15 03:10:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Received event network-vif-plugged-32e2af6e-cb96-4616-9dab-781cc8560957 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:10:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] Acquiring lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:10:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:10:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:10:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] No waiting events found dispatching network-vif-plugged-32e2af6e-cb96-4616-9dab-781cc8560957 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:10:02 user nova-compute[75391]: WARNING nova.compute.manager [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Received unexpected event network-vif-plugged-32e2af6e-cb96-4616-9dab-781cc8560957 for instance with vm_state deleted and task_state None.
Nov 15 03:10:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Received event network-vif-unplugged-32e2af6e-cb96-4616-9dab-781cc8560957 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:10:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] Acquiring lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:10:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:10:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:10:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] No waiting events found dispatching network-vif-unplugged-32e2af6e-cb96-4616-9dab-781cc8560957 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:10:02 user nova-compute[75391]: WARNING nova.compute.manager [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Received unexpected event network-vif-unplugged-32e2af6e-cb96-4616-9dab-781cc8560957 for instance with vm_state deleted and task_state None.
Nov 15 03:10:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Received event network-vif-plugged-32e2af6e-cb96-4616-9dab-781cc8560957 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:10:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] Acquiring lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:10:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:10:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] Lock "6036730b-2c7e-4ea9-95f2-9a40eab2fdce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:10:02 user nova-compute[75391]: DEBUG nova.compute.manager [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] No waiting events found dispatching network-vif-plugged-32e2af6e-cb96-4616-9dab-781cc8560957 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:10:02 user nova-compute[75391]: WARNING nova.compute.manager [req-303a59b0-dd3f-4ee2-9e40-34caf0bf4828 req-cfa79738-2166-41b8-885c-1f3627cd85c7 service nova] [instance: 6036730b-2c7e-4ea9-95f2-9a40eab2fdce] Received unexpected event network-vif-plugged-32e2af6e-cb96-4616-9dab-781cc8560957 for instance with vm_state deleted and task_state None.
Nov 15 03:10:02 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:10:05 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:10:05 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:10:05 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:10:05 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Didn't find any instances for network info cache update. {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 03:10:05 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:10:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:06 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:10:08 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:10:08 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:10:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:10:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:10:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:10:08 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:10:09 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:10:09 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:10:09 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=9073MB free_disk=25.05078125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:10:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:10:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:10:09 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:10:09 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:10:09 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:10:09 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:10:09 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:10:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:10:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:10:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:10:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:10:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:10:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:14 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:10:14 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:10:14 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:10:14 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:10:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Acquiring lock "6ab268ce-41f5-4d64-b23f-072c6e061b3d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:10:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "6ab268ce-41f5-4d64-b23f-072c6e061b3d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:10:37 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 03:10:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:10:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:10:37 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 03:10:37 user nova-compute[75391]: INFO nova.compute.claims [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Claim successful on node user
Nov 15 03:10:37 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:10:38 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:10:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.255s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:10:38 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 03:10:38 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 03:10:38 user nova-compute[75391]: DEBUG nova.network.neutron [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 03:10:38 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 03:10:38 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 03:10:38 user nova-compute[75391]: DEBUG nova.policy [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2be875a591641d9aa32e5588c849067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfae1cce998b41a485e8686882f9d524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 03:10:38 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 03:10:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 03:10:38 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Creating image(s)
Nov 15 03:10:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:10:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "/opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:10:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "/opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:10:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:10:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.181s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:10:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:10:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:10:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:10:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.215s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:10:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:10:38 user nova-compute[75391]: DEBUG nova.network.neutron [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Successfully created port: 4fce227a-af16-4fe8-8583-6d547f44654c {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 03:10:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk 1073741824" returned: 0 in 0.049s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:10:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:10:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.172s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Cannot resize image /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Ensure instance console log exists: /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.network.neutron [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Successfully updated port: 4fce227a-af16-4fe8-8583-6d547f44654c {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Acquiring lock "refresh_cache-6ab268ce-41f5-4d64-b23f-072c6e061b3d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Acquired lock "refresh_cache-6ab268ce-41f5-4d64-b23f-072c6e061b3d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.network.neutron [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.compute.manager [req-129e9a6a-a5d9-4648-8358-089738d338b7 req-8979342d-fa1c-4685-be68-d646e327f687 service nova] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Received event network-changed-4fce227a-af16-4fe8-8583-6d547f44654c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.compute.manager [req-129e9a6a-a5d9-4648-8358-089738d338b7 req-8979342d-fa1c-4685-be68-d646e327f687 service nova] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Refreshing instance network info cache due to event network-changed-4fce227a-af16-4fe8-8583-6d547f44654c. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-129e9a6a-a5d9-4648-8358-089738d338b7 req-8979342d-fa1c-4685-be68-d646e327f687 service nova] Acquiring lock "refresh_cache-6ab268ce-41f5-4d64-b23f-072c6e061b3d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.network.neutron [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.network.neutron [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Updating instance_info_cache with network_info: [{"id": "4fce227a-af16-4fe8-8583-6d547f44654c", "address": "fa:16:3e:c9:3b:32", "network": {"id": "8cd30440-88b8-474a-93a2-f521b6dbfeb2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976042029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfae1cce998b41a485e8686882f9d524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fce227a-af", "ovs_interfaceid": "4fce227a-af16-4fe8-8583-6d547f44654c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Releasing lock "refresh_cache-6ab268ce-41f5-4d64-b23f-072c6e061b3d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Instance network_info: |[{"id": "4fce227a-af16-4fe8-8583-6d547f44654c", "address": "fa:16:3e:c9:3b:32", "network": {"id": "8cd30440-88b8-474a-93a2-f521b6dbfeb2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976042029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfae1cce998b41a485e8686882f9d524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fce227a-af", "ovs_interfaceid": "4fce227a-af16-4fe8-8583-6d547f44654c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-129e9a6a-a5d9-4648-8358-089738d338b7 req-8979342d-fa1c-4685-be68-d646e327f687 service nova] Acquired lock "refresh_cache-6ab268ce-41f5-4d64-b23f-072c6e061b3d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.network.neutron [req-129e9a6a-a5d9-4648-8358-089738d338b7 req-8979342d-fa1c-4685-be68-d646e327f687 service nova] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Refreshing network info cache for port 4fce227a-af16-4fe8-8583-6d547f44654c {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Start _get_guest_xml network_info=[{"id": "4fce227a-af16-4fe8-8583-6d547f44654c", "address": "fa:16:3e:c9:3b:32", "network": {"id": "8cd30440-88b8-474a-93a2-f521b6dbfeb2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976042029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfae1cce998b41a485e8686882f9d524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fce227a-af", "ovs_interfaceid": "4fce227a-af16-4fe8-8583-6d547f44654c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 03:10:39 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:10:39 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:10:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-566146823',display_name='tempest-ServersNegativeTestJSON-server-566146823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-566146823',id=44,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfae1cce998b41a485e8686882f9d524',ramdisk_id='',reservation_id='r-08otb3ss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1763001545',owner_user_name='tempest-ServersNegativeTestJSON-1763001545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:10:38Z,user_data=None,user_id='d2be875a591641d9aa32e5588c849067',uuid=6ab268ce-41f5-4d64-b23f-072c6e061b3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fce227a-af16-4fe8-8583-6d547f44654c", "address": "fa:16:3e:c9:3b:32", "network": {"id": "8cd30440-88b8-474a-93a2-f521b6dbfeb2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976042029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfae1cce998b41a485e8686882f9d524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fce227a-af", "ovs_interfaceid": "4fce227a-af16-4fe8-8583-6d547f44654c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Converting VIF {"id": "4fce227a-af16-4fe8-8583-6d547f44654c", "address": "fa:16:3e:c9:3b:32", "network": {"id": "8cd30440-88b8-474a-93a2-f521b6dbfeb2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976042029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfae1cce998b41a485e8686882f9d524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fce227a-af", "ovs_interfaceid": "4fce227a-af16-4fe8-8583-6d547f44654c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:3b:32,bridge_name='br-int',has_traffic_filtering=True,id=4fce227a-af16-4fe8-8583-6d547f44654c,network=Network(8cd30440-88b8-474a-93a2-f521b6dbfeb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fce227a-af') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.objects.instance [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ab268ce-41f5-4d64-b23f-072c6e061b3d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 03:10:39 user nova-compute[75391]:   <uuid>6ab268ce-41f5-4d64-b23f-072c6e061b3d</uuid>
Nov 15 03:10:39 user nova-compute[75391]:   <name>instance-0000002c</name>
Nov 15 03:10:39 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 03:10:39 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 03:10:39 user nova-compute[75391]:   <metadata>
Nov 15 03:10:39 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 03:10:39 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 03:10:39 user nova-compute[75391]:       <nova:name>tempest-ServersNegativeTestJSON-server-566146823</nova:name>
Nov 15 03:10:39 user nova-compute[75391]:       <nova:creationTime>2023-11-15 03:10:39</nova:creationTime>
Nov 15 03:10:39 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 03:10:39 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 03:10:39 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 03:10:39 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 03:10:39 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 03:10:39 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 03:10:39 user nova-compute[75391]:       </nova:flavor>
Nov 15 03:10:39 user nova-compute[75391]:       <nova:owner>
Nov 15 03:10:39 user nova-compute[75391]:         <nova:user uuid="d2be875a591641d9aa32e5588c849067">tempest-ServersNegativeTestJSON-1763001545-project-member</nova:user>
Nov 15 03:10:39 user nova-compute[75391]:         <nova:project uuid="dfae1cce998b41a485e8686882f9d524">tempest-ServersNegativeTestJSON-1763001545</nova:project>
Nov 15 03:10:39 user nova-compute[75391]:       </nova:owner>
Nov 15 03:10:39 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 03:10:39 user nova-compute[75391]:       <nova:ports>
Nov 15 03:10:39 user nova-compute[75391]:         <nova:port uuid="4fce227a-af16-4fe8-8583-6d547f44654c">
Nov 15 03:10:39 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 03:10:39 user nova-compute[75391]:         </nova:port>
Nov 15 03:10:39 user nova-compute[75391]:       </nova:ports>
Nov 15 03:10:39 user nova-compute[75391]:     </nova:instance>
Nov 15 03:10:39 user nova-compute[75391]:   </metadata>
Nov 15 03:10:39 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 03:10:39 user nova-compute[75391]:     <system>
Nov 15 03:10:39 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 03:10:39 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 03:10:39 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 03:10:39 user nova-compute[75391]:       <entry name="serial">6ab268ce-41f5-4d64-b23f-072c6e061b3d</entry>
Nov 15 03:10:39 user nova-compute[75391]:       <entry name="uuid">6ab268ce-41f5-4d64-b23f-072c6e061b3d</entry>
Nov 15 03:10:39 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 03:10:39 user nova-compute[75391]:     </system>
Nov 15 03:10:39 user nova-compute[75391]:   </sysinfo>
Nov 15 03:10:39 user nova-compute[75391]:   <os>
Nov 15 03:10:39 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 03:10:39 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 03:10:39 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 03:10:39 user nova-compute[75391]:   </os>
Nov 15 03:10:39 user nova-compute[75391]:   <features>
Nov 15 03:10:39 user nova-compute[75391]:     <acpi/>
Nov 15 03:10:39 user nova-compute[75391]:     <apic/>
Nov 15 03:10:39 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 03:10:39 user nova-compute[75391]:   </features>
Nov 15 03:10:39 user nova-compute[75391]:   <clock offset="utc">
Nov 15 03:10:39 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 03:10:39 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 03:10:39 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 03:10:39 user nova-compute[75391]:   </clock>
Nov 15 03:10:39 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 03:10:39 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 03:10:39 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 03:10:39 user nova-compute[75391]:   </cpu>
Nov 15 03:10:39 user nova-compute[75391]:   <devices>
Nov 15 03:10:39 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 03:10:39 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 03:10:39 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk"/>
Nov 15 03:10:39 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 03:10:39 user nova-compute[75391]:     </disk>
Nov 15 03:10:39 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 03:10:39 user nova-compute[75391]:       <mac address="fa:16:3e:c9:3b:32"/>
Nov 15 03:10:39 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:10:39 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 03:10:39 user nova-compute[75391]:       <target dev="tap4fce227a-af"/>
Nov 15 03:10:39 user nova-compute[75391]:     </interface>
Nov 15 03:10:39 user nova-compute[75391]:     <serial type="pty">
Nov 15 03:10:39 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/console.log" append="off"/>
Nov 15 03:10:39 user nova-compute[75391]:     </serial>
Nov 15 03:10:39 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 03:10:39 user nova-compute[75391]:     <video>
Nov 15 03:10:39 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:10:39 user nova-compute[75391]:     </video>
Nov 15 03:10:39 user nova-compute[75391]:     <rng model="virtio">
Nov 15 03:10:39 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 03:10:39 user nova-compute[75391]:     </rng>
Nov 15 03:10:39 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 03:10:39 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 03:10:39 user nova-compute[75391]:       <stats period="10"/>
Nov 15 03:10:39 user nova-compute[75391]:     </memballoon>
Nov 15 03:10:39 user nova-compute[75391]:   </devices>
Nov 15 03:10:39 user nova-compute[75391]: </domain>
Nov 15 03:10:39 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:10:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-566146823',display_name='tempest-ServersNegativeTestJSON-server-566146823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-566146823',id=44,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfae1cce998b41a485e8686882f9d524',ramdisk_id='',reservation_id='r-08otb3ss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1763001545',owner_user_name='tempest-ServersNegativeTestJSON-1763001545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:10:38Z,user_data=None,user_id='d2be875a591641d9aa32e5588c849067',uuid=6ab268ce-41f5-4d64-b23f-072c6e061b3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fce227a-af16-4fe8-8583-6d547f44654c", "address": "fa:16:3e:c9:3b:32", "network": {"id": "8cd30440-88b8-474a-93a2-f521b6dbfeb2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976042029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfae1cce998b41a485e8686882f9d524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fce227a-af", "ovs_interfaceid": "4fce227a-af16-4fe8-8583-6d547f44654c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Converting VIF {"id": "4fce227a-af16-4fe8-8583-6d547f44654c", "address": "fa:16:3e:c9:3b:32", "network": {"id": "8cd30440-88b8-474a-93a2-f521b6dbfeb2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976042029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfae1cce998b41a485e8686882f9d524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fce227a-af", "ovs_interfaceid": "4fce227a-af16-4fe8-8583-6d547f44654c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:3b:32,bridge_name='br-int',has_traffic_filtering=True,id=4fce227a-af16-4fe8-8583-6d547f44654c,network=Network(8cd30440-88b8-474a-93a2-f521b6dbfeb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fce227a-af') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG os_vif [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:3b:32,bridge_name='br-int',has_traffic_filtering=True,id=4fce227a-af16-4fe8-8583-6d547f44654c,network=Network(8cd30440-88b8-474a-93a2-f521b6dbfeb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fce227a-af') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d4dab57-13c8-5191-ac3f-0b0baffd3661', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fce227a-af, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4fce227a-af, col_values=(('qos', UUID('1fbef301-a558-4bca-850e-c62b78bfa9f9')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4fce227a-af, col_values=(('external_ids', {'iface-id': '4fce227a-af16-4fe8-8583-6d547f44654c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:3b:32', 'vm-uuid': '6ab268ce-41f5-4d64-b23f-072c6e061b3d'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:39 user nova-compute[75391]: INFO os_vif [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:3b:32,bridge_name='br-int',has_traffic_filtering=True,id=4fce227a-af16-4fe8-8583-6d547f44654c,network=Network(8cd30440-88b8-474a-93a2-f521b6dbfeb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fce227a-af')
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:10:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] No VIF found with MAC fa:16:3e:c9:3b:32, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 03:10:40 user nova-compute[75391]: DEBUG nova.network.neutron [req-129e9a6a-a5d9-4648-8358-089738d338b7 req-8979342d-fa1c-4685-be68-d646e327f687 service nova] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Updated VIF entry in instance network info cache for port 4fce227a-af16-4fe8-8583-6d547f44654c. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:10:40 user nova-compute[75391]: DEBUG nova.network.neutron [req-129e9a6a-a5d9-4648-8358-089738d338b7 req-8979342d-fa1c-4685-be68-d646e327f687 service nova] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Updating instance_info_cache with network_info: [{"id": "4fce227a-af16-4fe8-8583-6d547f44654c", "address": "fa:16:3e:c9:3b:32", "network": {"id": "8cd30440-88b8-474a-93a2-f521b6dbfeb2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976042029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfae1cce998b41a485e8686882f9d524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fce227a-af", "ovs_interfaceid": "4fce227a-af16-4fe8-8583-6d547f44654c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:10:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-129e9a6a-a5d9-4648-8358-089738d338b7 req-8979342d-fa1c-4685-be68-d646e327f687 service nova] Releasing lock "refresh_cache-6ab268ce-41f5-4d64-b23f-072c6e061b3d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:10:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:43 user nova-compute[75391]: DEBUG nova.compute.manager [req-26814a43-e782-43cf-b258-fac34cb84462 req-1f782f81-efd6-4ee9-95bd-e1db87545f66 service nova] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Received event network-vif-plugged-4fce227a-af16-4fe8-8583-6d547f44654c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:10:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-26814a43-e782-43cf-b258-fac34cb84462 req-1f782f81-efd6-4ee9-95bd-e1db87545f66 service nova] Acquiring lock "6ab268ce-41f5-4d64-b23f-072c6e061b3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:10:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-26814a43-e782-43cf-b258-fac34cb84462 req-1f782f81-efd6-4ee9-95bd-e1db87545f66 service nova] Lock "6ab268ce-41f5-4d64-b23f-072c6e061b3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:10:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-26814a43-e782-43cf-b258-fac34cb84462 req-1f782f81-efd6-4ee9-95bd-e1db87545f66 service nova] Lock "6ab268ce-41f5-4d64-b23f-072c6e061b3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:10:43 user nova-compute[75391]: DEBUG nova.compute.manager [req-26814a43-e782-43cf-b258-fac34cb84462 req-1f782f81-efd6-4ee9-95bd-e1db87545f66 service nova] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] No waiting events found dispatching network-vif-plugged-4fce227a-af16-4fe8-8583-6d547f44654c {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:10:43 user nova-compute[75391]: WARNING nova.compute.manager [req-26814a43-e782-43cf-b258-fac34cb84462 req-1f782f81-efd6-4ee9-95bd-e1db87545f66 service nova] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Received unexpected event network-vif-plugged-4fce227a-af16-4fe8-8583-6d547f44654c for instance with vm_state building and task_state spawning.
Nov 15 03:10:43 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 03:10:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 03:10:43 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Instance spawned successfully.
Nov 15 03:10:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 03:10:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:10:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:10:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:10:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:10:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:10:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:10:43 user nova-compute[75391]: INFO nova.compute.manager [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Took 4.99 seconds to spawn the instance on the hypervisor.
Nov 15 03:10:43 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 03:10:43 user nova-compute[75391]: INFO nova.compute.manager [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Took 5.62 seconds to build instance.
Nov 15 03:10:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5de3f58a-5534-44fd-9497-2c99739e9c15 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "6ab268ce-41f5-4d64-b23f-072c6e061b3d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.710s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:10:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:45 user nova-compute[75391]: DEBUG nova.compute.manager [req-3a2bf153-8833-4315-b296-11bf8984ca15 req-10b1bbc6-1e03-4b89-983d-19fc3ef5faf4 service nova] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Received event network-vif-plugged-4fce227a-af16-4fe8-8583-6d547f44654c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:10:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3a2bf153-8833-4315-b296-11bf8984ca15 req-10b1bbc6-1e03-4b89-983d-19fc3ef5faf4 service nova] Acquiring lock "6ab268ce-41f5-4d64-b23f-072c6e061b3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:10:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3a2bf153-8833-4315-b296-11bf8984ca15 req-10b1bbc6-1e03-4b89-983d-19fc3ef5faf4 service nova] Lock "6ab268ce-41f5-4d64-b23f-072c6e061b3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:10:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3a2bf153-8833-4315-b296-11bf8984ca15 req-10b1bbc6-1e03-4b89-983d-19fc3ef5faf4 service nova] Lock "6ab268ce-41f5-4d64-b23f-072c6e061b3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:10:45 user nova-compute[75391]: DEBUG nova.compute.manager [req-3a2bf153-8833-4315-b296-11bf8984ca15 req-10b1bbc6-1e03-4b89-983d-19fc3ef5faf4 service nova] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] No waiting events found dispatching network-vif-plugged-4fce227a-af16-4fe8-8583-6d547f44654c {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:10:45 user nova-compute[75391]: WARNING nova.compute.manager [req-3a2bf153-8833-4315-b296-11bf8984ca15 req-10b1bbc6-1e03-4b89-983d-19fc3ef5faf4 service nova] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Received unexpected event network-vif-plugged-4fce227a-af16-4fe8-8583-6d547f44654c for instance with vm_state active and task_state None.
Nov 15 03:10:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "80ef5798-5000-4b37-90ad-f857bb72badf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:10:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "80ef5798-5000-4b37-90ad-f857bb72badf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:10:53 user nova-compute[75391]: DEBUG nova.compute.manager [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 03:10:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:10:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.007s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:10:53 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 03:10:53 user nova-compute[75391]: INFO nova.compute.claims [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Claim successful on node user
Nov 15 03:10:54 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:10:54 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:10:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.227s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:10:54 user nova-compute[75391]: DEBUG nova.compute.manager [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 03:10:54 user nova-compute[75391]: DEBUG nova.compute.manager [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 03:10:54 user nova-compute[75391]: DEBUG nova.network.neutron [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 03:10:54 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 03:10:54 user nova-compute[75391]: DEBUG nova.compute.manager [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 03:10:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:54 user nova-compute[75391]: DEBUG nova.policy [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '970046cb64de4109bb299f75172b7dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c00f50c42754cea86c68e3e668c0180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 03:10:54 user nova-compute[75391]: DEBUG nova.compute.manager [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 03:10:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 03:10:54 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Creating image(s)
Nov 15 03:10:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "/opt/stack/data/nova/instances/80ef5798-5000-4b37-90ad-f857bb72badf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:10:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "/opt/stack/data/nova/instances/80ef5798-5000-4b37-90ad-f857bb72badf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:10:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "/opt/stack/data/nova/instances/80ef5798-5000-4b37-90ad-f857bb72badf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:10:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:10:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.178s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:10:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:10:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:10:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:10:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.184s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:10:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/80ef5798-5000-4b37-90ad-f857bb72badf/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:10:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/80ef5798-5000-4b37-90ad-f857bb72badf/disk 1073741824" returned: 0 in 0.055s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:10:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:10:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:10:54 user nova-compute[75391]: DEBUG nova.network.neutron [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Successfully created port: f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 03:10:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.182s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:10:54 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80ef5798-5000-4b37-90ad-f857bb72badf/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 03:10:54 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80ef5798-5000-4b37-90ad-f857bb72badf/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:10:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80ef5798-5000-4b37-90ad-f857bb72badf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Cannot resize image /opt/stack/data/nova/instances/80ef5798-5000-4b37-90ad-f857bb72badf/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Ensure instance console log exists: /opt/stack/data/nova/instances/80ef5798-5000-4b37-90ad-f857bb72badf/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.network.neutron [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Successfully updated port: f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "refresh_cache-80ef5798-5000-4b37-90ad-f857bb72badf" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquired lock "refresh_cache-80ef5798-5000-4b37-90ad-f857bb72badf" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.network.neutron [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.compute.manager [req-947b1d83-19c8-4dc0-b8a9-257977e533dc req-aa4d253d-94f5-4c10-9afe-80e0986d52c4 service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Received event network-changed-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.compute.manager [req-947b1d83-19c8-4dc0-b8a9-257977e533dc req-aa4d253d-94f5-4c10-9afe-80e0986d52c4 service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Refreshing instance network info cache due to event network-changed-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-947b1d83-19c8-4dc0-b8a9-257977e533dc req-aa4d253d-94f5-4c10-9afe-80e0986d52c4 service nova] Acquiring lock "refresh_cache-80ef5798-5000-4b37-90ad-f857bb72badf" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.network.neutron [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.network.neutron [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Updating instance_info_cache with network_info: [{"id": "f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9", "address": "fa:16:3e:2f:bf:50", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fcf4a5-68", "ovs_interfaceid": "f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Releasing lock "refresh_cache-80ef5798-5000-4b37-90ad-f857bb72badf" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.compute.manager [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Instance network_info: |[{"id": "f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9", "address": "fa:16:3e:2f:bf:50", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fcf4a5-68", "ovs_interfaceid": "f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-947b1d83-19c8-4dc0-b8a9-257977e533dc req-aa4d253d-94f5-4c10-9afe-80e0986d52c4 service nova] Acquired lock "refresh_cache-80ef5798-5000-4b37-90ad-f857bb72badf" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.network.neutron [req-947b1d83-19c8-4dc0-b8a9-257977e533dc req-aa4d253d-94f5-4c10-9afe-80e0986d52c4 service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Refreshing network info cache for port f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Start _get_guest_xml network_info=[{"id": "f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9", "address": "fa:16:3e:2f:bf:50", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fcf4a5-68", "ovs_interfaceid": "f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 03:10:55 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:10:55 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:10:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-614701514',display_name='tempest-AttachVolumeNegativeTest-server-614701514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-614701514',id=45,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQLpq+bHJX3eHjRxMc2j1PUAnevwfDTbqLBcm/I8USk+OO9JVDI39o7WAbnggFh2ZO6XrU/WZtqOdhmCurwms5VyMvYNYI3AH5ppgB2MD5/AZciLb6Y7ItSVUwcafJyuA==',key_name='tempest-keypair-641954476',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c00f50c42754cea86c68e3e668c0180',ramdisk_id='',reservation_id='r-f4vccpuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-941502312',owner_user_name='tempest-AttachVolumeNegativeTest-941502312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:10:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970046cb64de4109bb299f75172b7dd7',uuid=80ef5798-5000-4b37-90ad-f857bb72badf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9", "address": "fa:16:3e:2f:bf:50", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fcf4a5-68", "ovs_interfaceid": "f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Converting VIF {"id": "f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9", "address": "fa:16:3e:2f:bf:50", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fcf4a5-68", "ovs_interfaceid": "f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:bf:50,bridge_name='br-int',has_traffic_filtering=True,id=f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9,network=Network(2109b776-effc-4ec7-ac51-d0408f119253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2fcf4a5-68') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.objects.instance [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lazy-loading 'pci_devices' on Instance uuid 80ef5798-5000-4b37-90ad-f857bb72badf {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] End _get_guest_xml xml=<domain type="kvm">
Nov 15 03:10:55 user nova-compute[75391]:   <uuid>80ef5798-5000-4b37-90ad-f857bb72badf</uuid>
Nov 15 03:10:55 user nova-compute[75391]:   <name>instance-0000002d</name>
Nov 15 03:10:55 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 03:10:55 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 03:10:55 user nova-compute[75391]:   <metadata>
Nov 15 03:10:55 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 03:10:55 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 03:10:55 user nova-compute[75391]:       <nova:name>tempest-AttachVolumeNegativeTest-server-614701514</nova:name>
Nov 15 03:10:55 user nova-compute[75391]:       <nova:creationTime>2023-11-15 03:10:55</nova:creationTime>
Nov 15 03:10:55 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 03:10:55 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 03:10:55 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 03:10:55 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 03:10:55 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 03:10:55 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 03:10:55 user nova-compute[75391]:       </nova:flavor>
Nov 15 03:10:55 user nova-compute[75391]:       <nova:owner>
Nov 15 03:10:55 user nova-compute[75391]:         <nova:user uuid="970046cb64de4109bb299f75172b7dd7">tempest-AttachVolumeNegativeTest-941502312-project-member</nova:user>
Nov 15 03:10:55 user nova-compute[75391]:         <nova:project uuid="9c00f50c42754cea86c68e3e668c0180">tempest-AttachVolumeNegativeTest-941502312</nova:project>
Nov 15 03:10:55 user nova-compute[75391]:       </nova:owner>
Nov 15 03:10:55 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 03:10:55 user nova-compute[75391]:       <nova:ports>
Nov 15 03:10:55 user nova-compute[75391]:         <nova:port uuid="f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9">
Nov 15 03:10:55 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 03:10:55 user nova-compute[75391]:         </nova:port>
Nov 15 03:10:55 user nova-compute[75391]:       </nova:ports>
Nov 15 03:10:55 user nova-compute[75391]:     </nova:instance>
Nov 15 03:10:55 user nova-compute[75391]:   </metadata>
Nov 15 03:10:55 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 03:10:55 user nova-compute[75391]:     <system>
Nov 15 03:10:55 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 03:10:55 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 03:10:55 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 03:10:55 user nova-compute[75391]:       <entry name="serial">80ef5798-5000-4b37-90ad-f857bb72badf</entry>
Nov 15 03:10:55 user nova-compute[75391]:       <entry name="uuid">80ef5798-5000-4b37-90ad-f857bb72badf</entry>
Nov 15 03:10:55 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 03:10:55 user nova-compute[75391]:     </system>
Nov 15 03:10:55 user nova-compute[75391]:   </sysinfo>
Nov 15 03:10:55 user nova-compute[75391]:   <os>
Nov 15 03:10:55 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 03:10:55 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 03:10:55 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 03:10:55 user nova-compute[75391]:   </os>
Nov 15 03:10:55 user nova-compute[75391]:   <features>
Nov 15 03:10:55 user nova-compute[75391]:     <acpi/>
Nov 15 03:10:55 user nova-compute[75391]:     <apic/>
Nov 15 03:10:55 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 03:10:55 user nova-compute[75391]:   </features>
Nov 15 03:10:55 user nova-compute[75391]:   <clock offset="utc">
Nov 15 03:10:55 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 03:10:55 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 03:10:55 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 03:10:55 user nova-compute[75391]:   </clock>
Nov 15 03:10:55 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 03:10:55 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 03:10:55 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 03:10:55 user nova-compute[75391]:   </cpu>
Nov 15 03:10:55 user nova-compute[75391]:   <devices>
Nov 15 03:10:55 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 03:10:55 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 03:10:55 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/80ef5798-5000-4b37-90ad-f857bb72badf/disk"/>
Nov 15 03:10:55 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 03:10:55 user nova-compute[75391]:     </disk>
Nov 15 03:10:55 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 03:10:55 user nova-compute[75391]:       <mac address="fa:16:3e:2f:bf:50"/>
Nov 15 03:10:55 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:10:55 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 03:10:55 user nova-compute[75391]:       <target dev="tapf2fcf4a5-68"/>
Nov 15 03:10:55 user nova-compute[75391]:     </interface>
Nov 15 03:10:55 user nova-compute[75391]:     <serial type="pty">
Nov 15 03:10:55 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/80ef5798-5000-4b37-90ad-f857bb72badf/console.log" append="off"/>
Nov 15 03:10:55 user nova-compute[75391]:     </serial>
Nov 15 03:10:55 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 03:10:55 user nova-compute[75391]:     <video>
Nov 15 03:10:55 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:10:55 user nova-compute[75391]:     </video>
Nov 15 03:10:55 user nova-compute[75391]:     <rng model="virtio">
Nov 15 03:10:55 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 03:10:55 user nova-compute[75391]:     </rng>
Nov 15 03:10:55 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 03:10:55 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 03:10:55 user nova-compute[75391]:       <stats period="10"/>
Nov 15 03:10:55 user nova-compute[75391]:     </memballoon>
Nov 15 03:10:55 user nova-compute[75391]:   </devices>
Nov 15 03:10:55 user nova-compute[75391]: </domain>
Nov 15 03:10:55 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:10:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-614701514',display_name='tempest-AttachVolumeNegativeTest-server-614701514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-614701514',id=45,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQLpq+bHJX3eHjRxMc2j1PUAnevwfDTbqLBcm/I8USk+OO9JVDI39o7WAbnggFh2ZO6XrU/WZtqOdhmCurwms5VyMvYNYI3AH5ppgB2MD5/AZciLb6Y7ItSVUwcafJyuA==',key_name='tempest-keypair-641954476',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c00f50c42754cea86c68e3e668c0180',ramdisk_id='',reservation_id='r-f4vccpuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-941502312',owner_user_name='tempest-AttachVolumeNegativeTest-941502312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:10:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970046cb64de4109bb299f75172b7dd7',uuid=80ef5798-5000-4b37-90ad-f857bb72badf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9", "address": "fa:16:3e:2f:bf:50", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fcf4a5-68", "ovs_interfaceid": "f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Converting VIF {"id": "f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9", "address": "fa:16:3e:2f:bf:50", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fcf4a5-68", "ovs_interfaceid": "f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:bf:50,bridge_name='br-int',has_traffic_filtering=True,id=f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9,network=Network(2109b776-effc-4ec7-ac51-d0408f119253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2fcf4a5-68') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG os_vif [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:bf:50,bridge_name='br-int',has_traffic_filtering=True,id=f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9,network=Network(2109b776-effc-4ec7-ac51-d0408f119253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2fcf4a5-68') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '51808305-56a2-5dcb-b62d-48645c9e40cb', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2fcf4a5-68, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2fcf4a5-68, col_values=(('qos', UUID('a0a0e4e9-001f-462b-a0b8-479afb6e5d17')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2fcf4a5-68, col_values=(('external_ids', {'iface-id': 'f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:bf:50', 'vm-uuid': '80ef5798-5000-4b37-90ad-f857bb72badf'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:55 user nova-compute[75391]: INFO os_vif [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:bf:50,bridge_name='br-int',has_traffic_filtering=True,id=f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9,network=Network(2109b776-effc-4ec7-ac51-d0408f119253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2fcf4a5-68')
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:10:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] No VIF found with MAC fa:16:3e:2f:bf:50, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 03:10:56 user nova-compute[75391]: DEBUG nova.network.neutron [req-947b1d83-19c8-4dc0-b8a9-257977e533dc req-aa4d253d-94f5-4c10-9afe-80e0986d52c4 service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Updated VIF entry in instance network info cache for port f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:10:56 user nova-compute[75391]: DEBUG nova.network.neutron [req-947b1d83-19c8-4dc0-b8a9-257977e533dc req-aa4d253d-94f5-4c10-9afe-80e0986d52c4 service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Updating instance_info_cache with network_info: [{"id": "f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9", "address": "fa:16:3e:2f:bf:50", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fcf4a5-68", "ovs_interfaceid": "f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:10:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-947b1d83-19c8-4dc0-b8a9-257977e533dc req-aa4d253d-94f5-4c10-9afe-80e0986d52c4 service nova] Releasing lock "refresh_cache-80ef5798-5000-4b37-90ad-f857bb72badf" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:10:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:57 user nova-compute[75391]: DEBUG nova.compute.manager [req-cf2186e5-7dd3-405d-89cb-e779face8b05 req-1dd19695-3cae-40f7-9c43-07174e6aca8b service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Received event network-vif-plugged-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:10:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-cf2186e5-7dd3-405d-89cb-e779face8b05 req-1dd19695-3cae-40f7-9c43-07174e6aca8b service nova] Acquiring lock "80ef5798-5000-4b37-90ad-f857bb72badf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:10:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-cf2186e5-7dd3-405d-89cb-e779face8b05 req-1dd19695-3cae-40f7-9c43-07174e6aca8b service nova] Lock "80ef5798-5000-4b37-90ad-f857bb72badf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:10:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-cf2186e5-7dd3-405d-89cb-e779face8b05 req-1dd19695-3cae-40f7-9c43-07174e6aca8b service nova] Lock "80ef5798-5000-4b37-90ad-f857bb72badf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:10:57 user nova-compute[75391]: DEBUG nova.compute.manager [req-cf2186e5-7dd3-405d-89cb-e779face8b05 req-1dd19695-3cae-40f7-9c43-07174e6aca8b service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] No waiting events found dispatching network-vif-plugged-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:10:57 user nova-compute[75391]: WARNING nova.compute.manager [req-cf2186e5-7dd3-405d-89cb-e779face8b05 req-1dd19695-3cae-40f7-9c43-07174e6aca8b service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Received unexpected event network-vif-plugged-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 for instance with vm_state building and task_state spawning.
Nov 15 03:10:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:10:59 user nova-compute[75391]: DEBUG nova.compute.manager [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 03:10:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 03:10:59 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Instance spawned successfully.
Nov 15 03:10:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 03:10:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:10:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:10:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:10:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:10:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:10:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:10:59 user nova-compute[75391]: INFO nova.compute.manager [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Took 5.16 seconds to spawn the instance on the hypervisor.
Nov 15 03:10:59 user nova-compute[75391]: DEBUG nova.compute.manager [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 03:10:59 user nova-compute[75391]: INFO nova.compute.manager [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Took 5.74 seconds to build instance.
Nov 15 03:10:59 user nova-compute[75391]: DEBUG nova.compute.manager [req-7509e28f-7f55-472f-bbfb-abb88f3661eb req-fdc5281b-7758-45a3-bd21-a0e9edb67eeb service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Received event network-vif-plugged-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:10:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7509e28f-7f55-472f-bbfb-abb88f3661eb req-fdc5281b-7758-45a3-bd21-a0e9edb67eeb service nova] Acquiring lock "80ef5798-5000-4b37-90ad-f857bb72badf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:10:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7509e28f-7f55-472f-bbfb-abb88f3661eb req-fdc5281b-7758-45a3-bd21-a0e9edb67eeb service nova] Lock "80ef5798-5000-4b37-90ad-f857bb72badf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:10:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-7509e28f-7f55-472f-bbfb-abb88f3661eb req-fdc5281b-7758-45a3-bd21-a0e9edb67eeb service nova] Lock "80ef5798-5000-4b37-90ad-f857bb72badf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:10:59 user nova-compute[75391]: DEBUG nova.compute.manager [req-7509e28f-7f55-472f-bbfb-abb88f3661eb req-fdc5281b-7758-45a3-bd21-a0e9edb67eeb service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] No waiting events found dispatching network-vif-plugged-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:10:59 user nova-compute[75391]: WARNING nova.compute.manager [req-7509e28f-7f55-472f-bbfb-abb88f3661eb req-fdc5281b-7758-45a3-bd21-a0e9edb67eeb service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Received unexpected event network-vif-plugged-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 for instance with vm_state active and task_state None.
Nov 15 03:10:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98619050-7e65-47ac-a58f-5f2073572de7 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "80ef5798-5000-4b37-90ad-f857bb72badf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.997s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:11:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:11:02 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:11:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:11:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:11:06 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:11:06 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:11:07 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:11:07 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:11:07 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 03:11:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-6ab268ce-41f5-4d64-b23f-072c6e061b3d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:11:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-6ab268ce-41f5-4d64-b23f-072c6e061b3d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:11:07 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:11:07 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lazy-loading 'info_cache' on Instance uuid 6ab268ce-41f5-4d64-b23f-072c6e061b3d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:11:08 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Updating instance_info_cache with network_info: [{"id": "4fce227a-af16-4fe8-8583-6d547f44654c", "address": "fa:16:3e:c9:3b:32", "network": {"id": "8cd30440-88b8-474a-93a2-f521b6dbfeb2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976042029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfae1cce998b41a485e8686882f9d524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fce227a-af", "ovs_interfaceid": "4fce227a-af16-4fe8-8583-6d547f44654c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:11:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-6ab268ce-41f5-4d64-b23f-072c6e061b3d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:11:08 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:11:08 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:11:08 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:11:08 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:11:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:11:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:11:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:11:08 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:11:08 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:11:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:11:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:11:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:11:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:11:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80ef5798-5000-4b37-90ad-f857bb72badf/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:11:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80ef5798-5000-4b37-90ad-f857bb72badf/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:11:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80ef5798-5000-4b37-90ad-f857bb72badf/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:11:09 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80ef5798-5000-4b37-90ad-f857bb72badf/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:11:09 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:11:09 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:11:09 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8725MB free_disk=25.019500732421875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:11:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:11:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:11:09 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6ab268ce-41f5-4d64-b23f-072c6e061b3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:11:09 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 80ef5798-5000-4b37-90ad-f857bb72badf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:11:09 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:11:09 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:11:10 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:11:10 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:11:10 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:11:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:11:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:11:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:11:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:11:16 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:11:16 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:11:16 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:11:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:11:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:11:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:11:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:11:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:11:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:11:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:11:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:11:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:11:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:11:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:11:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:11:40 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:11:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:11:50 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:11:50 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:11:50 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:11:50 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:11:50 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:11:50 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:11:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:12:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:12:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:12:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:12:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:03 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:12:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:06 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:12:07 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:12:08 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:12:08 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:12:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-80ef5798-5000-4b37-90ad-f857bb72badf" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:12:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-80ef5798-5000-4b37-90ad-f857bb72badf" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:12:08 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:12:09 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Updating instance_info_cache with network_info: [{"id": "f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9", "address": "fa:16:3e:2f:bf:50", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fcf4a5-68", "ovs_interfaceid": "f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:12:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-80ef5798-5000-4b37-90ad-f857bb72badf" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:12:09 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:12:09 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:12:09 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:12:10 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:12:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:12:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:12:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:12:10 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:12:10 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:12:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:10 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:12:10 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:12:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:12:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80ef5798-5000-4b37-90ad-f857bb72badf/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:12:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80ef5798-5000-4b37-90ad-f857bb72badf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:12:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80ef5798-5000-4b37-90ad-f857bb72badf/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:12:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80ef5798-5000-4b37-90ad-f857bb72badf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:12:11 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:12:11 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:12:11 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8877MB free_disk=24.990909576416016GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:12:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:12:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:12:12 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6ab268ce-41f5-4d64-b23f-072c6e061b3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:12:12 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 80ef5798-5000-4b37-90ad-f857bb72badf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:12:12 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:12:12 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:12:12 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:12:12 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:12:12 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:12:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:12:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:12:16 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:12:16 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:12:16 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:12:16 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:12:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:12:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:12:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:12:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:12:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:12:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:12:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:12:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:12:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Acquiring lock "94544212-b8ee-4843-9202-e68240766874" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:12:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "94544212-b8ee-4843-9202-e68240766874" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:12:28 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 03:12:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:12:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:12:28 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 03:12:28 user nova-compute[75391]: INFO nova.compute.claims [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Claim successful on node user
Nov 15 03:12:29 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:12:29 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:12:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.227s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:12:29 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 03:12:29 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 03:12:29 user nova-compute[75391]: DEBUG nova.network.neutron [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 03:12:29 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 03:12:29 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 03:12:29 user nova-compute[75391]: DEBUG nova.policy [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2be875a591641d9aa32e5588c849067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfae1cce998b41a485e8686882f9d524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 03:12:29 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 03:12:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 03:12:29 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Creating image(s)
Nov 15 03:12:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Acquiring lock "/opt/stack/data/nova/instances/94544212-b8ee-4843-9202-e68240766874/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:12:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "/opt/stack/data/nova/instances/94544212-b8ee-4843-9202-e68240766874/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:12:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "/opt/stack/data/nova/instances/94544212-b8ee-4843-9202-e68240766874/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:12:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:12:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.176s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:12:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:12:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:12:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:12:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.187s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:12:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/94544212-b8ee-4843-9202-e68240766874/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:12:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/94544212-b8ee-4843-9202-e68240766874/disk 1073741824" returned: 0 in 0.052s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:12:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:12:29 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.network.neutron [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Successfully created port: 33664bdf-0e65-4e6a-a73d-f482b89e233c {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.188s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94544212-b8ee-4843-9202-e68240766874/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94544212-b8ee-4843-9202-e68240766874/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94544212-b8ee-4843-9202-e68240766874/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Cannot resize image /opt/stack/data/nova/instances/94544212-b8ee-4843-9202-e68240766874/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Ensure instance console log exists: /opt/stack/data/nova/instances/94544212-b8ee-4843-9202-e68240766874/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.network.neutron [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Successfully updated port: 33664bdf-0e65-4e6a-a73d-f482b89e233c {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Acquiring lock "refresh_cache-94544212-b8ee-4843-9202-e68240766874" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Acquired lock "refresh_cache-94544212-b8ee-4843-9202-e68240766874" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.network.neutron [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.compute.manager [req-ca19bbd9-2040-4298-b8c9-c680ac1daab3 req-650c73b8-bb34-46ab-9a20-493191cc62c0 service nova] [instance: 94544212-b8ee-4843-9202-e68240766874] Received event network-changed-33664bdf-0e65-4e6a-a73d-f482b89e233c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.compute.manager [req-ca19bbd9-2040-4298-b8c9-c680ac1daab3 req-650c73b8-bb34-46ab-9a20-493191cc62c0 service nova] [instance: 94544212-b8ee-4843-9202-e68240766874] Refreshing instance network info cache due to event network-changed-33664bdf-0e65-4e6a-a73d-f482b89e233c. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ca19bbd9-2040-4298-b8c9-c680ac1daab3 req-650c73b8-bb34-46ab-9a20-493191cc62c0 service nova] Acquiring lock "refresh_cache-94544212-b8ee-4843-9202-e68240766874" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.network.neutron [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.network.neutron [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Updating instance_info_cache with network_info: [{"id": "33664bdf-0e65-4e6a-a73d-f482b89e233c", "address": "fa:16:3e:d3:c1:cd", "network": {"id": "8cd30440-88b8-474a-93a2-f521b6dbfeb2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976042029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfae1cce998b41a485e8686882f9d524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33664bdf-0e", "ovs_interfaceid": "33664bdf-0e65-4e6a-a73d-f482b89e233c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Releasing lock "refresh_cache-94544212-b8ee-4843-9202-e68240766874" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Instance network_info: |[{"id": "33664bdf-0e65-4e6a-a73d-f482b89e233c", "address": "fa:16:3e:d3:c1:cd", "network": {"id": "8cd30440-88b8-474a-93a2-f521b6dbfeb2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976042029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfae1cce998b41a485e8686882f9d524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33664bdf-0e", "ovs_interfaceid": "33664bdf-0e65-4e6a-a73d-f482b89e233c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ca19bbd9-2040-4298-b8c9-c680ac1daab3 req-650c73b8-bb34-46ab-9a20-493191cc62c0 service nova] Acquired lock "refresh_cache-94544212-b8ee-4843-9202-e68240766874" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.network.neutron [req-ca19bbd9-2040-4298-b8c9-c680ac1daab3 req-650c73b8-bb34-46ab-9a20-493191cc62c0 service nova] [instance: 94544212-b8ee-4843-9202-e68240766874] Refreshing network info cache for port 33664bdf-0e65-4e6a-a73d-f482b89e233c {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Start _get_guest_xml network_info=[{"id": "33664bdf-0e65-4e6a-a73d-f482b89e233c", "address": "fa:16:3e:d3:c1:cd", "network": {"id": "8cd30440-88b8-474a-93a2-f521b6dbfeb2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976042029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfae1cce998b41a485e8686882f9d524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33664bdf-0e", "ovs_interfaceid": "33664bdf-0e65-4e6a-a73d-f482b89e233c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 03:12:30 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:12:30 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:12:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-649782120',display_name='tempest-ServersNegativeTestJSON-server-649782120',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-649782120',id=46,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfae1cce998b41a485e8686882f9d524',ramdisk_id='',reservation_id='r-5jo8ocjo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1763001545',owner_user_name='tempest-ServersNegativeTestJSON-1763001545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:12:29Z,user_data=None,user_id='d2be875a591641d9aa32e5588c849067',uuid=94544212-b8ee-4843-9202-e68240766874,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33664bdf-0e65-4e6a-a73d-f482b89e233c", "address": "fa:16:3e:d3:c1:cd", "network": {"id": "8cd30440-88b8-474a-93a2-f521b6dbfeb2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976042029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfae1cce998b41a485e8686882f9d524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33664bdf-0e", "ovs_interfaceid": "33664bdf-0e65-4e6a-a73d-f482b89e233c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Converting VIF {"id": "33664bdf-0e65-4e6a-a73d-f482b89e233c", "address": "fa:16:3e:d3:c1:cd", "network": {"id": "8cd30440-88b8-474a-93a2-f521b6dbfeb2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976042029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfae1cce998b41a485e8686882f9d524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33664bdf-0e", "ovs_interfaceid": "33664bdf-0e65-4e6a-a73d-f482b89e233c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:c1:cd,bridge_name='br-int',has_traffic_filtering=True,id=33664bdf-0e65-4e6a-a73d-f482b89e233c,network=Network(8cd30440-88b8-474a-93a2-f521b6dbfeb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33664bdf-0e') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.objects.instance [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lazy-loading 'pci_devices' on Instance uuid 94544212-b8ee-4843-9202-e68240766874 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:12:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] End _get_guest_xml xml=<domain type="kvm">
Nov 15 03:12:30 user nova-compute[75391]:   <uuid>94544212-b8ee-4843-9202-e68240766874</uuid>
Nov 15 03:12:30 user nova-compute[75391]:   <name>instance-0000002e</name>
Nov 15 03:12:30 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 03:12:30 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 03:12:30 user nova-compute[75391]:   <metadata>
Nov 15 03:12:30 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 03:12:30 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 03:12:30 user nova-compute[75391]:       <nova:name>tempest-ServersNegativeTestJSON-server-649782120</nova:name>
Nov 15 03:12:30 user nova-compute[75391]:       <nova:creationTime>2023-11-15 03:12:30</nova:creationTime>
Nov 15 03:12:30 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 03:12:30 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 03:12:30 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 03:12:30 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 03:12:30 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 03:12:30 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 03:12:30 user nova-compute[75391]:       </nova:flavor>
Nov 15 03:12:30 user nova-compute[75391]:       <nova:owner>
Nov 15 03:12:30 user nova-compute[75391]:         <nova:user uuid="d2be875a591641d9aa32e5588c849067">tempest-ServersNegativeTestJSON-1763001545-project-member</nova:user>
Nov 15 03:12:30 user nova-compute[75391]:         <nova:project uuid="dfae1cce998b41a485e8686882f9d524">tempest-ServersNegativeTestJSON-1763001545</nova:project>
Nov 15 03:12:30 user nova-compute[75391]:       </nova:owner>
Nov 15 03:12:30 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 03:12:30 user nova-compute[75391]:       <nova:ports>
Nov 15 03:12:30 user nova-compute[75391]:         <nova:port uuid="33664bdf-0e65-4e6a-a73d-f482b89e233c">
Nov 15 03:12:30 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 03:12:30 user nova-compute[75391]:         </nova:port>
Nov 15 03:12:30 user nova-compute[75391]:       </nova:ports>
Nov 15 03:12:30 user nova-compute[75391]:     </nova:instance>
Nov 15 03:12:30 user nova-compute[75391]:   </metadata>
Nov 15 03:12:30 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 03:12:30 user nova-compute[75391]:     <system>
Nov 15 03:12:30 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 03:12:30 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 03:12:30 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 03:12:30 user nova-compute[75391]:       <entry name="serial">94544212-b8ee-4843-9202-e68240766874</entry>
Nov 15 03:12:30 user nova-compute[75391]:       <entry name="uuid">94544212-b8ee-4843-9202-e68240766874</entry>
Nov 15 03:12:30 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 03:12:30 user nova-compute[75391]:     </system>
Nov 15 03:12:30 user nova-compute[75391]:   </sysinfo>
Nov 15 03:12:30 user nova-compute[75391]:   <os>
Nov 15 03:12:30 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 03:12:30 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 03:12:30 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 03:12:30 user nova-compute[75391]:   </os>
Nov 15 03:12:30 user nova-compute[75391]:   <features>
Nov 15 03:12:30 user nova-compute[75391]:     <acpi/>
Nov 15 03:12:30 user nova-compute[75391]:     <apic/>
Nov 15 03:12:30 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 03:12:30 user nova-compute[75391]:   </features>
Nov 15 03:12:30 user nova-compute[75391]:   <clock offset="utc">
Nov 15 03:12:30 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 03:12:30 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 03:12:30 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 03:12:30 user nova-compute[75391]:   </clock>
Nov 15 03:12:30 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 03:12:30 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 03:12:30 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 03:12:30 user nova-compute[75391]:   </cpu>
Nov 15 03:12:30 user nova-compute[75391]:   <devices>
Nov 15 03:12:30 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 03:12:30 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 03:12:30 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/94544212-b8ee-4843-9202-e68240766874/disk"/>
Nov 15 03:12:30 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 03:12:30 user nova-compute[75391]:     </disk>
Nov 15 03:12:30 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 03:12:30 user nova-compute[75391]:       <mac address="fa:16:3e:d3:c1:cd"/>
Nov 15 03:12:30 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:12:30 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 03:12:30 user nova-compute[75391]:       <target dev="tap33664bdf-0e"/>
Nov 15 03:12:30 user nova-compute[75391]:     </interface>
Nov 15 03:12:30 user nova-compute[75391]:     <serial type="pty">
Nov 15 03:12:30 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/94544212-b8ee-4843-9202-e68240766874/console.log" append="off"/>
Nov 15 03:12:30 user nova-compute[75391]:     </serial>
Nov 15 03:12:30 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 03:12:30 user nova-compute[75391]:     <video>
Nov 15 03:12:30 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:12:30 user nova-compute[75391]:     </video>
Nov 15 03:12:30 user nova-compute[75391]:     <rng model="virtio">
Nov 15 03:12:30 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 03:12:30 user nova-compute[75391]:     </rng>
Nov 15 03:12:30 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 03:12:30 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 03:12:30 user nova-compute[75391]:       <stats period="10"/>
Nov 15 03:12:30 user nova-compute[75391]:     </memballoon>
Nov 15 03:12:30 user nova-compute[75391]:   </devices>
Nov 15 03:12:30 user nova-compute[75391]: </domain>
Nov 15 03:12:30 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 03:12:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:12:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-649782120',display_name='tempest-ServersNegativeTestJSON-server-649782120',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-649782120',id=46,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfae1cce998b41a485e8686882f9d524',ramdisk_id='',reservation_id='r-5jo8ocjo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1763001545',owner_user_name='tempest-ServersNegativeTestJSON-1763001545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:12:29Z,user_data=None,user_id='d2be875a591641d9aa32e5588c849067',uuid=94544212-b8ee-4843-9202-e68240766874,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33664bdf-0e65-4e6a-a73d-f482b89e233c", "address": "fa:16:3e:d3:c1:cd", "network": {"id": "8cd30440-88b8-474a-93a2-f521b6dbfeb2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976042029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfae1cce998b41a485e8686882f9d524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33664bdf-0e", "ovs_interfaceid": "33664bdf-0e65-4e6a-a73d-f482b89e233c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 03:12:31 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Converting VIF {"id": "33664bdf-0e65-4e6a-a73d-f482b89e233c", "address": "fa:16:3e:d3:c1:cd", "network": {"id": "8cd30440-88b8-474a-93a2-f521b6dbfeb2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976042029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfae1cce998b41a485e8686882f9d524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33664bdf-0e", "ovs_interfaceid": "33664bdf-0e65-4e6a-a73d-f482b89e233c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:12:31 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:c1:cd,bridge_name='br-int',has_traffic_filtering=True,id=33664bdf-0e65-4e6a-a73d-f482b89e233c,network=Network(8cd30440-88b8-474a-93a2-f521b6dbfeb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33664bdf-0e') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:12:31 user nova-compute[75391]: DEBUG os_vif [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:c1:cd,bridge_name='br-int',has_traffic_filtering=True,id=33664bdf-0e65-4e6a-a73d-f482b89e233c,network=Network(8cd30440-88b8-474a-93a2-f521b6dbfeb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33664bdf-0e') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 03:12:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:12:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 03:12:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57af8d3c-ea9f-5c7d-bb2d-0072a06b67c1', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:12:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:12:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33664bdf-0e, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:12:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap33664bdf-0e, col_values=(('qos', UUID('75d201ae-5b2c-4e09-abda-e30ff1811ccd')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:12:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap33664bdf-0e, col_values=(('external_ids', {'iface-id': '33664bdf-0e65-4e6a-a73d-f482b89e233c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:c1:cd', 'vm-uuid': '94544212-b8ee-4843-9202-e68240766874'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:12:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:12:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:31 user nova-compute[75391]: INFO os_vif [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:c1:cd,bridge_name='br-int',has_traffic_filtering=True,id=33664bdf-0e65-4e6a-a73d-f482b89e233c,network=Network(8cd30440-88b8-474a-93a2-f521b6dbfeb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33664bdf-0e')
Nov 15 03:12:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:12:31 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] No VIF found with MAC fa:16:3e:d3:c1:cd, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 03:12:31 user nova-compute[75391]: DEBUG nova.network.neutron [req-ca19bbd9-2040-4298-b8c9-c680ac1daab3 req-650c73b8-bb34-46ab-9a20-493191cc62c0 service nova] [instance: 94544212-b8ee-4843-9202-e68240766874] Updated VIF entry in instance network info cache for port 33664bdf-0e65-4e6a-a73d-f482b89e233c. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:12:31 user nova-compute[75391]: DEBUG nova.network.neutron [req-ca19bbd9-2040-4298-b8c9-c680ac1daab3 req-650c73b8-bb34-46ab-9a20-493191cc62c0 service nova] [instance: 94544212-b8ee-4843-9202-e68240766874] Updating instance_info_cache with network_info: [{"id": "33664bdf-0e65-4e6a-a73d-f482b89e233c", "address": "fa:16:3e:d3:c1:cd", "network": {"id": "8cd30440-88b8-474a-93a2-f521b6dbfeb2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976042029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfae1cce998b41a485e8686882f9d524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33664bdf-0e", "ovs_interfaceid": "33664bdf-0e65-4e6a-a73d-f482b89e233c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:12:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ca19bbd9-2040-4298-b8c9-c680ac1daab3 req-650c73b8-bb34-46ab-9a20-493191cc62c0 service nova] Releasing lock "refresh_cache-94544212-b8ee-4843-9202-e68240766874" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:12:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:32 user nova-compute[75391]: DEBUG nova.compute.manager [req-b38c13ea-8a08-43fd-a9fa-ebfab9113bd4 req-285bd52e-c4bd-4745-958d-3336208e6081 service nova] [instance: 94544212-b8ee-4843-9202-e68240766874] Received event network-vif-plugged-33664bdf-0e65-4e6a-a73d-f482b89e233c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:12:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b38c13ea-8a08-43fd-a9fa-ebfab9113bd4 req-285bd52e-c4bd-4745-958d-3336208e6081 service nova] Acquiring lock "94544212-b8ee-4843-9202-e68240766874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:12:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b38c13ea-8a08-43fd-a9fa-ebfab9113bd4 req-285bd52e-c4bd-4745-958d-3336208e6081 service nova] Lock "94544212-b8ee-4843-9202-e68240766874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:12:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b38c13ea-8a08-43fd-a9fa-ebfab9113bd4 req-285bd52e-c4bd-4745-958d-3336208e6081 service nova] Lock "94544212-b8ee-4843-9202-e68240766874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:12:32 user nova-compute[75391]: DEBUG nova.compute.manager [req-b38c13ea-8a08-43fd-a9fa-ebfab9113bd4 req-285bd52e-c4bd-4745-958d-3336208e6081 service nova] [instance: 94544212-b8ee-4843-9202-e68240766874] No waiting events found dispatching network-vif-plugged-33664bdf-0e65-4e6a-a73d-f482b89e233c {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:12:32 user nova-compute[75391]: WARNING nova.compute.manager [req-b38c13ea-8a08-43fd-a9fa-ebfab9113bd4 req-285bd52e-c4bd-4745-958d-3336208e6081 service nova] [instance: 94544212-b8ee-4843-9202-e68240766874] Received unexpected event network-vif-plugged-33664bdf-0e65-4e6a-a73d-f482b89e233c for instance with vm_state building and task_state spawning.
Nov 15 03:12:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:34 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 03:12:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 03:12:34 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 94544212-b8ee-4843-9202-e68240766874] Instance spawned successfully.
Nov 15 03:12:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 03:12:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:12:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:12:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:12:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:12:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:12:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:12:34 user nova-compute[75391]: DEBUG nova.compute.manager [req-41e99340-426e-4eb9-93ac-348e9e3c633f req-2dc4a41b-9c6c-4353-bb5b-2ca416d4361a service nova] [instance: 94544212-b8ee-4843-9202-e68240766874] Received event network-vif-plugged-33664bdf-0e65-4e6a-a73d-f482b89e233c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:12:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-41e99340-426e-4eb9-93ac-348e9e3c633f req-2dc4a41b-9c6c-4353-bb5b-2ca416d4361a service nova] Acquiring lock "94544212-b8ee-4843-9202-e68240766874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:12:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-41e99340-426e-4eb9-93ac-348e9e3c633f req-2dc4a41b-9c6c-4353-bb5b-2ca416d4361a service nova] Lock "94544212-b8ee-4843-9202-e68240766874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:12:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-41e99340-426e-4eb9-93ac-348e9e3c633f req-2dc4a41b-9c6c-4353-bb5b-2ca416d4361a service nova] Lock "94544212-b8ee-4843-9202-e68240766874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:12:34 user nova-compute[75391]: DEBUG nova.compute.manager [req-41e99340-426e-4eb9-93ac-348e9e3c633f req-2dc4a41b-9c6c-4353-bb5b-2ca416d4361a service nova] [instance: 94544212-b8ee-4843-9202-e68240766874] No waiting events found dispatching network-vif-plugged-33664bdf-0e65-4e6a-a73d-f482b89e233c {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:12:34 user nova-compute[75391]: WARNING nova.compute.manager [req-41e99340-426e-4eb9-93ac-348e9e3c633f req-2dc4a41b-9c6c-4353-bb5b-2ca416d4361a service nova] [instance: 94544212-b8ee-4843-9202-e68240766874] Received unexpected event network-vif-plugged-33664bdf-0e65-4e6a-a73d-f482b89e233c for instance with vm_state building and task_state spawning.
Nov 15 03:12:34 user nova-compute[75391]: INFO nova.compute.manager [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Took 5.01 seconds to spawn the instance on the hypervisor.
Nov 15 03:12:34 user nova-compute[75391]: DEBUG nova.compute.manager [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 03:12:34 user nova-compute[75391]: INFO nova.compute.manager [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Took 5.76 seconds to build instance.
Nov 15 03:12:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-5aa639eb-d2d8-4fac-b16e-3dce683a78a5 tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "94544212-b8ee-4843-9202-e68240766874" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.858s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:12:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:12:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-b206e653-ccd2-491f-beea-05539ebed886 req-3debd136-1db8-4fbe-85df-b3379dc1affd service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Received event network-changed-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:12:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-b206e653-ccd2-491f-beea-05539ebed886 req-3debd136-1db8-4fbe-85df-b3379dc1affd service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Refreshing instance network info cache due to event network-changed-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:12:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b206e653-ccd2-491f-beea-05539ebed886 req-3debd136-1db8-4fbe-85df-b3379dc1affd service nova] Acquiring lock "refresh_cache-80ef5798-5000-4b37-90ad-f857bb72badf" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:12:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b206e653-ccd2-491f-beea-05539ebed886 req-3debd136-1db8-4fbe-85df-b3379dc1affd service nova] Acquired lock "refresh_cache-80ef5798-5000-4b37-90ad-f857bb72badf" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:12:44 user nova-compute[75391]: DEBUG nova.network.neutron [req-b206e653-ccd2-491f-beea-05539ebed886 req-3debd136-1db8-4fbe-85df-b3379dc1affd service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Refreshing network info cache for port f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:12:44 user nova-compute[75391]: DEBUG nova.network.neutron [req-b206e653-ccd2-491f-beea-05539ebed886 req-3debd136-1db8-4fbe-85df-b3379dc1affd service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Updated VIF entry in instance network info cache for port f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:12:44 user nova-compute[75391]: DEBUG nova.network.neutron [req-b206e653-ccd2-491f-beea-05539ebed886 req-3debd136-1db8-4fbe-85df-b3379dc1affd service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Updating instance_info_cache with network_info: [{"id": "f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9", "address": "fa:16:3e:2f:bf:50", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fcf4a5-68", "ovs_interfaceid": "f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:12:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b206e653-ccd2-491f-beea-05539ebed886 req-3debd136-1db8-4fbe-85df-b3379dc1affd service nova] Releasing lock "refresh_cache-80ef5798-5000-4b37-90ad-f857bb72badf" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:12:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "80ef5798-5000-4b37-90ad-f857bb72badf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:12:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "80ef5798-5000-4b37-90ad-f857bb72badf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:12:45 user nova-compute[75391]: DEBUG nova.objects.instance [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lazy-loading 'flavor' on Instance uuid 80ef5798-5000-4b37-90ad-f857bb72badf {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:12:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "80ef5798-5000-4b37-90ad-f857bb72badf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:12:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "80ef5798-5000-4b37-90ad-f857bb72badf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:12:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "80ef5798-5000-4b37-90ad-f857bb72badf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:12:45 user nova-compute[75391]: INFO nova.compute.manager [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Attaching volume 0f4fa36b-d351-4531-bf91-0c8f7e87db63 to /dev/vdb
Nov 15 03:12:46 user nova-compute[75391]: DEBUG os_brick.utils [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:12:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:12:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:12:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[025b2a8d-61d9-46d7-83ae-ca21ec9d284c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:12:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:12:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:12:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7215681c-b14a-40f4-8020-1bd6c7c4bac1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:12:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:12:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:12:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fee65ac-b26a-42cc-ac31-55e75fe7d950]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:12:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22fae14-8bcb-4bf2-94ca-a53106346cd3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:12:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:12:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:12:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 03:12:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:12:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:12:46 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 03:12:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf5c40d-d745-4923-859c-87c80d5adb67]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:12:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 03:12:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 03:12:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 03:12:46 user nova-compute[75391]: DEBUG os_brick.utils [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:12:46 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Updating existing volume attachment record: 4e762cc5-53f7-4ac6-b98f-a2faf18a26f0 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 03:12:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PEKelMrI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:12:51 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:12:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:12:51 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:12:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:12:51 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db75612-dba6-4c6f-9812-dcf150c9f245]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 03:12:51 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac1ae14-ed48-4731-a912-d57f29fca725]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63] added
Nov 15 03:12:51 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4675ee82-d606-4291-871f-9cd409eeefa7]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[00080849-9582-4ba4-8bef-2453cea9c0db]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PEKelMrI {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PEKelMrI" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c2c548-ec1b-4209-b246-406770cdbb81]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PEKelMrI'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad008b2-70a7-4d20-9f02-c9963c751759]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fbb0ee-55a7-4f5a-9f46-56925bc70183]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 03:12:51 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 03:12:51 user nova-compute[75391]:  {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:12:51 user nova-compute[75391]: WARNING os_brick.initiator.connectors.iscsi [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 03:12:51 user nova-compute[75391]: 
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35a6021-648d-48d7-8f78-f9e19769618a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63, portal: 172.16.0.220,3260]
Nov 15 03:12:51 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63, portal: 172.16.0.220,3260] successful.
Nov 15 03:12:51 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f3108a-e84d-475b-b169-478efa5a9240]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3660d518-d2e1-4372-bf20-1c4639a5aa59]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63 (non-flash)
Nov 15 03:12:51 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63 (non-flash)
Nov 15 03:12:51 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09b9def-5f48-4abc-8360-a72faabd1030]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:12:51 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 03:12:52 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 03:12:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PEKelMrI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 03:12:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:12:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23433323862393130', 'path': '/dev/sdb'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:12:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433323862393130', 'path': '/dev/sdb'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 03:12:52 user nova-compute[75391]: DEBUG nova.objects.instance [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lazy-loading 'flavor' on Instance uuid 80ef5798-5000-4b37-90ad-f857bb72badf {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:12:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 03:12:52 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:12:52 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 03:12:52 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 03:12:52 user nova-compute[75391]:   <serial>0f4fa36b-d351-4531-bf91-0c8f7e87db63</serial>
Nov 15 03:12:52 user nova-compute[75391]: </disk>
Nov 15 03:12:52 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 03:12:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:12:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:12:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] No VIF found with MAC fa:16:3e:2f:bf:50, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 03:12:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-250aa43d-d071-4bbd-a09c-f9e9c80ee486 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "80ef5798-5000-4b37-90ad-f857bb72badf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.193s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:12:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "80ef5798-5000-4b37-90ad-f857bb72badf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:12:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "80ef5798-5000-4b37-90ad-f857bb72badf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:12:53 user nova-compute[75391]: INFO nova.compute.manager [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Detaching volume 0f4fa36b-d351-4531-bf91-0c8f7e87db63
Nov 15 03:12:53 user nova-compute[75391]: INFO nova.virt.block_device [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Attempting to driver detach volume 0f4fa36b-d351-4531-bf91-0c8f7e87db63 from mountpoint /dev/vdb
Nov 15 03:12:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Attempting to detach device vdb from instance 80ef5798-5000-4b37-90ad-f857bb72badf from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 03:12:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 03:12:53 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:12:53 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 03:12:53 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 03:12:53 user nova-compute[75391]:   <serial>0f4fa36b-d351-4531-bf91-0c8f7e87db63</serial>
Nov 15 03:12:53 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 03:12:53 user nova-compute[75391]: </disk>
Nov 15 03:12:53 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 03:12:54 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Successfully detached device vdb from instance 80ef5798-5000-4b37-90ad-f857bb72badf from the persistent domain config.
Nov 15 03:12:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 80ef5798-5000-4b37-90ad-f857bb72badf from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 03:12:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 03:12:54 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:12:54 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 03:12:54 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 03:12:54 user nova-compute[75391]:   <serial>0f4fa36b-d351-4531-bf91-0c8f7e87db63</serial>
Nov 15 03:12:54 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 03:12:54 user nova-compute[75391]: </disk>
Nov 15 03:12:54 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 03:12:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:54 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 80ef5798-5000-4b37-90ad-f857bb72badf {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 03:12:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:12:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:01 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:13:01 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 03:13:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:04 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:13:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:06 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:13:07 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:13:08 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:13:08 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:13:08 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 03:13:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-6ab268ce-41f5-4d64-b23f-072c6e061b3d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:13:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-6ab268ce-41f5-4d64-b23f-072c6e061b3d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:13:08 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:13:08 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lazy-loading 'info_cache' on Instance uuid 6ab268ce-41f5-4d64-b23f-072c6e061b3d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:13:09 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Updating instance_info_cache with network_info: [{"id": "4fce227a-af16-4fe8-8583-6d547f44654c", "address": "fa:16:3e:c9:3b:32", "network": {"id": "8cd30440-88b8-474a-93a2-f521b6dbfeb2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976042029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfae1cce998b41a485e8686882f9d524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fce227a-af", "ovs_interfaceid": "4fce227a-af16-4fe8-8583-6d547f44654c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:13:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-6ab268ce-41f5-4d64-b23f-072c6e061b3d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:13:09 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:13:09 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:13:10 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:13:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:13:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:13:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:13:10 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:13:10 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94544212-b8ee-4843-9202-e68240766874/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:13:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94544212-b8ee-4843-9202-e68240766874/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:13:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94544212-b8ee-4843-9202-e68240766874/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:13:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94544212-b8ee-4843-9202-e68240766874/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:13:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:13:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:13:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:13:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:13:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80ef5798-5000-4b37-90ad-f857bb72badf/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:13:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80ef5798-5000-4b37-90ad-f857bb72badf/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:13:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80ef5798-5000-4b37-90ad-f857bb72badf/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:13:11 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80ef5798-5000-4b37-90ad-f857bb72badf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:13:12 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:13:12 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:13:12 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8752MB free_disk=24.953258514404297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:13:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:13:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:13:12 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6ab268ce-41f5-4d64-b23f-072c6e061b3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:13:12 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 80ef5798-5000-4b37-90ad-f857bb72badf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:13:12 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 94544212-b8ee-4843-9202-e68240766874 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:13:12 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:13:12 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:13:12 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Refreshing inventories for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 03:13:12 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Updating ProviderTree inventory for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 03:13:12 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Updating inventory in ProviderTree for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 03:13:12 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Refreshing aggregate associations for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e, aggregates: None {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 03:13:12 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Refreshing trait associations for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 03:13:12 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:13:12 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:13:12 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:13:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.470s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:13:13 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:13:14 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 80ef5798-5000-4b37-90ad-f857bb72badf is timed out.
Nov 15 03:13:14 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Successfully detached device vdb from instance 80ef5798-5000-4b37-90ad-f857bb72badf from the live domain config.
Nov 15 03:13:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PEKelMrI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:13:14 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:13:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[177978b1-9b6c-481d-9c81-c72ff2439da5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 03:13:14 user nova-compute[75391]: No targets found.
Nov 15 03:13:14 user nova-compute[75391]: iSNS:
Nov 15 03:13:14 user nova-compute[75391]: No targets found.
Nov 15 03:13:14 user nova-compute[75391]: STATIC:
Nov 15 03:13:14 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63
Nov 15 03:13:14 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 03:13:14 user nova-compute[75391]:                 Iface Name: default
Nov 15 03:13:14 user nova-compute[75391]: FIRMWARE:
Nov 15 03:13:14 user nova-compute[75391]: No targets found.
Nov 15 03:13:14 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 03:13:14 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 03:13:14 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed86dc9e-0b6b-46b2-82d9-79e025ea7956]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18d8add-1efb-4dd5-a394-918b474b6175]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63 (non-flash)
Nov 15 03:13:14 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63 (non-flash)
Nov 15 03:13:14 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f623c141870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63'): ({'sdb'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Removing single pathed devices sdb {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[af178069-85ee-4b25-8c03-39b0d704624b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e2cfdf-4524-45ef-a16c-f1b1d153d188]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Flushing IO for device /dev/sdb {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9986f7-b63d-40d8-94ad-9899c10c5f74]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a291524-23ba-4c2c-8e49-d3df821c5330]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[917ea2f1-a4ea-481f-b025-1d39aa383ce2]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb9aa5a-9a39-4dee-adb6-ba08a35f15d1]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63, portal: 172.16.0.220,3260]
Nov 15 03:13:14 user nova-compute[75391]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63, portal: 172.16.0.220,3260] successful.
Nov 15 03:13:14 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4fa36b-d351-4531-bf91-0c8f7e87db63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa32ea1-103f-44f1-93fc-fda198c99e8f]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] <== disconnect_volume: return (281ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:13:14 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 03:13:15 user nova-compute[75391]: DEBUG nova.objects.instance [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lazy-loading 'flavor' on Instance uuid 80ef5798-5000-4b37-90ad-f857bb72badf {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:13:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-aed00f58-6ffa-490d-95a1-2271fd4121c3 tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "80ef5798-5000-4b37-90ad-f857bb72badf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.631s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:13:15 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:13:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:13:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:13:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:13:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:13:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:16 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:13:16 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:13:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:21 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:27 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:13:27 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Cleaning up deleted instances {{(pid=75391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 03:13:27 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] There are 0 instances to clean {{(pid=75391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 03:13:27 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:13:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:13:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:13:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:13:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:13:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:13:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:13:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f87a8f05-9bc3-4cb9-b989-ded2e852f74f tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "80ef5798-5000-4b37-90ad-f857bb72badf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:13:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f87a8f05-9bc3-4cb9-b989-ded2e852f74f tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "80ef5798-5000-4b37-90ad-f857bb72badf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:13:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f87a8f05-9bc3-4cb9-b989-ded2e852f74f tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "80ef5798-5000-4b37-90ad-f857bb72badf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:13:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f87a8f05-9bc3-4cb9-b989-ded2e852f74f tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "80ef5798-5000-4b37-90ad-f857bb72badf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:13:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f87a8f05-9bc3-4cb9-b989-ded2e852f74f tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "80ef5798-5000-4b37-90ad-f857bb72badf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:13:44 user nova-compute[75391]: INFO nova.compute.manager [None req-f87a8f05-9bc3-4cb9-b989-ded2e852f74f tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Terminating instance
Nov 15 03:13:44 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f87a8f05-9bc3-4cb9-b989-ded2e852f74f tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 03:13:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-2e0e367c-1713-4961-863a-ffe5f260ea6c req-93ca49e5-cd09-44f3-8821-4d438ccaa2b6 service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Received event network-vif-unplugged-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:13:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2e0e367c-1713-4961-863a-ffe5f260ea6c req-93ca49e5-cd09-44f3-8821-4d438ccaa2b6 service nova] Acquiring lock "80ef5798-5000-4b37-90ad-f857bb72badf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:13:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2e0e367c-1713-4961-863a-ffe5f260ea6c req-93ca49e5-cd09-44f3-8821-4d438ccaa2b6 service nova] Lock "80ef5798-5000-4b37-90ad-f857bb72badf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:13:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2e0e367c-1713-4961-863a-ffe5f260ea6c req-93ca49e5-cd09-44f3-8821-4d438ccaa2b6 service nova] Lock "80ef5798-5000-4b37-90ad-f857bb72badf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:13:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-2e0e367c-1713-4961-863a-ffe5f260ea6c req-93ca49e5-cd09-44f3-8821-4d438ccaa2b6 service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] No waiting events found dispatching network-vif-unplugged-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:13:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-2e0e367c-1713-4961-863a-ffe5f260ea6c req-93ca49e5-cd09-44f3-8821-4d438ccaa2b6 service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Received event network-vif-unplugged-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 03:13:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:44 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Instance destroyed successfully.
Nov 15 03:13:44 user nova-compute[75391]: DEBUG nova.objects.instance [None req-f87a8f05-9bc3-4cb9-b989-ded2e852f74f tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lazy-loading 'resources' on Instance uuid 80ef5798-5000-4b37-90ad-f857bb72badf {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:13:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:45 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-f87a8f05-9bc3-4cb9-b989-ded2e852f74f tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:10:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-614701514',display_name='tempest-AttachVolumeNegativeTest-server-614701514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-614701514',id=45,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQLpq+bHJX3eHjRxMc2j1PUAnevwfDTbqLBcm/I8USk+OO9JVDI39o7WAbnggFh2ZO6XrU/WZtqOdhmCurwms5VyMvYNYI3AH5ppgB2MD5/AZciLb6Y7ItSVUwcafJyuA==',key_name='tempest-keypair-641954476',keypairs=<?>,launch_index=0,launched_at=2023-11-15T03:10:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c00f50c42754cea86c68e3e668c0180',ramdisk_id='',reservation_id='r-f4vccpuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-941502312',owner_user_name='tempest-AttachVolumeNegativeTest-941502312-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T03:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970046cb64de4109bb299f75172b7dd7',uuid=80ef5798-5000-4b37-90ad-f857bb72badf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9", "address": "fa:16:3e:2f:bf:50", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fcf4a5-68", "ovs_interfaceid": "f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 03:13:45 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f87a8f05-9bc3-4cb9-b989-ded2e852f74f tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Converting VIF {"id": "f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9", "address": "fa:16:3e:2f:bf:50", "network": {"id": "2109b776-effc-4ec7-ac51-d0408f119253", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-725935929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c00f50c42754cea86c68e3e668c0180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fcf4a5-68", "ovs_interfaceid": "f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:13:45 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f87a8f05-9bc3-4cb9-b989-ded2e852f74f tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:bf:50,bridge_name='br-int',has_traffic_filtering=True,id=f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9,network=Network(2109b776-effc-4ec7-ac51-d0408f119253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2fcf4a5-68') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:13:45 user nova-compute[75391]: DEBUG os_vif [None req-f87a8f05-9bc3-4cb9-b989-ded2e852f74f tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:bf:50,bridge_name='br-int',has_traffic_filtering=True,id=f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9,network=Network(2109b776-effc-4ec7-ac51-d0408f119253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2fcf4a5-68') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 03:13:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2fcf4a5-68, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:13:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:13:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0a0e4e9-001f-462b-a0b8-479afb6e5d17) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:13:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:13:45 user nova-compute[75391]: INFO os_vif [None req-f87a8f05-9bc3-4cb9-b989-ded2e852f74f tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:bf:50,bridge_name='br-int',has_traffic_filtering=True,id=f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9,network=Network(2109b776-effc-4ec7-ac51-d0408f119253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2fcf4a5-68')
Nov 15 03:13:45 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-f87a8f05-9bc3-4cb9-b989-ded2e852f74f tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Deleting instance files /opt/stack/data/nova/instances/80ef5798-5000-4b37-90ad-f857bb72badf_del
Nov 15 03:13:45 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-f87a8f05-9bc3-4cb9-b989-ded2e852f74f tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Deletion of /opt/stack/data/nova/instances/80ef5798-5000-4b37-90ad-f857bb72badf_del complete
Nov 15 03:13:45 user nova-compute[75391]: INFO nova.compute.manager [None req-f87a8f05-9bc3-4cb9-b989-ded2e852f74f tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 03:13:45 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-f87a8f05-9bc3-4cb9-b989-ded2e852f74f tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 03:13:45 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 03:13:45 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 03:13:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:46 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:13:46 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Took 1.31 seconds to deallocate network for instance.
Nov 15 03:13:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f87a8f05-9bc3-4cb9-b989-ded2e852f74f tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:13:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f87a8f05-9bc3-4cb9-b989-ded2e852f74f tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:13:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Received event network-vif-plugged-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:13:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] Acquiring lock "80ef5798-5000-4b37-90ad-f857bb72badf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:13:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] Lock "80ef5798-5000-4b37-90ad-f857bb72badf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:13:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] Lock "80ef5798-5000-4b37-90ad-f857bb72badf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:13:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] No waiting events found dispatching network-vif-plugged-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:13:46 user nova-compute[75391]: WARNING nova.compute.manager [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Received unexpected event network-vif-plugged-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 for instance with vm_state deleted and task_state None.
Nov 15 03:13:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Received event network-vif-plugged-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:13:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] Acquiring lock "80ef5798-5000-4b37-90ad-f857bb72badf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:13:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] Lock "80ef5798-5000-4b37-90ad-f857bb72badf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:13:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] Lock "80ef5798-5000-4b37-90ad-f857bb72badf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:13:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] No waiting events found dispatching network-vif-plugged-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:13:46 user nova-compute[75391]: WARNING nova.compute.manager [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Received unexpected event network-vif-plugged-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 for instance with vm_state deleted and task_state None.
Nov 15 03:13:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Received event network-vif-plugged-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:13:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] Acquiring lock "80ef5798-5000-4b37-90ad-f857bb72badf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:13:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] Lock "80ef5798-5000-4b37-90ad-f857bb72badf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:13:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] Lock "80ef5798-5000-4b37-90ad-f857bb72badf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:13:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] No waiting events found dispatching network-vif-plugged-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:13:46 user nova-compute[75391]: WARNING nova.compute.manager [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Received unexpected event network-vif-plugged-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 for instance with vm_state deleted and task_state None.
Nov 15 03:13:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Received event network-vif-unplugged-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:13:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] Acquiring lock "80ef5798-5000-4b37-90ad-f857bb72badf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:13:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] Lock "80ef5798-5000-4b37-90ad-f857bb72badf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:13:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] Lock "80ef5798-5000-4b37-90ad-f857bb72badf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:13:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] No waiting events found dispatching network-vif-unplugged-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:13:46 user nova-compute[75391]: WARNING nova.compute.manager [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Received unexpected event network-vif-unplugged-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 for instance with vm_state deleted and task_state None.
Nov 15 03:13:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Received event network-vif-plugged-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:13:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] Acquiring lock "80ef5798-5000-4b37-90ad-f857bb72badf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:13:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] Lock "80ef5798-5000-4b37-90ad-f857bb72badf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:13:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] Lock "80ef5798-5000-4b37-90ad-f857bb72badf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:13:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] No waiting events found dispatching network-vif-plugged-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:13:46 user nova-compute[75391]: WARNING nova.compute.manager [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Received unexpected event network-vif-plugged-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 for instance with vm_state deleted and task_state None.
Nov 15 03:13:46 user nova-compute[75391]: DEBUG nova.compute.manager [req-4cb2e98a-2e95-408b-8870-df5e989deadf req-1d57bf9f-8210-4446-9d02-b5ef41dc1f47 service nova] [instance: 80ef5798-5000-4b37-90ad-f857bb72badf] Received event network-vif-deleted-f2fcf4a5-6806-4fde-94ca-2dfe84bcf8c9 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:13:46 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-f87a8f05-9bc3-4cb9-b989-ded2e852f74f tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:13:46 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-f87a8f05-9bc3-4cb9-b989-ded2e852f74f tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:13:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f87a8f05-9bc3-4cb9-b989-ded2e852f74f tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:13:46 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-f87a8f05-9bc3-4cb9-b989-ded2e852f74f tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Deleted allocations for instance 80ef5798-5000-4b37-90ad-f857bb72badf
Nov 15 03:13:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f87a8f05-9bc3-4cb9-b989-ded2e852f74f tempest-AttachVolumeNegativeTest-941502312 tempest-AttachVolumeNegativeTest-941502312-project-member] Lock "80ef5798-5000-4b37-90ad-f857bb72badf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.571s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:13:50 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:13:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:14:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:14:04 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:14:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:14:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:14:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:14:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:14:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:14:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:14:07 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:14:08 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:14:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:14:10 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:14:10 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:14:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-94544212-b8ee-4843-9202-e68240766874" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:14:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-94544212-b8ee-4843-9202-e68240766874" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:14:10 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 94544212-b8ee-4843-9202-e68240766874] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:14:11 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 94544212-b8ee-4843-9202-e68240766874] Updating instance_info_cache with network_info: [{"id": "33664bdf-0e65-4e6a-a73d-f482b89e233c", "address": "fa:16:3e:d3:c1:cd", "network": {"id": "8cd30440-88b8-474a-93a2-f521b6dbfeb2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976042029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfae1cce998b41a485e8686882f9d524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33664bdf-0e", "ovs_interfaceid": "33664bdf-0e65-4e6a-a73d-f482b89e233c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:14:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-94544212-b8ee-4843-9202-e68240766874" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:14:11 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 94544212-b8ee-4843-9202-e68240766874] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:14:11 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:14:12 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:14:12 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:14:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:14:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:14:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:14:12 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:14:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94544212-b8ee-4843-9202-e68240766874/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:14:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94544212-b8ee-4843-9202-e68240766874/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:14:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94544212-b8ee-4843-9202-e68240766874/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:14:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94544212-b8ee-4843-9202-e68240766874/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:14:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:14:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:14:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:14:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:14:13 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:14:13 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:14:13 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8854MB free_disk=24.980236053466797GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:14:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:14:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:14:14 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6ab268ce-41f5-4d64-b23f-072c6e061b3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:14:14 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 94544212-b8ee-4843-9202-e68240766874 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:14:14 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:14:14 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:14:14 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:14:14 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:14:14 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:14:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:14:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:14:16 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:14:17 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:14:17 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:14:17 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:14:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9d24ec42-337a-4bcd-bba2-ffdb53cc4eed tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Acquiring lock "94544212-b8ee-4843-9202-e68240766874" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:14:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9d24ec42-337a-4bcd-bba2-ffdb53cc4eed tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "94544212-b8ee-4843-9202-e68240766874" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:14:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9d24ec42-337a-4bcd-bba2-ffdb53cc4eed tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Acquiring lock "94544212-b8ee-4843-9202-e68240766874-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:14:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9d24ec42-337a-4bcd-bba2-ffdb53cc4eed tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "94544212-b8ee-4843-9202-e68240766874-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:14:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9d24ec42-337a-4bcd-bba2-ffdb53cc4eed tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "94544212-b8ee-4843-9202-e68240766874-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:14:18 user nova-compute[75391]: INFO nova.compute.manager [None req-9d24ec42-337a-4bcd-bba2-ffdb53cc4eed tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Terminating instance
Nov 15 03:14:19 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9d24ec42-337a-4bcd-bba2-ffdb53cc4eed tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 03:14:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:14:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:14:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:14:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:14:19 user nova-compute[75391]: DEBUG nova.compute.manager [req-a12712ad-7f94-41e0-ac88-6b3bcc0e75c7 req-e49e048f-b6c4-4e76-9835-5ffb304eb615 service nova] [instance: 94544212-b8ee-4843-9202-e68240766874] Received event network-vif-unplugged-33664bdf-0e65-4e6a-a73d-f482b89e233c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:14:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a12712ad-7f94-41e0-ac88-6b3bcc0e75c7 req-e49e048f-b6c4-4e76-9835-5ffb304eb615 service nova] Acquiring lock "94544212-b8ee-4843-9202-e68240766874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:14:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a12712ad-7f94-41e0-ac88-6b3bcc0e75c7 req-e49e048f-b6c4-4e76-9835-5ffb304eb615 service nova] Lock "94544212-b8ee-4843-9202-e68240766874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:14:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a12712ad-7f94-41e0-ac88-6b3bcc0e75c7 req-e49e048f-b6c4-4e76-9835-5ffb304eb615 service nova] Lock "94544212-b8ee-4843-9202-e68240766874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:14:19 user nova-compute[75391]: DEBUG nova.compute.manager [req-a12712ad-7f94-41e0-ac88-6b3bcc0e75c7 req-e49e048f-b6c4-4e76-9835-5ffb304eb615 service nova] [instance: 94544212-b8ee-4843-9202-e68240766874] No waiting events found dispatching network-vif-unplugged-33664bdf-0e65-4e6a-a73d-f482b89e233c {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:14:19 user nova-compute[75391]: DEBUG nova.compute.manager [req-a12712ad-7f94-41e0-ac88-6b3bcc0e75c7 req-e49e048f-b6c4-4e76-9835-5ffb304eb615 service nova] [instance: 94544212-b8ee-4843-9202-e68240766874] Received event network-vif-unplugged-33664bdf-0e65-4e6a-a73d-f482b89e233c for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 03:14:19 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 94544212-b8ee-4843-9202-e68240766874] Instance destroyed successfully.
Nov 15 03:14:19 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9d24ec42-337a-4bcd-bba2-ffdb53cc4eed tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lazy-loading 'resources' on Instance uuid 94544212-b8ee-4843-9202-e68240766874 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:14:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-9d24ec42-337a-4bcd-bba2-ffdb53cc4eed tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:12:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-649782120',display_name='tempest-ServersNegativeTestJSON-server-649782120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-649782120',id=46,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T03:12:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dfae1cce998b41a485e8686882f9d524',ramdisk_id='',reservation_id='r-5jo8ocjo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1763001545',owner_user_name='tempest-ServersNegativeTestJSON-1763001545-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T03:12:35Z,user_data=None,user_id='d2be875a591641d9aa32e5588c849067',uuid=94544212-b8ee-4843-9202-e68240766874,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33664bdf-0e65-4e6a-a73d-f482b89e233c", "address": "fa:16:3e:d3:c1:cd", "network": {"id": "8cd30440-88b8-474a-93a2-f521b6dbfeb2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976042029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfae1cce998b41a485e8686882f9d524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33664bdf-0e", "ovs_interfaceid": "33664bdf-0e65-4e6a-a73d-f482b89e233c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 03:14:19 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-9d24ec42-337a-4bcd-bba2-ffdb53cc4eed tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Converting VIF {"id": "33664bdf-0e65-4e6a-a73d-f482b89e233c", "address": "fa:16:3e:d3:c1:cd", "network": {"id": "8cd30440-88b8-474a-93a2-f521b6dbfeb2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976042029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfae1cce998b41a485e8686882f9d524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33664bdf-0e", "ovs_interfaceid": "33664bdf-0e65-4e6a-a73d-f482b89e233c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:14:19 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-9d24ec42-337a-4bcd-bba2-ffdb53cc4eed tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:c1:cd,bridge_name='br-int',has_traffic_filtering=True,id=33664bdf-0e65-4e6a-a73d-f482b89e233c,network=Network(8cd30440-88b8-474a-93a2-f521b6dbfeb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33664bdf-0e') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:14:19 user nova-compute[75391]: DEBUG os_vif [None req-9d24ec42-337a-4bcd-bba2-ffdb53cc4eed tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:c1:cd,bridge_name='br-int',has_traffic_filtering=True,id=33664bdf-0e65-4e6a-a73d-f482b89e233c,network=Network(8cd30440-88b8-474a-93a2-f521b6dbfeb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33664bdf-0e') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 03:14:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:14:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33664bdf-0e, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:14:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:14:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:14:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:14:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75d201ae-5b2c-4e09-abda-e30ff1811ccd) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:14:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:14:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:14:19 user nova-compute[75391]: INFO os_vif [None req-9d24ec42-337a-4bcd-bba2-ffdb53cc4eed tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:c1:cd,bridge_name='br-int',has_traffic_filtering=True,id=33664bdf-0e65-4e6a-a73d-f482b89e233c,network=Network(8cd30440-88b8-474a-93a2-f521b6dbfeb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33664bdf-0e')
Nov 15 03:14:19 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-9d24ec42-337a-4bcd-bba2-ffdb53cc4eed tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Deleting instance files /opt/stack/data/nova/instances/94544212-b8ee-4843-9202-e68240766874_del
Nov 15 03:14:19 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-9d24ec42-337a-4bcd-bba2-ffdb53cc4eed tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Deletion of /opt/stack/data/nova/instances/94544212-b8ee-4843-9202-e68240766874_del complete
Nov 15 03:14:19 user nova-compute[75391]: INFO nova.compute.manager [None req-9d24ec42-337a-4bcd-bba2-ffdb53cc4eed tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 94544212-b8ee-4843-9202-e68240766874] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 15 03:14:19 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-9d24ec42-337a-4bcd-bba2-ffdb53cc4eed tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 03:14:19 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 94544212-b8ee-4843-9202-e68240766874] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 03:14:19 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 94544212-b8ee-4843-9202-e68240766874] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 03:14:20 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 94544212-b8ee-4843-9202-e68240766874] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:14:20 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 94544212-b8ee-4843-9202-e68240766874] Took 0.44 seconds to deallocate network for instance.
Nov 15 03:14:20 user nova-compute[75391]: DEBUG nova.compute.manager [req-a962499f-e838-4396-8495-3bc97ea5612f req-450e4e1a-1d50-4305-9d51-d8b4435cd1fc service nova] [instance: 94544212-b8ee-4843-9202-e68240766874] Received event network-vif-deleted-33664bdf-0e65-4e6a-a73d-f482b89e233c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:14:20 user nova-compute[75391]: INFO nova.compute.manager [req-a962499f-e838-4396-8495-3bc97ea5612f req-450e4e1a-1d50-4305-9d51-d8b4435cd1fc service nova] [instance: 94544212-b8ee-4843-9202-e68240766874] Neutron deleted interface 33664bdf-0e65-4e6a-a73d-f482b89e233c; detaching it from the instance and deleting it from the info cache
Nov 15 03:14:20 user nova-compute[75391]: DEBUG nova.network.neutron [req-a962499f-e838-4396-8495-3bc97ea5612f req-450e4e1a-1d50-4305-9d51-d8b4435cd1fc service nova] [instance: 94544212-b8ee-4843-9202-e68240766874] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:14:20 user nova-compute[75391]: DEBUG nova.compute.manager [req-a962499f-e838-4396-8495-3bc97ea5612f req-450e4e1a-1d50-4305-9d51-d8b4435cd1fc service nova] [instance: 94544212-b8ee-4843-9202-e68240766874] Detach interface failed, port_id=33664bdf-0e65-4e6a-a73d-f482b89e233c, reason: Instance 94544212-b8ee-4843-9202-e68240766874 could not be found. {{(pid=75391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 03:14:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9d24ec42-337a-4bcd-bba2-ffdb53cc4eed tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:14:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9d24ec42-337a-4bcd-bba2-ffdb53cc4eed tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:14:20 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9d24ec42-337a-4bcd-bba2-ffdb53cc4eed tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:14:20 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9d24ec42-337a-4bcd-bba2-ffdb53cc4eed tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:14:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9d24ec42-337a-4bcd-bba2-ffdb53cc4eed tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.153s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:14:20 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-9d24ec42-337a-4bcd-bba2-ffdb53cc4eed tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Deleted allocations for instance 94544212-b8ee-4843-9202-e68240766874
Nov 15 03:14:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9d24ec42-337a-4bcd-bba2-ffdb53cc4eed tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "94544212-b8ee-4843-9202-e68240766874" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.535s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:14:21 user nova-compute[75391]: DEBUG nova.compute.manager [req-072bd7b4-b035-4ea2-be1e-3444d5e65787 req-668c2901-d04c-4f90-bf51-164cb0cf7d44 service nova] [instance: 94544212-b8ee-4843-9202-e68240766874] Received event network-vif-plugged-33664bdf-0e65-4e6a-a73d-f482b89e233c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:14:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-072bd7b4-b035-4ea2-be1e-3444d5e65787 req-668c2901-d04c-4f90-bf51-164cb0cf7d44 service nova] Acquiring lock "94544212-b8ee-4843-9202-e68240766874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:14:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-072bd7b4-b035-4ea2-be1e-3444d5e65787 req-668c2901-d04c-4f90-bf51-164cb0cf7d44 service nova] Lock "94544212-b8ee-4843-9202-e68240766874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:14:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-072bd7b4-b035-4ea2-be1e-3444d5e65787 req-668c2901-d04c-4f90-bf51-164cb0cf7d44 service nova] Lock "94544212-b8ee-4843-9202-e68240766874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:14:21 user nova-compute[75391]: DEBUG nova.compute.manager [req-072bd7b4-b035-4ea2-be1e-3444d5e65787 req-668c2901-d04c-4f90-bf51-164cb0cf7d44 service nova] [instance: 94544212-b8ee-4843-9202-e68240766874] No waiting events found dispatching network-vif-plugged-33664bdf-0e65-4e6a-a73d-f482b89e233c {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:14:21 user nova-compute[75391]: WARNING nova.compute.manager [req-072bd7b4-b035-4ea2-be1e-3444d5e65787 req-668c2901-d04c-4f90-bf51-164cb0cf7d44 service nova] [instance: 94544212-b8ee-4843-9202-e68240766874] Received unexpected event network-vif-plugged-33664bdf-0e65-4e6a-a73d-f482b89e233c for instance with vm_state deleted and task_state None.
Nov 15 03:14:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:14:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:14:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:14:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:14:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:14:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:14:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:14:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:14:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:14:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:05 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:15:08 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:15:08 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:15:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:15:10 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:15:10 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:15:10 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 03:15:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-6ab268ce-41f5-4d64-b23f-072c6e061b3d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:15:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-6ab268ce-41f5-4d64-b23f-072c6e061b3d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:15:10 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:15:10 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lazy-loading 'info_cache' on Instance uuid 6ab268ce-41f5-4d64-b23f-072c6e061b3d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:15:11 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Updating instance_info_cache with network_info: [{"id": "4fce227a-af16-4fe8-8583-6d547f44654c", "address": "fa:16:3e:c9:3b:32", "network": {"id": "8cd30440-88b8-474a-93a2-f521b6dbfeb2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976042029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfae1cce998b41a485e8686882f9d524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fce227a-af", "ovs_interfaceid": "4fce227a-af16-4fe8-8583-6d547f44654c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:15:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-6ab268ce-41f5-4d64-b23f-072c6e061b3d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:15:11 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:15:11 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:15:12 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:15:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:15:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:15:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:15:12 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:15:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:15:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:15:12 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:15:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:15:13 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:15:13 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:15:13 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8985MB free_disk=25.005550384521484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:15:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:15:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:15:13 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6ab268ce-41f5-4d64-b23f-072c6e061b3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:15:13 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:15:13 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:15:13 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:15:13 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:15:13 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:15:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:15:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:14 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:15:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:17 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:15:17 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:15:17 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:15:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:21 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "8aba9a39-8ddf-4ce3-af19-f03b763187ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:15:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "8aba9a39-8ddf-4ce3-af19-f03b763187ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:15:27 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 03:15:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:15:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:15:27 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 03:15:27 user nova-compute[75391]: INFO nova.compute.claims [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Claim successful on node user
Nov 15 03:15:27 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:15:27 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:15:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.266s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:15:27 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 03:15:27 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 03:15:27 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 03:15:27 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 03:15:27 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 03:15:27 user nova-compute[75391]: DEBUG nova.policy [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27184608c0aa47f993c5f2020e5f7df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac31667fa4804667afdb398aeb03d616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 03:15:27 user nova-compute[75391]: INFO nova.virt.block_device [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Booting with volume snapshot cd92bdd9-cecc-49fd-9d89-36f0dc678629 at /dev/vda
Nov 15 03:15:28 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Successfully created port: 4d5e9978-eb50-4122-80a4-028a0ea0d5ed {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 03:15:28 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Successfully updated port: 4d5e9978-eb50-4122-80a4-028a0ea0d5ed {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 03:15:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "refresh_cache-8aba9a39-8ddf-4ce3-af19-f03b763187ac" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:15:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquired lock "refresh_cache-8aba9a39-8ddf-4ce3-af19-f03b763187ac" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:15:28 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 03:15:29 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 03:15:29 user nova-compute[75391]: DEBUG nova.compute.manager [req-278302c6-fd8a-431c-9ce3-43fe5d7adca3 req-66cf2695-4516-4046-b167-dacc105de2e1 service nova] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Received event network-changed-4d5e9978-eb50-4122-80a4-028a0ea0d5ed {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:15:29 user nova-compute[75391]: DEBUG nova.compute.manager [req-278302c6-fd8a-431c-9ce3-43fe5d7adca3 req-66cf2695-4516-4046-b167-dacc105de2e1 service nova] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Refreshing instance network info cache due to event network-changed-4d5e9978-eb50-4122-80a4-028a0ea0d5ed. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:15:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-278302c6-fd8a-431c-9ce3-43fe5d7adca3 req-66cf2695-4516-4046-b167-dacc105de2e1 service nova] Acquiring lock "refresh_cache-8aba9a39-8ddf-4ce3-af19-f03b763187ac" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:15:29 user nova-compute[75391]: DEBUG nova.network.neutron [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Updating instance_info_cache with network_info: [{"id": "4d5e9978-eb50-4122-80a4-028a0ea0d5ed", "address": "fa:16:3e:02:0b:b8", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5e9978-eb", "ovs_interfaceid": "4d5e9978-eb50-4122-80a4-028a0ea0d5ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:15:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Releasing lock "refresh_cache-8aba9a39-8ddf-4ce3-af19-f03b763187ac" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:15:29 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Instance network_info: |[{"id": "4d5e9978-eb50-4122-80a4-028a0ea0d5ed", "address": "fa:16:3e:02:0b:b8", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5e9978-eb", "ovs_interfaceid": "4d5e9978-eb50-4122-80a4-028a0ea0d5ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 03:15:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-278302c6-fd8a-431c-9ce3-43fe5d7adca3 req-66cf2695-4516-4046-b167-dacc105de2e1 service nova] Acquired lock "refresh_cache-8aba9a39-8ddf-4ce3-af19-f03b763187ac" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:15:29 user nova-compute[75391]: DEBUG nova.network.neutron [req-278302c6-fd8a-431c-9ce3-43fe5d7adca3 req-66cf2695-4516-4046-b167-dacc105de2e1 service nova] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Refreshing network info cache for port 4d5e9978-eb50-4122-80a4-028a0ea0d5ed {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:15:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:29 user nova-compute[75391]: DEBUG nova.network.neutron [req-278302c6-fd8a-431c-9ce3-43fe5d7adca3 req-66cf2695-4516-4046-b167-dacc105de2e1 service nova] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Updated VIF entry in instance network info cache for port 4d5e9978-eb50-4122-80a4-028a0ea0d5ed. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:15:29 user nova-compute[75391]: DEBUG nova.network.neutron [req-278302c6-fd8a-431c-9ce3-43fe5d7adca3 req-66cf2695-4516-4046-b167-dacc105de2e1 service nova] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Updating instance_info_cache with network_info: [{"id": "4d5e9978-eb50-4122-80a4-028a0ea0d5ed", "address": "fa:16:3e:02:0b:b8", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5e9978-eb", "ovs_interfaceid": "4d5e9978-eb50-4122-80a4-028a0ea0d5ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:15:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-278302c6-fd8a-431c-9ce3-43fe5d7adca3 req-66cf2695-4516-4046-b167-dacc105de2e1 service nova] Releasing lock "refresh_cache-8aba9a39-8ddf-4ce3-af19-f03b763187ac" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:15:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:33 user nova-compute[75391]: DEBUG os_brick.utils [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:15:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:15:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:15:33 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df2f713-f9a0-40c1-9ad2-70fabcc39daa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:15:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:15:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:15:33 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[209194ab-b6d7-4d7d-9a53-fca39af35506]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:15:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:15:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:15:33 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4ff342-871a-4845-9fa3-51bee3930283]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:15:33 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2db849-1f06-4248-bf73-0e70b180ec56]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:15:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:15:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:15:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 03:15:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:15:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:15:33 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 03:15:33 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b7b665-984e-4d37-bcf1-997bb7df473c]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:15:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 03:15:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 03:15:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 03:15:33 user nova-compute[75391]: DEBUG os_brick.utils [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:15:33 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Updating existing volume attachment record: 919a4fd0-8f59-4770-83be-99c95e55c617 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 03:15:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 03:15:38 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Creating image(s)
Nov 15 03:15:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Did not create local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Ensure instance console log exists: /opt/stack/data/nova/instances/8aba9a39-8ddf-4ce3-af19-f03b763187ac/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Start _get_guest_xml network_info=[{"id": "4d5e9978-eb50-4122-80a4-028a0ea0d5ed", "address": "fa:16:3e:02:0b:b8", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5e9978-eb", "ovs_interfaceid": "4d5e9978-eb50-4122-80a4-028a0ea0d5ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '919a4fd0-8f59-4770-83be-99c95e55c617', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXaKrRBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8aba9a39-8ddf-4ce3-af19-f03b763187ac', 'attached_at': '', 'detached_at': '', 'volume_id': '64be4863-2a60-4ca6-abdf-14ca98d4ac8e', 'serial': '64be4863-2a60-4ca6-abdf-14ca98d4ac8e'}, 'volume_type': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 03:15:38 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:15:38 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:15:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXaKrRBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:15:38 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:15:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:15:38 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:15:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:15:38 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[702c2f27-aaa6-49d7-a645-929e7366c790]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 03:15:38 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7684cbd4-9aba-47a7-93dd-5be78631664e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e] added
Nov 15 03:15:38 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3429d282-d820-4211-98ac-620903d226ef]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cabeac-1e3d-476e-a63c-93ff00bf3178]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXaKrRBV {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXaKrRBV" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7274af-c711-462d-ab35-6bd33cbc7902]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EXaKrRBV'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdc9f6f-a09d-4490-883c-59e5a1940839]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7856b3-e196-4ec8-8fb2-6d5c0205ae95]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 03:15:38 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 03:15:38 user nova-compute[75391]:  {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:15:38 user nova-compute[75391]: WARNING os_brick.initiator.connectors.iscsi [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 03:15:38 user nova-compute[75391]: 
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22e4438-87ff-4b4c-95e6-4d44f374c525]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e, portal: 172.16.0.220,3260]
Nov 15 03:15:38 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e, portal: 172.16.0.220,3260] successful.
Nov 15 03:15:38 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de27536-28c7-470e-86ed-c98f8d9000b1]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0a185f-80b7-4100-8a0e-d881823842b2]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e (non-flash)
Nov 15 03:15:38 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e (non-flash)
Nov 15 03:15:38 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3d73b0-1e18-4af3-8fbb-2c818f46e723]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 03:15:38 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXaKrRBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 03:15:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:15:39 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23465623931326666', 'path': '/dev/sdb'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:15:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465623931326666', 'path': '/dev/sdb'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 03:15:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1173264274',display_name='tempest-TestVolumeBootPattern-server-1173264274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1173264274',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac31667fa4804667afdb398aeb03d616',ramdisk_id='',reservation_id='r-6m821w7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1108994886',owner_user_name='tempest-TestVolumeBootPattern-1108994886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:15:28Z,user_data=None,user_id='27184608c0aa47f993c5f2020e5f7df4',uuid=8aba9a39-8ddf-4ce3-af19-f03b763187ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d5e9978-eb50-4122-80a4-028a0ea0d5ed", "address": "fa:16:3e:02:0b:b8", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5e9978-eb", "ovs_interfaceid": "4d5e9978-eb50-4122-80a4-028a0ea0d5ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 03:15:39 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converting VIF {"id": "4d5e9978-eb50-4122-80a4-028a0ea0d5ed", "address": "fa:16:3e:02:0b:b8", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5e9978-eb", "ovs_interfaceid": "4d5e9978-eb50-4122-80a4-028a0ea0d5ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:15:39 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:0b:b8,bridge_name='br-int',has_traffic_filtering=True,id=4d5e9978-eb50-4122-80a4-028a0ea0d5ed,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5e9978-eb') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:15:39 user nova-compute[75391]: DEBUG nova.objects.instance [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lazy-loading 'pci_devices' on Instance uuid 8aba9a39-8ddf-4ce3-af19-f03b763187ac {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:15:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] End _get_guest_xml xml=<domain type="kvm">
Nov 15 03:15:39 user nova-compute[75391]:   <uuid>8aba9a39-8ddf-4ce3-af19-f03b763187ac</uuid>
Nov 15 03:15:39 user nova-compute[75391]:   <name>instance-0000002f</name>
Nov 15 03:15:39 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 03:15:39 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 03:15:39 user nova-compute[75391]:   <metadata>
Nov 15 03:15:39 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 03:15:39 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 03:15:39 user nova-compute[75391]:       <nova:name>tempest-TestVolumeBootPattern-server-1173264274</nova:name>
Nov 15 03:15:39 user nova-compute[75391]:       <nova:creationTime>2023-11-15 03:15:38</nova:creationTime>
Nov 15 03:15:39 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 03:15:39 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 03:15:39 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 03:15:39 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 03:15:39 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 03:15:39 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 03:15:39 user nova-compute[75391]:       </nova:flavor>
Nov 15 03:15:39 user nova-compute[75391]:       <nova:owner>
Nov 15 03:15:39 user nova-compute[75391]:         <nova:user uuid="27184608c0aa47f993c5f2020e5f7df4">tempest-TestVolumeBootPattern-1108994886-project-member</nova:user>
Nov 15 03:15:39 user nova-compute[75391]:         <nova:project uuid="ac31667fa4804667afdb398aeb03d616">tempest-TestVolumeBootPattern-1108994886</nova:project>
Nov 15 03:15:39 user nova-compute[75391]:       </nova:owner>
Nov 15 03:15:39 user nova-compute[75391]:       <nova:ports>
Nov 15 03:15:39 user nova-compute[75391]:         <nova:port uuid="4d5e9978-eb50-4122-80a4-028a0ea0d5ed">
Nov 15 03:15:39 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 03:15:39 user nova-compute[75391]:         </nova:port>
Nov 15 03:15:39 user nova-compute[75391]:       </nova:ports>
Nov 15 03:15:39 user nova-compute[75391]:     </nova:instance>
Nov 15 03:15:39 user nova-compute[75391]:   </metadata>
Nov 15 03:15:39 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 03:15:39 user nova-compute[75391]:     <system>
Nov 15 03:15:39 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 03:15:39 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 03:15:39 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 03:15:39 user nova-compute[75391]:       <entry name="serial">8aba9a39-8ddf-4ce3-af19-f03b763187ac</entry>
Nov 15 03:15:39 user nova-compute[75391]:       <entry name="uuid">8aba9a39-8ddf-4ce3-af19-f03b763187ac</entry>
Nov 15 03:15:39 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 03:15:39 user nova-compute[75391]:     </system>
Nov 15 03:15:39 user nova-compute[75391]:   </sysinfo>
Nov 15 03:15:39 user nova-compute[75391]:   <os>
Nov 15 03:15:39 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 03:15:39 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 03:15:39 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 03:15:39 user nova-compute[75391]:   </os>
Nov 15 03:15:39 user nova-compute[75391]:   <features>
Nov 15 03:15:39 user nova-compute[75391]:     <acpi/>
Nov 15 03:15:39 user nova-compute[75391]:     <apic/>
Nov 15 03:15:39 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 03:15:39 user nova-compute[75391]:   </features>
Nov 15 03:15:39 user nova-compute[75391]:   <clock offset="utc">
Nov 15 03:15:39 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 03:15:39 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 03:15:39 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 03:15:39 user nova-compute[75391]:   </clock>
Nov 15 03:15:39 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 03:15:39 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 03:15:39 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 03:15:39 user nova-compute[75391]:   </cpu>
Nov 15 03:15:39 user nova-compute[75391]:   <devices>
Nov 15 03:15:39 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 03:15:39 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:15:39 user nova-compute[75391]:       <source dev="/dev/sdb"/>
Nov 15 03:15:39 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 03:15:39 user nova-compute[75391]:       <serial>64be4863-2a60-4ca6-abdf-14ca98d4ac8e</serial>
Nov 15 03:15:39 user nova-compute[75391]:     </disk>
Nov 15 03:15:39 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 03:15:39 user nova-compute[75391]:       <mac address="fa:16:3e:02:0b:b8"/>
Nov 15 03:15:39 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:15:39 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 03:15:39 user nova-compute[75391]:       <target dev="tap4d5e9978-eb"/>
Nov 15 03:15:39 user nova-compute[75391]:     </interface>
Nov 15 03:15:39 user nova-compute[75391]:     <serial type="pty">
Nov 15 03:15:39 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/8aba9a39-8ddf-4ce3-af19-f03b763187ac/console.log" append="off"/>
Nov 15 03:15:39 user nova-compute[75391]:     </serial>
Nov 15 03:15:39 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 03:15:39 user nova-compute[75391]:     <video>
Nov 15 03:15:39 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:15:39 user nova-compute[75391]:     </video>
Nov 15 03:15:39 user nova-compute[75391]:     <rng model="virtio">
Nov 15 03:15:39 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 03:15:39 user nova-compute[75391]:     </rng>
Nov 15 03:15:39 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 03:15:39 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 03:15:39 user nova-compute[75391]:       <stats period="10"/>
Nov 15 03:15:39 user nova-compute[75391]:     </memballoon>
Nov 15 03:15:39 user nova-compute[75391]:   </devices>
Nov 15 03:15:39 user nova-compute[75391]: </domain>
Nov 15 03:15:39 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 03:15:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1173264274',display_name='tempest-TestVolumeBootPattern-server-1173264274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1173264274',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac31667fa4804667afdb398aeb03d616',ramdisk_id='',reservation_id='r-6m821w7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1108994886',owner_user_name='tempest-TestVolumeBootPattern-1108994886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:15:28Z,user_data=None,user_id='27184608c0aa47f993c5f2020e5f7df4',uuid=8aba9a39-8ddf-4ce3-af19-f03b763187ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d5e9978-eb50-4122-80a4-028a0ea0d5ed", "address": "fa:16:3e:02:0b:b8", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5e9978-eb", "ovs_interfaceid": "4d5e9978-eb50-4122-80a4-028a0ea0d5ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 03:15:39 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converting VIF {"id": "4d5e9978-eb50-4122-80a4-028a0ea0d5ed", "address": "fa:16:3e:02:0b:b8", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5e9978-eb", "ovs_interfaceid": "4d5e9978-eb50-4122-80a4-028a0ea0d5ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:15:39 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:0b:b8,bridge_name='br-int',has_traffic_filtering=True,id=4d5e9978-eb50-4122-80a4-028a0ea0d5ed,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5e9978-eb') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:15:39 user nova-compute[75391]: DEBUG os_vif [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:0b:b8,bridge_name='br-int',has_traffic_filtering=True,id=4d5e9978-eb50-4122-80a4-028a0ea0d5ed,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5e9978-eb') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 03:15:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:15:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 03:15:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0c73c07-0181-5fe8-b7c8-204ce3ff0b47', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:15:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d5e9978-eb, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:15:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d5e9978-eb, col_values=(('qos', UUID('7d76989c-7aca-4763-b51a-c2bff00ec249')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:15:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d5e9978-eb, col_values=(('external_ids', {'iface-id': '4d5e9978-eb50-4122-80a4-028a0ea0d5ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:0b:b8', 'vm-uuid': '8aba9a39-8ddf-4ce3-af19-f03b763187ac'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:15:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:15:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:39 user nova-compute[75391]: INFO os_vif [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:0b:b8,bridge_name='br-int',has_traffic_filtering=True,id=4d5e9978-eb50-4122-80a4-028a0ea0d5ed,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5e9978-eb')
Nov 15 03:15:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:15:39 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] No VIF found with MAC fa:16:3e:02:0b:b8, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 03:15:40 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:40 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:40 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:40 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:41 user nova-compute[75391]: DEBUG nova.compute.manager [req-b2b341fa-eefd-4017-b498-77c7015e38e1 req-634d0240-84b7-456a-a98a-fd9448d70c1d service nova] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Received event network-vif-plugged-4d5e9978-eb50-4122-80a4-028a0ea0d5ed {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:15:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b2b341fa-eefd-4017-b498-77c7015e38e1 req-634d0240-84b7-456a-a98a-fd9448d70c1d service nova] Acquiring lock "8aba9a39-8ddf-4ce3-af19-f03b763187ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:15:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b2b341fa-eefd-4017-b498-77c7015e38e1 req-634d0240-84b7-456a-a98a-fd9448d70c1d service nova] Lock "8aba9a39-8ddf-4ce3-af19-f03b763187ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:15:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b2b341fa-eefd-4017-b498-77c7015e38e1 req-634d0240-84b7-456a-a98a-fd9448d70c1d service nova] Lock "8aba9a39-8ddf-4ce3-af19-f03b763187ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:15:41 user nova-compute[75391]: DEBUG nova.compute.manager [req-b2b341fa-eefd-4017-b498-77c7015e38e1 req-634d0240-84b7-456a-a98a-fd9448d70c1d service nova] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] No waiting events found dispatching network-vif-plugged-4d5e9978-eb50-4122-80a4-028a0ea0d5ed {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:15:41 user nova-compute[75391]: WARNING nova.compute.manager [req-b2b341fa-eefd-4017-b498-77c7015e38e1 req-634d0240-84b7-456a-a98a-fd9448d70c1d service nova] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Received unexpected event network-vif-plugged-4d5e9978-eb50-4122-80a4-028a0ea0d5ed for instance with vm_state building and task_state spawning.
Nov 15 03:15:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:43 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 03:15:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 03:15:43 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Instance spawned successfully.
Nov 15 03:15:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 03:15:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:15:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:15:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:15:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:15:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:15:43 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:15:43 user nova-compute[75391]: INFO nova.compute.manager [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 15 03:15:43 user nova-compute[75391]: DEBUG nova.compute.manager [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 03:15:43 user nova-compute[75391]: DEBUG nova.compute.manager [req-87b5fbe3-a47d-46f5-af8a-f85b9ac10849 req-14bd3ef7-e1a5-4802-8127-e6b4f8703552 service nova] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Received event network-vif-plugged-4d5e9978-eb50-4122-80a4-028a0ea0d5ed {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:15:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-87b5fbe3-a47d-46f5-af8a-f85b9ac10849 req-14bd3ef7-e1a5-4802-8127-e6b4f8703552 service nova] Acquiring lock "8aba9a39-8ddf-4ce3-af19-f03b763187ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:15:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-87b5fbe3-a47d-46f5-af8a-f85b9ac10849 req-14bd3ef7-e1a5-4802-8127-e6b4f8703552 service nova] Lock "8aba9a39-8ddf-4ce3-af19-f03b763187ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:15:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-87b5fbe3-a47d-46f5-af8a-f85b9ac10849 req-14bd3ef7-e1a5-4802-8127-e6b4f8703552 service nova] Lock "8aba9a39-8ddf-4ce3-af19-f03b763187ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:15:43 user nova-compute[75391]: DEBUG nova.compute.manager [req-87b5fbe3-a47d-46f5-af8a-f85b9ac10849 req-14bd3ef7-e1a5-4802-8127-e6b4f8703552 service nova] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] No waiting events found dispatching network-vif-plugged-4d5e9978-eb50-4122-80a4-028a0ea0d5ed {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:15:43 user nova-compute[75391]: WARNING nova.compute.manager [req-87b5fbe3-a47d-46f5-af8a-f85b9ac10849 req-14bd3ef7-e1a5-4802-8127-e6b4f8703552 service nova] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Received unexpected event network-vif-plugged-4d5e9978-eb50-4122-80a4-028a0ea0d5ed for instance with vm_state building and task_state spawning.
Nov 15 03:15:43 user nova-compute[75391]: INFO nova.compute.manager [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Took 15.77 seconds to build instance.
Nov 15 03:15:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f86130db-cb2d-4884-b689-87a88f8bfb63 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "8aba9a39-8ddf-4ce3-af19-f03b763187ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.043s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:15:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:15:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:16:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:16:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:16:05 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:16:08 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:16:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:16:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:16:09 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:16:10 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:16:10 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:16:10 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 03:16:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-6ab268ce-41f5-4d64-b23f-072c6e061b3d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:16:10 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-6ab268ce-41f5-4d64-b23f-072c6e061b3d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:16:10 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:16:10 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lazy-loading 'info_cache' on Instance uuid 6ab268ce-41f5-4d64-b23f-072c6e061b3d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:16:11 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Updating instance_info_cache with network_info: [{"id": "4fce227a-af16-4fe8-8583-6d547f44654c", "address": "fa:16:3e:c9:3b:32", "network": {"id": "8cd30440-88b8-474a-93a2-f521b6dbfeb2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976042029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfae1cce998b41a485e8686882f9d524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fce227a-af", "ovs_interfaceid": "4fce227a-af16-4fe8-8583-6d547f44654c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:16:11 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-6ab268ce-41f5-4d64-b23f-072c6e061b3d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:16:11 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:16:13 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:16:13 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:16:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:16:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:16:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:16:13 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:16:13 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 03:16:13 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:16:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:16:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:16:14 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:16:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:16:14 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:16:14 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:16:14 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8825MB free_disk=25.002796173095703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:16:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:16:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:16:14 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6ab268ce-41f5-4d64-b23f-072c6e061b3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:16:14 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 8aba9a39-8ddf-4ce3-af19-f03b763187ac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:16:14 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:16:14 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:16:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:16:14 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:16:14 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:16:14 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:16:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:16:15 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:16:15 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:16:17 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:16:17 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:16:17 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:16:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:16:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:16:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:16:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:16:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:16:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:16:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:16:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:16:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:16:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:16:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:16:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:16:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:16:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:16:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:16:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:16:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:16:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:16:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:17:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:17:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:17:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:17:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:17:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:17:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:17:07 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:17:09 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:17:09 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:17:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:17:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:17:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:17:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:17:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:17:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:17:12 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:17:12 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:17:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-8aba9a39-8ddf-4ce3-af19-f03b763187ac" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:17:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-8aba9a39-8ddf-4ce3-af19-f03b763187ac" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:17:12 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:17:13 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Updating instance_info_cache with network_info: [{"id": "4d5e9978-eb50-4122-80a4-028a0ea0d5ed", "address": "fa:16:3e:02:0b:b8", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5e9978-eb", "ovs_interfaceid": "4d5e9978-eb50-4122-80a4-028a0ea0d5ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:17:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-8aba9a39-8ddf-4ce3-af19-f03b763187ac" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:17:13 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:17:14 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:17:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:17:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:17:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:17:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:17:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:17:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:17:15 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:17:15 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:17:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:17:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:17:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:17:15 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:17:15 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 03:17:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:17:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:17:15 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:17:16 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:17:16 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:17:16 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:17:16 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8879MB free_disk=25.002155303955078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:17:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:17:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:17:16 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6ab268ce-41f5-4d64-b23f-072c6e061b3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:17:16 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 8aba9a39-8ddf-4ce3-af19-f03b763187ac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:17:16 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:17:16 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:17:16 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:17:16 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:17:16 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:17:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:17:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "8aba9a39-8ddf-4ce3-af19-f03b763187ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:17:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "8aba9a39-8ddf-4ce3-af19-f03b763187ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:17:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "8aba9a39-8ddf-4ce3-af19-f03b763187ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:17:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "8aba9a39-8ddf-4ce3-af19-f03b763187ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:17:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "8aba9a39-8ddf-4ce3-af19-f03b763187ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:17:17 user nova-compute[75391]: INFO nova.compute.manager [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Terminating instance
Nov 15 03:17:17 user nova-compute[75391]: DEBUG nova.compute.manager [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 03:17:17 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG nova.compute.manager [req-00eb321c-7095-4b4a-bc3d-9db686fe00d2 req-f7b31456-4818-4595-8aaf-371ac2d309f0 service nova] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Received event network-vif-unplugged-4d5e9978-eb50-4122-80a4-028a0ea0d5ed {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-00eb321c-7095-4b4a-bc3d-9db686fe00d2 req-f7b31456-4818-4595-8aaf-371ac2d309f0 service nova] Acquiring lock "8aba9a39-8ddf-4ce3-af19-f03b763187ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-00eb321c-7095-4b4a-bc3d-9db686fe00d2 req-f7b31456-4818-4595-8aaf-371ac2d309f0 service nova] Lock "8aba9a39-8ddf-4ce3-af19-f03b763187ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-00eb321c-7095-4b4a-bc3d-9db686fe00d2 req-f7b31456-4818-4595-8aaf-371ac2d309f0 service nova] Lock "8aba9a39-8ddf-4ce3-af19-f03b763187ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG nova.compute.manager [req-00eb321c-7095-4b4a-bc3d-9db686fe00d2 req-f7b31456-4818-4595-8aaf-371ac2d309f0 service nova] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] No waiting events found dispatching network-vif-unplugged-4d5e9978-eb50-4122-80a4-028a0ea0d5ed {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG nova.compute.manager [req-00eb321c-7095-4b4a-bc3d-9db686fe00d2 req-f7b31456-4818-4595-8aaf-371ac2d309f0 service nova] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Received event network-vif-unplugged-4d5e9978-eb50-4122-80a4-028a0ea0d5ed for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:17:18 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Instance destroyed successfully.
Nov 15 03:17:18 user nova-compute[75391]: DEBUG nova.objects.instance [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lazy-loading 'resources' on Instance uuid 8aba9a39-8ddf-4ce3-af19-f03b763187ac {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1173264274',display_name='tempest-TestVolumeBootPattern-server-1173264274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1173264274',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T03:15:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac31667fa4804667afdb398aeb03d616',ramdisk_id='',reservation_id='r-6m821w7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1108994886',owner_user_name='tempest-TestVolumeBootPattern-1108994886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T03:15:43Z,user_data=None,user_id='27184608c0aa47f993c5f2020e5f7df4',uuid=8aba9a39-8ddf-4ce3-af19-f03b763187ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d5e9978-eb50-4122-80a4-028a0ea0d5ed", "address": "fa:16:3e:02:0b:b8", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5e9978-eb", "ovs_interfaceid": "4d5e9978-eb50-4122-80a4-028a0ea0d5ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converting VIF {"id": "4d5e9978-eb50-4122-80a4-028a0ea0d5ed", "address": "fa:16:3e:02:0b:b8", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5e9978-eb", "ovs_interfaceid": "4d5e9978-eb50-4122-80a4-028a0ea0d5ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:0b:b8,bridge_name='br-int',has_traffic_filtering=True,id=4d5e9978-eb50-4122-80a4-028a0ea0d5ed,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5e9978-eb') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG os_vif [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:0b:b8,bridge_name='br-int',has_traffic_filtering=True,id=4d5e9978-eb50-4122-80a4-028a0ea0d5ed,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5e9978-eb') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d5e9978-eb, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d76989c-7aca-4763-b51a-c2bff00ec249) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:17:18 user nova-compute[75391]: INFO os_vif [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:0b:b8,bridge_name='br-int',has_traffic_filtering=True,id=4d5e9978-eb50-4122-80a4-028a0ea0d5ed,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5e9978-eb')
Nov 15 03:17:18 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXaKrRBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:17:18 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:17:18 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7814003-1138-4c14-87f9-292f3f566777]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 03:17:18 user nova-compute[75391]: No targets found.
Nov 15 03:17:18 user nova-compute[75391]: iSNS:
Nov 15 03:17:18 user nova-compute[75391]: No targets found.
Nov 15 03:17:18 user nova-compute[75391]: STATIC:
Nov 15 03:17:18 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e
Nov 15 03:17:18 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 03:17:18 user nova-compute[75391]:                 Iface Name: default
Nov 15 03:17:18 user nova-compute[75391]: FIRMWARE:
Nov 15 03:17:18 user nova-compute[75391]: No targets found.
Nov 15 03:17:18 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 03:17:18 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 03:17:18 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca798d4-753a-471c-a078-3790b27d48be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d246e3-390c-49b4-ae3c-1a79fba4684e]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e (non-flash)
Nov 15 03:17:18 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e (non-flash)
Nov 15 03:17:18 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f622463fd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e'): ({'sdb'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Removing single pathed devices sdb {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74d4d5a-d308-49e2-8605-25e65160faa4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9751d07a-dfef-497e-9bfa-732fedb02652]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Flushing IO for device /dev/sdb {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0725f634-feea-4556-ae5e-69c627962354]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f99468b-520c-438a-88e2-d03c39fa46c2]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dfdeeb-5a11-472f-aeef-2f23e8a2e6af]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:17:18 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:17:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:17:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[085fc6eb-b1b8-47c0-8c52-0edc4f5694a3]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:17:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e, portal: 172.16.0.220,3260]
Nov 15 03:17:19 user nova-compute[75391]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e, portal: 172.16.0.220,3260] successful.
Nov 15 03:17:19 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:17:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:17:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64be4863-2a60-4ca6-abdf-14ca98d4ac8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:17:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a663e6ed-dd63-4afa-a024-8410e34cbe84]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:17:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:17:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:17:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] <== disconnect_volume: return (319ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:17:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 03:17:19 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Deleting instance files /opt/stack/data/nova/instances/8aba9a39-8ddf-4ce3-af19-f03b763187ac_del
Nov 15 03:17:19 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Deletion of /opt/stack/data/nova/instances/8aba9a39-8ddf-4ce3-af19-f03b763187ac_del complete
Nov 15 03:17:19 user nova-compute[75391]: INFO nova.compute.manager [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 15 03:17:19 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 03:17:19 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 03:17:19 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 03:17:19 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:17:19 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Took 0.39 seconds to deallocate network for instance.
Nov 15 03:17:19 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:17:19 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:17:19 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:17:20 user nova-compute[75391]: INFO nova.compute.manager [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Took 0.73 seconds to detach 1 volumes for instance.
Nov 15 03:17:20 user nova-compute[75391]: DEBUG nova.compute.manager [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Deleting volume: 64be4863-2a60-4ca6-abdf-14ca98d4ac8e {{(pid=75391) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 03:17:20 user nova-compute[75391]: DEBUG nova.compute.manager [req-68a3139f-910e-4ece-b5b1-47620cc126ce req-72de639f-471b-485b-9a30-2c351fa84b1a service nova] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Received event network-vif-plugged-4d5e9978-eb50-4122-80a4-028a0ea0d5ed {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:17:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-68a3139f-910e-4ece-b5b1-47620cc126ce req-72de639f-471b-485b-9a30-2c351fa84b1a service nova] Acquiring lock "8aba9a39-8ddf-4ce3-af19-f03b763187ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:17:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-68a3139f-910e-4ece-b5b1-47620cc126ce req-72de639f-471b-485b-9a30-2c351fa84b1a service nova] Lock "8aba9a39-8ddf-4ce3-af19-f03b763187ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:17:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-68a3139f-910e-4ece-b5b1-47620cc126ce req-72de639f-471b-485b-9a30-2c351fa84b1a service nova] Lock "8aba9a39-8ddf-4ce3-af19-f03b763187ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:17:20 user nova-compute[75391]: DEBUG nova.compute.manager [req-68a3139f-910e-4ece-b5b1-47620cc126ce req-72de639f-471b-485b-9a30-2c351fa84b1a service nova] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] No waiting events found dispatching network-vif-plugged-4d5e9978-eb50-4122-80a4-028a0ea0d5ed {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:17:20 user nova-compute[75391]: WARNING nova.compute.manager [req-68a3139f-910e-4ece-b5b1-47620cc126ce req-72de639f-471b-485b-9a30-2c351fa84b1a service nova] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Received unexpected event network-vif-plugged-4d5e9978-eb50-4122-80a4-028a0ea0d5ed for instance with vm_state active and task_state deleting.
Nov 15 03:17:20 user nova-compute[75391]: DEBUG nova.compute.manager [req-68a3139f-910e-4ece-b5b1-47620cc126ce req-72de639f-471b-485b-9a30-2c351fa84b1a service nova] [instance: 8aba9a39-8ddf-4ce3-af19-f03b763187ac] Received event network-vif-deleted-4d5e9978-eb50-4122-80a4-028a0ea0d5ed {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:17:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:17:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:17:20 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:17:20 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:17:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:17:20 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Deleted allocations for instance 8aba9a39-8ddf-4ce3-af19-f03b763187ac
Nov 15 03:17:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-47084d9c-1cb6-4327-a4f7-55f0ccc08ad7 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "8aba9a39-8ddf-4ce3-af19-f03b763187ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.683s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:17:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:17:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:17:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:17:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:17:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:17:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:17:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:17:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:17:37 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:17:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:17:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:17:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:17:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:17:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:17:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:17:37 user nova-compute[75391]: DEBUG nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Verify base images {{(pid=75391) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 15 03:17:37 user nova-compute[75391]: DEBUG nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Image id f31cb507-389e-424c-b4dc-02c610b0b558 yields fingerprint 6ed2fe621f8f11a6cdcf5ac879df64cad95c324a {{(pid=75391) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 15 03:17:37 user nova-compute[75391]: INFO nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] image f31cb507-389e-424c-b4dc-02c610b0b558 at (/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a): checking
Nov 15 03:17:37 user nova-compute[75391]: DEBUG nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] image f31cb507-389e-424c-b4dc-02c610b0b558 at (/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a): image is in use {{(pid=75391) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 15 03:17:37 user nova-compute[75391]: DEBUG nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75391) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 15 03:17:37 user nova-compute[75391]: DEBUG nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] 6ab268ce-41f5-4d64-b23f-072c6e061b3d is a valid instance name {{(pid=75391) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 15 03:17:37 user nova-compute[75391]: DEBUG nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] 6ab268ce-41f5-4d64-b23f-072c6e061b3d has a disk file {{(pid=75391) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 15 03:17:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:17:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:17:37 user nova-compute[75391]: DEBUG nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6ab268ce-41f5-4d64-b23f-072c6e061b3d is backed by 6ed2fe621f8f11a6cdcf5ac879df64cad95c324a {{(pid=75391) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 15 03:17:37 user nova-compute[75391]: WARNING nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Unknown base file: /opt/stack/data/nova/instances/_base/619ea27fe4302fc35ff86456fb3dfd1eeb6d7c68
Nov 15 03:17:37 user nova-compute[75391]: WARNING nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Unknown base file: /opt/stack/data/nova/instances/_base/ae51d8429e4db80a65c8102ceebb0defab0ca398
Nov 15 03:17:37 user nova-compute[75391]: WARNING nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Unknown base file: /opt/stack/data/nova/instances/_base/96c3e94aea325c0be9d564670108914ecea7194e
Nov 15 03:17:37 user nova-compute[75391]: WARNING nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Unknown base file: /opt/stack/data/nova/instances/_base/923b1fc7693da022cb3fdad817192ec139f94293
Nov 15 03:17:37 user nova-compute[75391]: WARNING nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Unknown base file: /opt/stack/data/nova/instances/_base/d1a7c5d3c5a3e3131dd7a678574f8e01e0630da1
Nov 15 03:17:37 user nova-compute[75391]: WARNING nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Unknown base file: /opt/stack/data/nova/instances/_base/5ce9bbd94ef2de94cb01c6f05642b5b468b3eb0e
Nov 15 03:17:37 user nova-compute[75391]: WARNING nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Unknown base file: /opt/stack/data/nova/instances/_base/2d7f86196cc3cb103a88c70361a80dec296d71e3
Nov 15 03:17:37 user nova-compute[75391]: WARNING nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Unknown base file: /opt/stack/data/nova/instances/_base/492432f921f89469381625e9482c741ebcd1a5f8
Nov 15 03:17:37 user nova-compute[75391]: WARNING nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Unknown base file: /opt/stack/data/nova/instances/_base/10096a2f4ad7902fc94fd20f45ffb07eb2a637f5
Nov 15 03:17:37 user nova-compute[75391]: INFO nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Active base files: /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a
Nov 15 03:17:37 user nova-compute[75391]: INFO nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Removable base files: /opt/stack/data/nova/instances/_base/619ea27fe4302fc35ff86456fb3dfd1eeb6d7c68 /opt/stack/data/nova/instances/_base/ae51d8429e4db80a65c8102ceebb0defab0ca398 /opt/stack/data/nova/instances/_base/96c3e94aea325c0be9d564670108914ecea7194e /opt/stack/data/nova/instances/_base/923b1fc7693da022cb3fdad817192ec139f94293 /opt/stack/data/nova/instances/_base/d1a7c5d3c5a3e3131dd7a678574f8e01e0630da1 /opt/stack/data/nova/instances/_base/5ce9bbd94ef2de94cb01c6f05642b5b468b3eb0e /opt/stack/data/nova/instances/_base/2d7f86196cc3cb103a88c70361a80dec296d71e3 /opt/stack/data/nova/instances/_base/492432f921f89469381625e9482c741ebcd1a5f8 /opt/stack/data/nova/instances/_base/10096a2f4ad7902fc94fd20f45ffb07eb2a637f5
Nov 15 03:17:37 user nova-compute[75391]: INFO nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/619ea27fe4302fc35ff86456fb3dfd1eeb6d7c68
Nov 15 03:17:37 user nova-compute[75391]: INFO nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ae51d8429e4db80a65c8102ceebb0defab0ca398
Nov 15 03:17:37 user nova-compute[75391]: INFO nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/96c3e94aea325c0be9d564670108914ecea7194e
Nov 15 03:17:37 user nova-compute[75391]: INFO nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/923b1fc7693da022cb3fdad817192ec139f94293
Nov 15 03:17:37 user nova-compute[75391]: INFO nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d1a7c5d3c5a3e3131dd7a678574f8e01e0630da1
Nov 15 03:17:37 user nova-compute[75391]: INFO nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5ce9bbd94ef2de94cb01c6f05642b5b468b3eb0e
Nov 15 03:17:37 user nova-compute[75391]: INFO nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2d7f86196cc3cb103a88c70361a80dec296d71e3
Nov 15 03:17:37 user nova-compute[75391]: INFO nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/492432f921f89469381625e9482c741ebcd1a5f8
Nov 15 03:17:37 user nova-compute[75391]: INFO nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/10096a2f4ad7902fc94fd20f45ffb07eb2a637f5
Nov 15 03:17:37 user nova-compute[75391]: DEBUG nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Verification complete {{(pid=75391) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 15 03:17:37 user nova-compute[75391]: DEBUG nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Verify swap images {{(pid=75391) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 15 03:17:37 user nova-compute[75391]: DEBUG nova.virt.libvirt.imagecache [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Verify ephemeral images {{(pid=75391) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 15 03:17:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:17:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:17:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:17:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:17:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:18:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:18:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:18:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:18:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:18:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:18:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:08 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:18:09 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:18:09 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:18:09 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 03:18:10 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:18:12 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:18:12 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:18:12 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 03:18:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-6ab268ce-41f5-4d64-b23f-072c6e061b3d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:18:12 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-6ab268ce-41f5-4d64-b23f-072c6e061b3d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:18:12 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:18:12 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lazy-loading 'info_cache' on Instance uuid 6ab268ce-41f5-4d64-b23f-072c6e061b3d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:18:13 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Updating instance_info_cache with network_info: [{"id": "4fce227a-af16-4fe8-8583-6d547f44654c", "address": "fa:16:3e:c9:3b:32", "network": {"id": "8cd30440-88b8-474a-93a2-f521b6dbfeb2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976042029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfae1cce998b41a485e8686882f9d524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fce227a-af", "ovs_interfaceid": "4fce227a-af16-4fe8-8583-6d547f44654c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:18:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-6ab268ce-41f5-4d64-b23f-072c6e061b3d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:18:13 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:18:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:15 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:18:15 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:18:16 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:18:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "5def6f32-4f27-4e72-8f11-35c5c64ffec5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:18:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "5def6f32-4f27-4e72-8f11-35c5c64ffec5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:18:16 user nova-compute[75391]: DEBUG nova.compute.manager [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 03:18:17 user nova-compute[75391]: INFO nova.compute.claims [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Claim successful on node user
Nov 15 03:18:17 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Refreshing inventories for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Updating ProviderTree inventory for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Updating inventory in ProviderTree for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Refreshing aggregate associations for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e, aggregates: None {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Refreshing trait associations for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG nova.compute.manager [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG nova.compute.manager [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG nova.network.neutron [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 03:18:17 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 03:18:17 user nova-compute[75391]: DEBUG nova.compute.manager [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 03:18:17 user nova-compute[75391]: INFO nova.virt.block_device [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Booting with volume fd0061d9-e81f-4a36-aa5f-9057f965025c at /dev/vda
Nov 15 03:18:17 user nova-compute[75391]: DEBUG os_brick.utils [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG nova.policy [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27184608c0aa47f993c5f2020e5f7df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac31667fa4804667afdb398aeb03d616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[963c0b6f-65bd-4e0e-ad41-184670dfdcd8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd86409-a620-49c4-a9e6-b8abb8dce11f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2351ab6-0362-493b-b58e-38425f4b97c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[50948f37-d59b-407a-bdcc-00054c9aee7a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:18:17 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 03:18:17 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9c78e4-6b9d-4670-a137-6ad71e96ad60]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG os_brick.utils [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Updating existing volume attachment record: ada8c25b-c165-47a6-93ef-202c6147b568 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 03:18:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:18:18 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:18:18 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:18:18 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:18:18 user nova-compute[75391]: DEBUG nova.network.neutron [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Successfully created port: 926bd439-042d-45e7-b14c-c5ebd9b262b3 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 03:18:18 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:18:18 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:18:18 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8966MB free_disk=24.992862701416016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:18:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:18:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:18:18 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6ab268ce-41f5-4d64-b23f-072c6e061b3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:18:18 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 5def6f32-4f27-4e72-8f11-35c5c64ffec5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:18:18 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:18:18 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:18:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:18 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:18:18 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:18:18 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:18:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.238s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:18:19 user nova-compute[75391]: DEBUG nova.network.neutron [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Successfully updated port: 926bd439-042d-45e7-b14c-c5ebd9b262b3 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 03:18:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "refresh_cache-5def6f32-4f27-4e72-8f11-35c5c64ffec5" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:18:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquired lock "refresh_cache-5def6f32-4f27-4e72-8f11-35c5c64ffec5" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:18:19 user nova-compute[75391]: DEBUG nova.network.neutron [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 03:18:19 user nova-compute[75391]: DEBUG nova.compute.manager [req-49b30e66-c822-4ea8-bddd-8cac9760103d req-e6779e7c-f6c4-4dd9-914b-a234d742deec service nova] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Received event network-changed-926bd439-042d-45e7-b14c-c5ebd9b262b3 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:18:19 user nova-compute[75391]: DEBUG nova.compute.manager [req-49b30e66-c822-4ea8-bddd-8cac9760103d req-e6779e7c-f6c4-4dd9-914b-a234d742deec service nova] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Refreshing instance network info cache due to event network-changed-926bd439-042d-45e7-b14c-c5ebd9b262b3. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:18:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-49b30e66-c822-4ea8-bddd-8cac9760103d req-e6779e7c-f6c4-4dd9-914b-a234d742deec service nova] Acquiring lock "refresh_cache-5def6f32-4f27-4e72-8f11-35c5c64ffec5" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:18:19 user nova-compute[75391]: DEBUG nova.network.neutron [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 03:18:19 user nova-compute[75391]: DEBUG nova.network.neutron [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Updating instance_info_cache with network_info: [{"id": "926bd439-042d-45e7-b14c-c5ebd9b262b3", "address": "fa:16:3e:da:4b:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap926bd439-04", "ovs_interfaceid": "926bd439-042d-45e7-b14c-c5ebd9b262b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:18:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Releasing lock "refresh_cache-5def6f32-4f27-4e72-8f11-35c5c64ffec5" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:18:19 user nova-compute[75391]: DEBUG nova.compute.manager [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Instance network_info: |[{"id": "926bd439-042d-45e7-b14c-c5ebd9b262b3", "address": "fa:16:3e:da:4b:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap926bd439-04", "ovs_interfaceid": "926bd439-042d-45e7-b14c-c5ebd9b262b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 03:18:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-49b30e66-c822-4ea8-bddd-8cac9760103d req-e6779e7c-f6c4-4dd9-914b-a234d742deec service nova] Acquired lock "refresh_cache-5def6f32-4f27-4e72-8f11-35c5c64ffec5" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:18:19 user nova-compute[75391]: DEBUG nova.network.neutron [req-49b30e66-c822-4ea8-bddd-8cac9760103d req-e6779e7c-f6c4-4dd9-914b-a234d742deec service nova] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Refreshing network info cache for port 926bd439-042d-45e7-b14c-c5ebd9b262b3 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:18:20 user nova-compute[75391]: DEBUG nova.network.neutron [req-49b30e66-c822-4ea8-bddd-8cac9760103d req-e6779e7c-f6c4-4dd9-914b-a234d742deec service nova] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Updated VIF entry in instance network info cache for port 926bd439-042d-45e7-b14c-c5ebd9b262b3. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:18:20 user nova-compute[75391]: DEBUG nova.network.neutron [req-49b30e66-c822-4ea8-bddd-8cac9760103d req-e6779e7c-f6c4-4dd9-914b-a234d742deec service nova] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Updating instance_info_cache with network_info: [{"id": "926bd439-042d-45e7-b14c-c5ebd9b262b3", "address": "fa:16:3e:da:4b:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap926bd439-04", "ovs_interfaceid": "926bd439-042d-45e7-b14c-c5ebd9b262b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:18:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-49b30e66-c822-4ea8-bddd-8cac9760103d req-e6779e7c-f6c4-4dd9-914b-a234d742deec service nova] Releasing lock "refresh_cache-5def6f32-4f27-4e72-8f11-35c5c64ffec5" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:18:20 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:18:20 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:18:21 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG nova.compute.manager [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 03:18:22 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Creating image(s)
Nov 15 03:18:22 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Did not create local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Ensure instance console log exists: /opt/stack/data/nova/instances/5def6f32-4f27-4e72-8f11-35c5c64ffec5/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Start _get_guest_xml network_info=[{"id": "926bd439-042d-45e7-b14c-c5ebd9b262b3", "address": "fa:16:3e:da:4b:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap926bd439-04", "ovs_interfaceid": "926bd439-042d-45e7-b14c-c5ebd9b262b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'ada8c25b-c165-47a6-93ef-202c6147b568', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PAUxtjJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5def6f32-4f27-4e72-8f11-35c5c64ffec5', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd0061d9-e81f-4a36-aa5f-9057f965025c', 'serial': 'fd0061d9-e81f-4a36-aa5f-9057f965025c'}, 'volume_type': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 03:18:22 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:18:22 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:18:22 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PAUxtjJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:18:22 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:18:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:18:22 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:18:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:18:22 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[60eb51a6-0b42-47a0-9db1-3124cdbe9a8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 03:18:22 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbc6a5c-566f-4a08-a008-63a422188b6f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c] added
Nov 15 03:18:22 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1d9d13-6688-46b6-8f89-120c2e0112c1]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bbb0a8-2418-428f-80d2-a6d9edd0cfe4]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PAUxtjJD {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PAUxtjJD" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2795f2ae-4af6-4f16-ac5c-5d24ac1225b6]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PAUxtjJD'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.085s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f240fe7-50fa-423c-8597-cb820ea29e6a]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bcd139-5cc9-4549-a720-90cef26d8cd5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 03:18:22 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 03:18:22 user nova-compute[75391]:  {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:18:22 user nova-compute[75391]: WARNING os_brick.initiator.connectors.iscsi [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 03:18:22 user nova-compute[75391]: 
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[689788a3-4549-48e5-90e8-e4c97fd2b66c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c, portal: 172.16.0.220,3260]
Nov 15 03:18:22 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c, portal: 172.16.0.220,3260] successful.
Nov 15 03:18:22 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c49f16-8954-4767-8d04-5b7decde95f4]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[70930a96-d9b0-402d-81b0-ce8d343c24dc]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c (non-flash)
Nov 15 03:18:22 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c (non-flash)
Nov 15 03:18:22 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e760ce-123a-48f3-972d-1587fb1159eb]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:18:22 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PAUxtjJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23062633639383835', 'path': '/dev/sdb'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062633639383835', 'path': '/dev/sdb'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:18:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-820114808',display_name='tempest-TestVolumeBootPattern-volume-backed-server-820114808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-820114808',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuA6dE9/9yCg8iAw1JxYiTg/Db8I5h1dUjAC32JEUYERV5ldGGuvxrFvb2YZtVkBVjTN3XTUiim8e0XEyqsp9f/lygcOv9+IdIM18fD8UOY4q4jWW0fW4lq17skltC7dQ==',key_name='tempest-keypair-89441821',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac31667fa4804667afdb398aeb03d616',ramdisk_id='',reservation_id='r-bjq09z9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1108994886',owner_user_name='tempest-TestVolumeBootPattern-1108994886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:18:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27184608c0aa47f993c5f2020e5f7df4',uuid=5def6f32-4f27-4e72-8f11-35c5c64ffec5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "926bd439-042d-45e7-b14c-c5ebd9b262b3", "address": "fa:16:3e:da:4b:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap926bd439-04", "ovs_interfaceid": "926bd439-042d-45e7-b14c-c5ebd9b262b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converting VIF {"id": "926bd439-042d-45e7-b14c-c5ebd9b262b3", "address": "fa:16:3e:da:4b:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap926bd439-04", "ovs_interfaceid": "926bd439-042d-45e7-b14c-c5ebd9b262b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:4b:66,bridge_name='br-int',has_traffic_filtering=True,id=926bd439-042d-45e7-b14c-c5ebd9b262b3,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap926bd439-04') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG nova.objects.instance [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lazy-loading 'pci_devices' on Instance uuid 5def6f32-4f27-4e72-8f11-35c5c64ffec5 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] End _get_guest_xml xml=<domain type="kvm">
Nov 15 03:18:23 user nova-compute[75391]:   <uuid>5def6f32-4f27-4e72-8f11-35c5c64ffec5</uuid>
Nov 15 03:18:23 user nova-compute[75391]:   <name>instance-00000030</name>
Nov 15 03:18:23 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 03:18:23 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 03:18:23 user nova-compute[75391]:   <metadata>
Nov 15 03:18:23 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 03:18:23 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 03:18:23 user nova-compute[75391]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-820114808</nova:name>
Nov 15 03:18:23 user nova-compute[75391]:       <nova:creationTime>2023-11-15 03:18:22</nova:creationTime>
Nov 15 03:18:23 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 03:18:23 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 03:18:23 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 03:18:23 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 03:18:23 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 03:18:23 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 03:18:23 user nova-compute[75391]:       </nova:flavor>
Nov 15 03:18:23 user nova-compute[75391]:       <nova:owner>
Nov 15 03:18:23 user nova-compute[75391]:         <nova:user uuid="27184608c0aa47f993c5f2020e5f7df4">tempest-TestVolumeBootPattern-1108994886-project-member</nova:user>
Nov 15 03:18:23 user nova-compute[75391]:         <nova:project uuid="ac31667fa4804667afdb398aeb03d616">tempest-TestVolumeBootPattern-1108994886</nova:project>
Nov 15 03:18:23 user nova-compute[75391]:       </nova:owner>
Nov 15 03:18:23 user nova-compute[75391]:       <nova:ports>
Nov 15 03:18:23 user nova-compute[75391]:         <nova:port uuid="926bd439-042d-45e7-b14c-c5ebd9b262b3">
Nov 15 03:18:23 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 03:18:23 user nova-compute[75391]:         </nova:port>
Nov 15 03:18:23 user nova-compute[75391]:       </nova:ports>
Nov 15 03:18:23 user nova-compute[75391]:     </nova:instance>
Nov 15 03:18:23 user nova-compute[75391]:   </metadata>
Nov 15 03:18:23 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 03:18:23 user nova-compute[75391]:     <system>
Nov 15 03:18:23 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 03:18:23 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 03:18:23 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 03:18:23 user nova-compute[75391]:       <entry name="serial">5def6f32-4f27-4e72-8f11-35c5c64ffec5</entry>
Nov 15 03:18:23 user nova-compute[75391]:       <entry name="uuid">5def6f32-4f27-4e72-8f11-35c5c64ffec5</entry>
Nov 15 03:18:23 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 03:18:23 user nova-compute[75391]:     </system>
Nov 15 03:18:23 user nova-compute[75391]:   </sysinfo>
Nov 15 03:18:23 user nova-compute[75391]:   <os>
Nov 15 03:18:23 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 03:18:23 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 03:18:23 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 03:18:23 user nova-compute[75391]:   </os>
Nov 15 03:18:23 user nova-compute[75391]:   <features>
Nov 15 03:18:23 user nova-compute[75391]:     <acpi/>
Nov 15 03:18:23 user nova-compute[75391]:     <apic/>
Nov 15 03:18:23 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 03:18:23 user nova-compute[75391]:   </features>
Nov 15 03:18:23 user nova-compute[75391]:   <clock offset="utc">
Nov 15 03:18:23 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 03:18:23 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 03:18:23 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 03:18:23 user nova-compute[75391]:   </clock>
Nov 15 03:18:23 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 03:18:23 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 03:18:23 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 03:18:23 user nova-compute[75391]:   </cpu>
Nov 15 03:18:23 user nova-compute[75391]:   <devices>
Nov 15 03:18:23 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 03:18:23 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:18:23 user nova-compute[75391]:       <source dev="/dev/sdb"/>
Nov 15 03:18:23 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 03:18:23 user nova-compute[75391]:       <serial>fd0061d9-e81f-4a36-aa5f-9057f965025c</serial>
Nov 15 03:18:23 user nova-compute[75391]:     </disk>
Nov 15 03:18:23 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 03:18:23 user nova-compute[75391]:       <mac address="fa:16:3e:da:4b:66"/>
Nov 15 03:18:23 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:18:23 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 03:18:23 user nova-compute[75391]:       <target dev="tap926bd439-04"/>
Nov 15 03:18:23 user nova-compute[75391]:     </interface>
Nov 15 03:18:23 user nova-compute[75391]:     <serial type="pty">
Nov 15 03:18:23 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/5def6f32-4f27-4e72-8f11-35c5c64ffec5/console.log" append="off"/>
Nov 15 03:18:23 user nova-compute[75391]:     </serial>
Nov 15 03:18:23 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 03:18:23 user nova-compute[75391]:     <video>
Nov 15 03:18:23 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:18:23 user nova-compute[75391]:     </video>
Nov 15 03:18:23 user nova-compute[75391]:     <rng model="virtio">
Nov 15 03:18:23 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 03:18:23 user nova-compute[75391]:     </rng>
Nov 15 03:18:23 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 03:18:23 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 03:18:23 user nova-compute[75391]:       <stats period="10"/>
Nov 15 03:18:23 user nova-compute[75391]:     </memballoon>
Nov 15 03:18:23 user nova-compute[75391]:   </devices>
Nov 15 03:18:23 user nova-compute[75391]: </domain>
Nov 15 03:18:23 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:18:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-820114808',display_name='tempest-TestVolumeBootPattern-volume-backed-server-820114808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-820114808',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuA6dE9/9yCg8iAw1JxYiTg/Db8I5h1dUjAC32JEUYERV5ldGGuvxrFvb2YZtVkBVjTN3XTUiim8e0XEyqsp9f/lygcOv9+IdIM18fD8UOY4q4jWW0fW4lq17skltC7dQ==',key_name='tempest-keypair-89441821',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac31667fa4804667afdb398aeb03d616',ramdisk_id='',reservation_id='r-bjq09z9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1108994886',owner_user_name='tempest-TestVolumeBootPattern-1108994886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:18:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27184608c0aa47f993c5f2020e5f7df4',uuid=5def6f32-4f27-4e72-8f11-35c5c64ffec5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "926bd439-042d-45e7-b14c-c5ebd9b262b3", "address": "fa:16:3e:da:4b:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap926bd439-04", "ovs_interfaceid": "926bd439-042d-45e7-b14c-c5ebd9b262b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converting VIF {"id": "926bd439-042d-45e7-b14c-c5ebd9b262b3", "address": "fa:16:3e:da:4b:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap926bd439-04", "ovs_interfaceid": "926bd439-042d-45e7-b14c-c5ebd9b262b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:4b:66,bridge_name='br-int',has_traffic_filtering=True,id=926bd439-042d-45e7-b14c-c5ebd9b262b3,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap926bd439-04') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG os_vif [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:4b:66,bridge_name='br-int',has_traffic_filtering=True,id=926bd439-042d-45e7-b14c-c5ebd9b262b3,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap926bd439-04') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f808f828-8969-5ae6-a6d0-586ab0494535', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap926bd439-04, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap926bd439-04, col_values=(('qos', UUID('52a38c85-ee53-4d6e-8c6b-7ad1a1bb1bad')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap926bd439-04, col_values=(('external_ids', {'iface-id': '926bd439-042d-45e7-b14c-c5ebd9b262b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:4b:66', 'vm-uuid': '5def6f32-4f27-4e72-8f11-35c5c64ffec5'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:23 user nova-compute[75391]: INFO os_vif [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:4b:66,bridge_name='br-int',has_traffic_filtering=True,id=926bd439-042d-45e7-b14c-c5ebd9b262b3,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap926bd439-04')
Nov 15 03:18:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:18:23 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] No VIF found with MAC fa:16:3e:da:4b:66, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 03:18:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:25 user nova-compute[75391]: DEBUG nova.compute.manager [req-61ffcc94-c21f-48d2-b152-474aa729c911 req-5d2fcc27-fc6f-449f-8914-e1903b8bc819 service nova] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Received event network-vif-plugged-926bd439-042d-45e7-b14c-c5ebd9b262b3 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:18:25 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-61ffcc94-c21f-48d2-b152-474aa729c911 req-5d2fcc27-fc6f-449f-8914-e1903b8bc819 service nova] Acquiring lock "5def6f32-4f27-4e72-8f11-35c5c64ffec5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:18:25 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-61ffcc94-c21f-48d2-b152-474aa729c911 req-5d2fcc27-fc6f-449f-8914-e1903b8bc819 service nova] Lock "5def6f32-4f27-4e72-8f11-35c5c64ffec5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:18:25 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-61ffcc94-c21f-48d2-b152-474aa729c911 req-5d2fcc27-fc6f-449f-8914-e1903b8bc819 service nova] Lock "5def6f32-4f27-4e72-8f11-35c5c64ffec5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:18:25 user nova-compute[75391]: DEBUG nova.compute.manager [req-61ffcc94-c21f-48d2-b152-474aa729c911 req-5d2fcc27-fc6f-449f-8914-e1903b8bc819 service nova] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] No waiting events found dispatching network-vif-plugged-926bd439-042d-45e7-b14c-c5ebd9b262b3 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:18:25 user nova-compute[75391]: WARNING nova.compute.manager [req-61ffcc94-c21f-48d2-b152-474aa729c911 req-5d2fcc27-fc6f-449f-8914-e1903b8bc819 service nova] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Received unexpected event network-vif-plugged-926bd439-042d-45e7-b14c-c5ebd9b262b3 for instance with vm_state building and task_state spawning.
Nov 15 03:18:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:27 user nova-compute[75391]: DEBUG nova.compute.manager [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 03:18:27 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 03:18:27 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Instance spawned successfully.
Nov 15 03:18:27 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 03:18:27 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:18:27 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:18:27 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:18:27 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:18:27 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:18:27 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:18:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-73750017-3cea-435b-9004-14c306b6537e req-ab1de0a9-ac3e-4b01-9f28-be45799a022c service nova] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Received event network-vif-plugged-926bd439-042d-45e7-b14c-c5ebd9b262b3 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:18:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-73750017-3cea-435b-9004-14c306b6537e req-ab1de0a9-ac3e-4b01-9f28-be45799a022c service nova] Acquiring lock "5def6f32-4f27-4e72-8f11-35c5c64ffec5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:18:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-73750017-3cea-435b-9004-14c306b6537e req-ab1de0a9-ac3e-4b01-9f28-be45799a022c service nova] Lock "5def6f32-4f27-4e72-8f11-35c5c64ffec5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:18:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-73750017-3cea-435b-9004-14c306b6537e req-ab1de0a9-ac3e-4b01-9f28-be45799a022c service nova] Lock "5def6f32-4f27-4e72-8f11-35c5c64ffec5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:18:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-73750017-3cea-435b-9004-14c306b6537e req-ab1de0a9-ac3e-4b01-9f28-be45799a022c service nova] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] No waiting events found dispatching network-vif-plugged-926bd439-042d-45e7-b14c-c5ebd9b262b3 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:18:27 user nova-compute[75391]: WARNING nova.compute.manager [req-73750017-3cea-435b-9004-14c306b6537e req-ab1de0a9-ac3e-4b01-9f28-be45799a022c service nova] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Received unexpected event network-vif-plugged-926bd439-042d-45e7-b14c-c5ebd9b262b3 for instance with vm_state building and task_state spawning.
Nov 15 03:18:27 user nova-compute[75391]: INFO nova.compute.manager [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 15 03:18:27 user nova-compute[75391]: DEBUG nova.compute.manager [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 03:18:27 user nova-compute[75391]: INFO nova.compute.manager [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Took 10.40 seconds to build instance.
Nov 15 03:18:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-537463ab-676f-4629-9e12-2674b9bc9cec tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "5def6f32-4f27-4e72-8f11-35c5c64ffec5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.511s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:18:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:33 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:18:33 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Cleaning up deleted instances {{(pid=75391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 03:18:33 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] There are 0 instances to clean {{(pid=75391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 03:18:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:18:39 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:18:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:18:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:19:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:19:08 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:19:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:19:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:19:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:19:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:19:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:19:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:19:11 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:19:12 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:19:13 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:19:13 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:19:13 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 03:19:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-6ab268ce-41f5-4d64-b23f-072c6e061b3d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:19:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-6ab268ce-41f5-4d64-b23f-072c6e061b3d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:19:13 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:19:13 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lazy-loading 'info_cache' on Instance uuid 6ab268ce-41f5-4d64-b23f-072c6e061b3d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:19:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:19:14 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Updating instance_info_cache with network_info: [{"id": "4fce227a-af16-4fe8-8583-6d547f44654c", "address": "fa:16:3e:c9:3b:32", "network": {"id": "8cd30440-88b8-474a-93a2-f521b6dbfeb2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976042029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfae1cce998b41a485e8686882f9d524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fce227a-af", "ovs_interfaceid": "4fce227a-af16-4fe8-8583-6d547f44654c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:19:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-6ab268ce-41f5-4d64-b23f-072c6e061b3d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:19:14 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:19:15 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:19:16 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:19:17 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_power_states {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:19:17 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid 6ab268ce-41f5-4d64-b23f-072c6e061b3d {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 03:19:17 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid 5def6f32-4f27-4e72-8f11-35c5c64ffec5 {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 03:19:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "6ab268ce-41f5-4d64-b23f-072c6e061b3d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:19:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "6ab268ce-41f5-4d64-b23f-072c6e061b3d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:19:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "5def6f32-4f27-4e72-8f11-35c5c64ffec5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:19:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "5def6f32-4f27-4e72-8f11-35c5c64ffec5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:19:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "6ab268ce-41f5-4d64-b23f-072c6e061b3d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:19:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "5def6f32-4f27-4e72-8f11-35c5c64ffec5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:19:17 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:19:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:19:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:19:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:19:17 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:19:17 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 03:19:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:19:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:19:17 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:19:18 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:19:18 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:19:18 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:19:18 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8845MB free_disk=24.991252899169922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:19:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:19:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:19:18 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 6ab268ce-41f5-4d64-b23f-072c6e061b3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:19:18 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 5def6f32-4f27-4e72-8f11-35c5c64ffec5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:19:18 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:19:18 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:19:18 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:19:18 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:19:18 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:19:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:19:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:19:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0ba06a92-8706-41e0-a4f0-68976f63434e tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Acquiring lock "6ab268ce-41f5-4d64-b23f-072c6e061b3d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:19:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0ba06a92-8706-41e0-a4f0-68976f63434e tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "6ab268ce-41f5-4d64-b23f-072c6e061b3d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:19:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0ba06a92-8706-41e0-a4f0-68976f63434e tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Acquiring lock "6ab268ce-41f5-4d64-b23f-072c6e061b3d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:19:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0ba06a92-8706-41e0-a4f0-68976f63434e tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "6ab268ce-41f5-4d64-b23f-072c6e061b3d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:19:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0ba06a92-8706-41e0-a4f0-68976f63434e tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "6ab268ce-41f5-4d64-b23f-072c6e061b3d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:19:18 user nova-compute[75391]: INFO nova.compute.manager [None req-0ba06a92-8706-41e0-a4f0-68976f63434e tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Terminating instance
Nov 15 03:19:18 user nova-compute[75391]: DEBUG nova.compute.manager [None req-0ba06a92-8706-41e0-a4f0-68976f63434e tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 03:19:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:19:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:19:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:19:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:19:19 user nova-compute[75391]: DEBUG nova.compute.manager [req-0b606b1d-44e9-466f-b64d-d16b937c6aee req-599f2a80-45d1-475c-b45a-d7dd34afe3e2 service nova] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Received event network-vif-unplugged-4fce227a-af16-4fe8-8583-6d547f44654c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:19:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0b606b1d-44e9-466f-b64d-d16b937c6aee req-599f2a80-45d1-475c-b45a-d7dd34afe3e2 service nova] Acquiring lock "6ab268ce-41f5-4d64-b23f-072c6e061b3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:19:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0b606b1d-44e9-466f-b64d-d16b937c6aee req-599f2a80-45d1-475c-b45a-d7dd34afe3e2 service nova] Lock "6ab268ce-41f5-4d64-b23f-072c6e061b3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:19:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0b606b1d-44e9-466f-b64d-d16b937c6aee req-599f2a80-45d1-475c-b45a-d7dd34afe3e2 service nova] Lock "6ab268ce-41f5-4d64-b23f-072c6e061b3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:19:19 user nova-compute[75391]: DEBUG nova.compute.manager [req-0b606b1d-44e9-466f-b64d-d16b937c6aee req-599f2a80-45d1-475c-b45a-d7dd34afe3e2 service nova] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] No waiting events found dispatching network-vif-unplugged-4fce227a-af16-4fe8-8583-6d547f44654c {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:19:19 user nova-compute[75391]: DEBUG nova.compute.manager [req-0b606b1d-44e9-466f-b64d-d16b937c6aee req-599f2a80-45d1-475c-b45a-d7dd34afe3e2 service nova] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Received event network-vif-unplugged-4fce227a-af16-4fe8-8583-6d547f44654c for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 03:19:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:19:19 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Instance destroyed successfully.
Nov 15 03:19:19 user nova-compute[75391]: DEBUG nova.objects.instance [None req-0ba06a92-8706-41e0-a4f0-68976f63434e tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lazy-loading 'resources' on Instance uuid 6ab268ce-41f5-4d64-b23f-072c6e061b3d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:19:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-0ba06a92-8706-41e0-a4f0-68976f63434e tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:10:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-566146823',display_name='tempest-ServersNegativeTestJSON-server-566146823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-566146823',id=44,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T03:10:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dfae1cce998b41a485e8686882f9d524',ramdisk_id='',reservation_id='r-08otb3ss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1763001545',owner_user_name='tempest-ServersNegativeTestJSON-1763001545-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T03:10:43Z,user_data=None,user_id='d2be875a591641d9aa32e5588c849067',uuid=6ab268ce-41f5-4d64-b23f-072c6e061b3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fce227a-af16-4fe8-8583-6d547f44654c", "address": "fa:16:3e:c9:3b:32", "network": {"id": "8cd30440-88b8-474a-93a2-f521b6dbfeb2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976042029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfae1cce998b41a485e8686882f9d524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fce227a-af", "ovs_interfaceid": "4fce227a-af16-4fe8-8583-6d547f44654c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 03:19:19 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-0ba06a92-8706-41e0-a4f0-68976f63434e tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Converting VIF {"id": "4fce227a-af16-4fe8-8583-6d547f44654c", "address": "fa:16:3e:c9:3b:32", "network": {"id": "8cd30440-88b8-474a-93a2-f521b6dbfeb2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1976042029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfae1cce998b41a485e8686882f9d524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fce227a-af", "ovs_interfaceid": "4fce227a-af16-4fe8-8583-6d547f44654c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:19:19 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-0ba06a92-8706-41e0-a4f0-68976f63434e tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:3b:32,bridge_name='br-int',has_traffic_filtering=True,id=4fce227a-af16-4fe8-8583-6d547f44654c,network=Network(8cd30440-88b8-474a-93a2-f521b6dbfeb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fce227a-af') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:19:19 user nova-compute[75391]: DEBUG os_vif [None req-0ba06a92-8706-41e0-a4f0-68976f63434e tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:3b:32,bridge_name='br-int',has_traffic_filtering=True,id=4fce227a-af16-4fe8-8583-6d547f44654c,network=Network(8cd30440-88b8-474a-93a2-f521b6dbfeb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fce227a-af') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 03:19:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:19:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fce227a-af, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:19:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:19:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:19:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1fbef301-a558-4bca-850e-c62b78bfa9f9) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:19:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:19:19 user nova-compute[75391]: INFO os_vif [None req-0ba06a92-8706-41e0-a4f0-68976f63434e tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:3b:32,bridge_name='br-int',has_traffic_filtering=True,id=4fce227a-af16-4fe8-8583-6d547f44654c,network=Network(8cd30440-88b8-474a-93a2-f521b6dbfeb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fce227a-af')
Nov 15 03:19:19 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-0ba06a92-8706-41e0-a4f0-68976f63434e tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Deleting instance files /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d_del
Nov 15 03:19:19 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-0ba06a92-8706-41e0-a4f0-68976f63434e tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Deletion of /opt/stack/data/nova/instances/6ab268ce-41f5-4d64-b23f-072c6e061b3d_del complete
Nov 15 03:19:19 user nova-compute[75391]: INFO nova.compute.manager [None req-0ba06a92-8706-41e0-a4f0-68976f63434e tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 15 03:19:19 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-0ba06a92-8706-41e0-a4f0-68976f63434e tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 03:19:19 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 03:19:19 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 03:19:20 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:19:20 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Took 0.41 seconds to deallocate network for instance.
Nov 15 03:19:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0ba06a92-8706-41e0-a4f0-68976f63434e tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:19:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0ba06a92-8706-41e0-a4f0-68976f63434e tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:19:20 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-0ba06a92-8706-41e0-a4f0-68976f63434e tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:19:20 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-0ba06a92-8706-41e0-a4f0-68976f63434e tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:19:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0ba06a92-8706-41e0-a4f0-68976f63434e tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:19:20 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-0ba06a92-8706-41e0-a4f0-68976f63434e tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Deleted allocations for instance 6ab268ce-41f5-4d64-b23f-072c6e061b3d
Nov 15 03:19:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-0ba06a92-8706-41e0-a4f0-68976f63434e tempest-ServersNegativeTestJSON-1763001545 tempest-ServersNegativeTestJSON-1763001545-project-member] Lock "6ab268ce-41f5-4d64-b23f-072c6e061b3d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.460s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:19:20 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:19:20 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:19:21 user nova-compute[75391]: DEBUG nova.compute.manager [req-d3b5cb18-bcc7-4bcb-a1f6-548bbc748d93 req-04d88567-338e-4e88-97a3-33f458555b48 service nova] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Received event network-vif-plugged-4fce227a-af16-4fe8-8583-6d547f44654c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:19:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d3b5cb18-bcc7-4bcb-a1f6-548bbc748d93 req-04d88567-338e-4e88-97a3-33f458555b48 service nova] Acquiring lock "6ab268ce-41f5-4d64-b23f-072c6e061b3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:19:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d3b5cb18-bcc7-4bcb-a1f6-548bbc748d93 req-04d88567-338e-4e88-97a3-33f458555b48 service nova] Lock "6ab268ce-41f5-4d64-b23f-072c6e061b3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:19:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d3b5cb18-bcc7-4bcb-a1f6-548bbc748d93 req-04d88567-338e-4e88-97a3-33f458555b48 service nova] Lock "6ab268ce-41f5-4d64-b23f-072c6e061b3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:19:21 user nova-compute[75391]: DEBUG nova.compute.manager [req-d3b5cb18-bcc7-4bcb-a1f6-548bbc748d93 req-04d88567-338e-4e88-97a3-33f458555b48 service nova] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] No waiting events found dispatching network-vif-plugged-4fce227a-af16-4fe8-8583-6d547f44654c {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:19:21 user nova-compute[75391]: WARNING nova.compute.manager [req-d3b5cb18-bcc7-4bcb-a1f6-548bbc748d93 req-04d88567-338e-4e88-97a3-33f458555b48 service nova] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Received unexpected event network-vif-plugged-4fce227a-af16-4fe8-8583-6d547f44654c for instance with vm_state deleted and task_state None.
Nov 15 03:19:21 user nova-compute[75391]: DEBUG nova.compute.manager [req-d3b5cb18-bcc7-4bcb-a1f6-548bbc748d93 req-04d88567-338e-4e88-97a3-33f458555b48 service nova] [instance: 6ab268ce-41f5-4d64-b23f-072c6e061b3d] Received event network-vif-deleted-4fce227a-af16-4fe8-8583-6d547f44654c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:19:23 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:19:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:19:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:19:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:19:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:19:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:19:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:19:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:19:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:19:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:19:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:19:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:19:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:19:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:19:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:19:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:19:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:19:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:19:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-bca33538-04ac-4f9f-b6ff-a7c4cb06d1d4 req-474e029f-ba99-492e-acf0-bedf7390d6d8 service nova] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Received event network-changed-926bd439-042d-45e7-b14c-c5ebd9b262b3 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:20:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-bca33538-04ac-4f9f-b6ff-a7c4cb06d1d4 req-474e029f-ba99-492e-acf0-bedf7390d6d8 service nova] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Refreshing instance network info cache due to event network-changed-926bd439-042d-45e7-b14c-c5ebd9b262b3. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:20:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bca33538-04ac-4f9f-b6ff-a7c4cb06d1d4 req-474e029f-ba99-492e-acf0-bedf7390d6d8 service nova] Acquiring lock "refresh_cache-5def6f32-4f27-4e72-8f11-35c5c64ffec5" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:20:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bca33538-04ac-4f9f-b6ff-a7c4cb06d1d4 req-474e029f-ba99-492e-acf0-bedf7390d6d8 service nova] Acquired lock "refresh_cache-5def6f32-4f27-4e72-8f11-35c5c64ffec5" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:20:07 user nova-compute[75391]: DEBUG nova.network.neutron [req-bca33538-04ac-4f9f-b6ff-a7c4cb06d1d4 req-474e029f-ba99-492e-acf0-bedf7390d6d8 service nova] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Refreshing network info cache for port 926bd439-042d-45e7-b14c-c5ebd9b262b3 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:20:08 user nova-compute[75391]: DEBUG nova.network.neutron [req-bca33538-04ac-4f9f-b6ff-a7c4cb06d1d4 req-474e029f-ba99-492e-acf0-bedf7390d6d8 service nova] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Updated VIF entry in instance network info cache for port 926bd439-042d-45e7-b14c-c5ebd9b262b3. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:20:08 user nova-compute[75391]: DEBUG nova.network.neutron [req-bca33538-04ac-4f9f-b6ff-a7c4cb06d1d4 req-474e029f-ba99-492e-acf0-bedf7390d6d8 service nova] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Updating instance_info_cache with network_info: [{"id": "926bd439-042d-45e7-b14c-c5ebd9b262b3", "address": "fa:16:3e:da:4b:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap926bd439-04", "ovs_interfaceid": "926bd439-042d-45e7-b14c-c5ebd9b262b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:20:08 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-bca33538-04ac-4f9f-b6ff-a7c4cb06d1d4 req-474e029f-ba99-492e-acf0-bedf7390d6d8 service nova] Releasing lock "refresh_cache-5def6f32-4f27-4e72-8f11-35c5c64ffec5" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:20:08 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:20:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:12 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:20:13 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:20:13 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:20:13 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:20:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-5def6f32-4f27-4e72-8f11-35c5c64ffec5" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:20:13 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-5def6f32-4f27-4e72-8f11-35c5c64ffec5" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:20:13 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:20:14 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Updating instance_info_cache with network_info: [{"id": "926bd439-042d-45e7-b14c-c5ebd9b262b3", "address": "fa:16:3e:da:4b:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap926bd439-04", "ovs_interfaceid": "926bd439-042d-45e7-b14c-c5ebd9b262b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:20:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-5def6f32-4f27-4e72-8f11-35c5c64ffec5" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:20:14 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:20:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "a9635474-cc42-4b7b-975d-6f990fadfdee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:20:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "a9635474-cc42-4b7b-975d-6f990fadfdee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:20:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:14 user nova-compute[75391]: DEBUG nova.compute.manager [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 03:20:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:20:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:20:14 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 03:20:14 user nova-compute[75391]: INFO nova.compute.claims [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Claim successful on node user
Nov 15 03:20:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:14 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:20:14 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:20:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.248s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:20:14 user nova-compute[75391]: DEBUG nova.compute.manager [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 03:20:14 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 03:20:14 user nova-compute[75391]: DEBUG nova.compute.manager [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 03:20:14 user nova-compute[75391]: DEBUG nova.network.neutron [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 03:20:14 user nova-compute[75391]: DEBUG nova.compute.manager [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 03:20:14 user nova-compute[75391]: INFO nova.virt.block_device [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Booting with volume snapshot 2c718c07-5b70-455d-81c2-311b5116c867 at /dev/vda
Nov 15 03:20:14 user nova-compute[75391]: DEBUG nova.policy [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27184608c0aa47f993c5f2020e5f7df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac31667fa4804667afdb398aeb03d616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 03:20:15 user nova-compute[75391]: DEBUG nova.network.neutron [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Successfully created port: f25b5ade-e1fd-408c-a8a2-3ccc724a64fa {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 03:20:15 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:20:16 user nova-compute[75391]: DEBUG nova.network.neutron [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Successfully updated port: f25b5ade-e1fd-408c-a8a2-3ccc724a64fa {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 03:20:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "refresh_cache-a9635474-cc42-4b7b-975d-6f990fadfdee" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:20:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquired lock "refresh_cache-a9635474-cc42-4b7b-975d-6f990fadfdee" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:20:16 user nova-compute[75391]: DEBUG nova.network.neutron [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 03:20:16 user nova-compute[75391]: DEBUG nova.compute.manager [req-918eae90-9429-40a5-8291-c82b9c57a579 req-bbc4b459-c3b5-42a3-8257-469c14a251dc service nova] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Received event network-changed-f25b5ade-e1fd-408c-a8a2-3ccc724a64fa {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:20:16 user nova-compute[75391]: DEBUG nova.compute.manager [req-918eae90-9429-40a5-8291-c82b9c57a579 req-bbc4b459-c3b5-42a3-8257-469c14a251dc service nova] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Refreshing instance network info cache due to event network-changed-f25b5ade-e1fd-408c-a8a2-3ccc724a64fa. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:20:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-918eae90-9429-40a5-8291-c82b9c57a579 req-bbc4b459-c3b5-42a3-8257-469c14a251dc service nova] Acquiring lock "refresh_cache-a9635474-cc42-4b7b-975d-6f990fadfdee" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:20:16 user nova-compute[75391]: DEBUG nova.network.neutron [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 03:20:16 user nova-compute[75391]: DEBUG nova.network.neutron [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Updating instance_info_cache with network_info: [{"id": "f25b5ade-e1fd-408c-a8a2-3ccc724a64fa", "address": "fa:16:3e:d5:c7:51", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25b5ade-e1", "ovs_interfaceid": "f25b5ade-e1fd-408c-a8a2-3ccc724a64fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:20:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Releasing lock "refresh_cache-a9635474-cc42-4b7b-975d-6f990fadfdee" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:20:16 user nova-compute[75391]: DEBUG nova.compute.manager [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Instance network_info: |[{"id": "f25b5ade-e1fd-408c-a8a2-3ccc724a64fa", "address": "fa:16:3e:d5:c7:51", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25b5ade-e1", "ovs_interfaceid": "f25b5ade-e1fd-408c-a8a2-3ccc724a64fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 03:20:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-918eae90-9429-40a5-8291-c82b9c57a579 req-bbc4b459-c3b5-42a3-8257-469c14a251dc service nova] Acquired lock "refresh_cache-a9635474-cc42-4b7b-975d-6f990fadfdee" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:20:16 user nova-compute[75391]: DEBUG nova.network.neutron [req-918eae90-9429-40a5-8291-c82b9c57a579 req-bbc4b459-c3b5-42a3-8257-469c14a251dc service nova] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Refreshing network info cache for port f25b5ade-e1fd-408c-a8a2-3ccc724a64fa {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:20:16 user nova-compute[75391]: DEBUG nova.network.neutron [req-918eae90-9429-40a5-8291-c82b9c57a579 req-bbc4b459-c3b5-42a3-8257-469c14a251dc service nova] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Updated VIF entry in instance network info cache for port f25b5ade-e1fd-408c-a8a2-3ccc724a64fa. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:20:16 user nova-compute[75391]: DEBUG nova.network.neutron [req-918eae90-9429-40a5-8291-c82b9c57a579 req-bbc4b459-c3b5-42a3-8257-469c14a251dc service nova] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Updating instance_info_cache with network_info: [{"id": "f25b5ade-e1fd-408c-a8a2-3ccc724a64fa", "address": "fa:16:3e:d5:c7:51", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25b5ade-e1", "ovs_interfaceid": "f25b5ade-e1fd-408c-a8a2-3ccc724a64fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:20:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-918eae90-9429-40a5-8291-c82b9c57a579 req-bbc4b459-c3b5-42a3-8257-469c14a251dc service nova] Releasing lock "refresh_cache-a9635474-cc42-4b7b-975d-6f990fadfdee" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:20:18 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:20:18 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:20:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:19 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:20:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:20:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:20:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:20:19 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:20:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 03:20:20 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:20:20 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:20:20 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8962MB free_disk=25.017196655273438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 5def6f32-4f27-4e72-8f11-35c5c64ffec5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance a9635474-cc42-4b7b-975d-6f990fadfdee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG os_brick.utils [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c7499a-a89c-4e39-a8f4-7ee42ff6fd37]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f316dea-fc2b-4234-9095-a468943946a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06e3849-e183-4616-9ee0-1f628af66f94]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba51ea4f-98f5-4e25-88a9-b8a64ef86ce6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:20:20 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 03:20:20 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0697fc-5a16-4240-8e2a-105a91cdba99]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG os_brick.utils [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:20:20 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Updating existing volume attachment record: b5edc60f-ad61-417a-90da-cf5ad1eaee95 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 03:20:21 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:20:21 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:20:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG nova.compute.manager [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 03:20:25 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Creating image(s)
Nov 15 03:20:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Did not create local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Ensure instance console log exists: /opt/stack/data/nova/instances/a9635474-cc42-4b7b-975d-6f990fadfdee/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Start _get_guest_xml network_info=[{"id": "f25b5ade-e1fd-408c-a8a2-3ccc724a64fa", "address": "fa:16:3e:d5:c7:51", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25b5ade-e1", "ovs_interfaceid": "f25b5ade-e1fd-408c-a8a2-3ccc724a64fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-15T03:20:10Z,direct_url=<?>,disk_format='qcow2',id=bb0c6ed4-5cb2-4396-b90b-dcb6f6509612,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1860294638',owner='ac31667fa4804667afdb398aeb03d616',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-15T03:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'b5edc60f-ad61-417a-90da-cf5ad1eaee95', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KzxRgVrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a9635474-cc42-4b7b-975d-6f990fadfdee', 'attached_at': '', 'detached_at': '', 'volume_id': '09972b68-084c-4a74-bac5-bbfe40d47fd3', 'serial': '09972b68-084c-4a74-bac5-bbfe40d47fd3'}, 'volume_type': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 03:20:25 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:20:25 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:20:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-15T03:20:10Z,direct_url=<?>,disk_format='qcow2',id=bb0c6ed4-5cb2-4396-b90b-dcb6f6509612,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1860294638',owner='ac31667fa4804667afdb398aeb03d616',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-15T03:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KzxRgVrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:20:25 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:20:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:20:25 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:20:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:20:25 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7942820e-7e6d-441a-a8ea-fc43e1c48e10]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 03:20:25 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff27617-a413-4ff0-a9d9-0d59c6758c82]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3] added
Nov 15 03:20:25 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f06ecb9-732e-45bf-95f8-5a15206b7aad]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b7c597-2d35-4803-8620-9df625312b3f]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KzxRgVrh {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KzxRgVrh" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6867af-8608-4148-902e-8419a406677d]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KzxRgVrh'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5ac000-40b9-4948-ae4c-95a217dc3351]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b26af4-2055-4db6-9702-32006d69258a]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c (non-flash)
Nov 15 03:20:25 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c (non-flash)
Nov 15 03:20:25 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9908fe4-d7d3-436d-a731-bb4f2dc44be4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3, portal: 172.16.0.220,3260]
Nov 15 03:20:25 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3, portal: 172.16.0.220,3260] successful.
Nov 15 03:20:25 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75014ef-3b2b-4404-82c8-35fd1126c498]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f67b31-129f-4673-938e-5b7807dca73a]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c (non-flash)
Nov 15 03:20:25 user nova-compute[75391]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3 (non-flash)
Nov 15 03:20:25 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c (non-flash)
Nov 15 03:20:25 user nova-compute[75391]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3 (non-flash)
Nov 15 03:20:25 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c895755-be86-4c08-9e1d-ed0d92007400]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:20:25 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: None {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 03:20:26 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 03:20:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KzxRgVrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 03:20:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:20:26 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23636343162383833', 'path': '/dev/sdc'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:20:26 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636343162383833', 'path': '/dev/sdc'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 03:20:26 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1268781356',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1268781356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1268781356',id=49,image_ref='bb0c6ed4-5cb2-4396-b90b-dcb6f6509612',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAR3RnQzVwNvKhk+DIEU/8J+PUEWAVq+tV5EamFAPjdc1BfZ6D3GNze2za+RapIJPKVveOoMeFSy+jbMNaBK8rTCDTOK4KtsLnB1441IG3FChkUOzyhmM+TXvJA3T+pzw==',key_name='tempest-keypair-1501911678',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac31667fa4804667afdb398aeb03d616',ramdisk_id='',reservation_id='r-8ywinw83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1108994886',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1108994886-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1108994886',owner_user_name='tempest-TestVolumeBootPattern-1108994886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:20:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27184608c0aa47f993c5f2020e5f7df4',uuid=a9635474-cc42-4b7b-975d-6f990fadfdee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f25b5ade-e1fd-408c-a8a2-3ccc724a64fa", "address": "fa:16:3e:d5:c7:51", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25b5ade-e1", "ovs_interfaceid": "f25b5ade-e1fd-408c-a8a2-3ccc724a64fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 03:20:26 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converting VIF {"id": "f25b5ade-e1fd-408c-a8a2-3ccc724a64fa", "address": "fa:16:3e:d5:c7:51", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25b5ade-e1", "ovs_interfaceid": "f25b5ade-e1fd-408c-a8a2-3ccc724a64fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:20:26 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:c7:51,bridge_name='br-int',has_traffic_filtering=True,id=f25b5ade-e1fd-408c-a8a2-3ccc724a64fa,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf25b5ade-e1') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:20:26 user nova-compute[75391]: DEBUG nova.objects.instance [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lazy-loading 'pci_devices' on Instance uuid a9635474-cc42-4b7b-975d-6f990fadfdee {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:20:26 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] End _get_guest_xml xml=<domain type="kvm">
Nov 15 03:20:26 user nova-compute[75391]:   <uuid>a9635474-cc42-4b7b-975d-6f990fadfdee</uuid>
Nov 15 03:20:26 user nova-compute[75391]:   <name>instance-00000031</name>
Nov 15 03:20:26 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 03:20:26 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 03:20:26 user nova-compute[75391]:   <metadata>
Nov 15 03:20:26 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 03:20:26 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 03:20:26 user nova-compute[75391]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1268781356</nova:name>
Nov 15 03:20:26 user nova-compute[75391]:       <nova:creationTime>2023-11-15 03:20:25</nova:creationTime>
Nov 15 03:20:26 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 03:20:26 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 03:20:26 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 03:20:26 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 03:20:26 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 03:20:26 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 03:20:26 user nova-compute[75391]:       </nova:flavor>
Nov 15 03:20:26 user nova-compute[75391]:       <nova:owner>
Nov 15 03:20:26 user nova-compute[75391]:         <nova:user uuid="27184608c0aa47f993c5f2020e5f7df4">tempest-TestVolumeBootPattern-1108994886-project-member</nova:user>
Nov 15 03:20:26 user nova-compute[75391]:         <nova:project uuid="ac31667fa4804667afdb398aeb03d616">tempest-TestVolumeBootPattern-1108994886</nova:project>
Nov 15 03:20:26 user nova-compute[75391]:       </nova:owner>
Nov 15 03:20:26 user nova-compute[75391]:       <nova:root type="image" uuid="bb0c6ed4-5cb2-4396-b90b-dcb6f6509612"/>
Nov 15 03:20:26 user nova-compute[75391]:       <nova:ports>
Nov 15 03:20:26 user nova-compute[75391]:         <nova:port uuid="f25b5ade-e1fd-408c-a8a2-3ccc724a64fa">
Nov 15 03:20:26 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 03:20:26 user nova-compute[75391]:         </nova:port>
Nov 15 03:20:26 user nova-compute[75391]:       </nova:ports>
Nov 15 03:20:26 user nova-compute[75391]:     </nova:instance>
Nov 15 03:20:26 user nova-compute[75391]:   </metadata>
Nov 15 03:20:26 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 03:20:26 user nova-compute[75391]:     <system>
Nov 15 03:20:26 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 03:20:26 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 03:20:26 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 03:20:26 user nova-compute[75391]:       <entry name="serial">a9635474-cc42-4b7b-975d-6f990fadfdee</entry>
Nov 15 03:20:26 user nova-compute[75391]:       <entry name="uuid">a9635474-cc42-4b7b-975d-6f990fadfdee</entry>
Nov 15 03:20:26 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 03:20:26 user nova-compute[75391]:     </system>
Nov 15 03:20:26 user nova-compute[75391]:   </sysinfo>
Nov 15 03:20:26 user nova-compute[75391]:   <os>
Nov 15 03:20:26 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 03:20:26 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 03:20:26 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 03:20:26 user nova-compute[75391]:   </os>
Nov 15 03:20:26 user nova-compute[75391]:   <features>
Nov 15 03:20:26 user nova-compute[75391]:     <acpi/>
Nov 15 03:20:26 user nova-compute[75391]:     <apic/>
Nov 15 03:20:26 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 03:20:26 user nova-compute[75391]:   </features>
Nov 15 03:20:26 user nova-compute[75391]:   <clock offset="utc">
Nov 15 03:20:26 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 03:20:26 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 03:20:26 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 03:20:26 user nova-compute[75391]:   </clock>
Nov 15 03:20:26 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 03:20:26 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 03:20:26 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 03:20:26 user nova-compute[75391]:   </cpu>
Nov 15 03:20:26 user nova-compute[75391]:   <devices>
Nov 15 03:20:26 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 03:20:26 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:20:26 user nova-compute[75391]:       <source dev="/dev/sdc"/>
Nov 15 03:20:26 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 03:20:26 user nova-compute[75391]:       <serial>09972b68-084c-4a74-bac5-bbfe40d47fd3</serial>
Nov 15 03:20:26 user nova-compute[75391]:     </disk>
Nov 15 03:20:26 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 03:20:26 user nova-compute[75391]:       <mac address="fa:16:3e:d5:c7:51"/>
Nov 15 03:20:26 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:20:26 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 03:20:26 user nova-compute[75391]:       <target dev="tapf25b5ade-e1"/>
Nov 15 03:20:26 user nova-compute[75391]:     </interface>
Nov 15 03:20:26 user nova-compute[75391]:     <serial type="pty">
Nov 15 03:20:26 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/a9635474-cc42-4b7b-975d-6f990fadfdee/console.log" append="off"/>
Nov 15 03:20:26 user nova-compute[75391]:     </serial>
Nov 15 03:20:26 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 03:20:26 user nova-compute[75391]:     <video>
Nov 15 03:20:26 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:20:26 user nova-compute[75391]:     </video>
Nov 15 03:20:26 user nova-compute[75391]:     <rng model="virtio">
Nov 15 03:20:26 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 03:20:26 user nova-compute[75391]:     </rng>
Nov 15 03:20:26 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 03:20:26 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 03:20:26 user nova-compute[75391]:       <stats period="10"/>
Nov 15 03:20:26 user nova-compute[75391]:     </memballoon>
Nov 15 03:20:26 user nova-compute[75391]:   </devices>
Nov 15 03:20:26 user nova-compute[75391]: </domain>
Nov 15 03:20:26 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 03:20:26 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1268781356',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1268781356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1268781356',id=49,image_ref='bb0c6ed4-5cb2-4396-b90b-dcb6f6509612',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAR3RnQzVwNvKhk+DIEU/8J+PUEWAVq+tV5EamFAPjdc1BfZ6D3GNze2za+RapIJPKVveOoMeFSy+jbMNaBK8rTCDTOK4KtsLnB1441IG3FChkUOzyhmM+TXvJA3T+pzw==',key_name='tempest-keypair-1501911678',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac31667fa4804667afdb398aeb03d616',ramdisk_id='',reservation_id='r-8ywinw83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1108994886',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1108994886-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1108994886',owner_user_name='tempest-TestVolumeBootPattern-1108994886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:20:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27184608c0aa47f993c5f2020e5f7df4',uuid=a9635474-cc42-4b7b-975d-6f990fadfdee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f25b5ade-e1fd-408c-a8a2-3ccc724a64fa", "address": "fa:16:3e:d5:c7:51", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25b5ade-e1", "ovs_interfaceid": "f25b5ade-e1fd-408c-a8a2-3ccc724a64fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 03:20:26 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converting VIF {"id": "f25b5ade-e1fd-408c-a8a2-3ccc724a64fa", "address": "fa:16:3e:d5:c7:51", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25b5ade-e1", "ovs_interfaceid": "f25b5ade-e1fd-408c-a8a2-3ccc724a64fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:20:26 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:c7:51,bridge_name='br-int',has_traffic_filtering=True,id=f25b5ade-e1fd-408c-a8a2-3ccc724a64fa,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf25b5ade-e1') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:20:26 user nova-compute[75391]: DEBUG os_vif [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:c7:51,bridge_name='br-int',has_traffic_filtering=True,id=f25b5ade-e1fd-408c-a8a2-3ccc724a64fa,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf25b5ade-e1') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 03:20:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:20:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 03:20:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6209d19c-bbf5-510e-9b22-559ea66b6933', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:20:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:20:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf25b5ade-e1, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:20:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf25b5ade-e1, col_values=(('qos', UUID('6bbb8d6a-334a-4a23-8f48-bef56da9c418')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:20:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf25b5ade-e1, col_values=(('external_ids', {'iface-id': 'f25b5ade-e1fd-408c-a8a2-3ccc724a64fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:c7:51', 'vm-uuid': 'a9635474-cc42-4b7b-975d-6f990fadfdee'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:20:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:20:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:26 user nova-compute[75391]: INFO os_vif [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:c7:51,bridge_name='br-int',has_traffic_filtering=True,id=f25b5ade-e1fd-408c-a8a2-3ccc724a64fa,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf25b5ade-e1')
Nov 15 03:20:26 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:20:26 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] No VIF found with MAC fa:16:3e:d5:c7:51, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 03:20:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:28 user nova-compute[75391]: DEBUG nova.compute.manager [req-0f277f86-9eb5-4f54-bf82-274bf2826b85 req-05eacdc2-b7ba-46f8-8941-bc72b40af9bd service nova] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Received event network-vif-plugged-f25b5ade-e1fd-408c-a8a2-3ccc724a64fa {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:20:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0f277f86-9eb5-4f54-bf82-274bf2826b85 req-05eacdc2-b7ba-46f8-8941-bc72b40af9bd service nova] Acquiring lock "a9635474-cc42-4b7b-975d-6f990fadfdee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:20:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0f277f86-9eb5-4f54-bf82-274bf2826b85 req-05eacdc2-b7ba-46f8-8941-bc72b40af9bd service nova] Lock "a9635474-cc42-4b7b-975d-6f990fadfdee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:20:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-0f277f86-9eb5-4f54-bf82-274bf2826b85 req-05eacdc2-b7ba-46f8-8941-bc72b40af9bd service nova] Lock "a9635474-cc42-4b7b-975d-6f990fadfdee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:20:28 user nova-compute[75391]: DEBUG nova.compute.manager [req-0f277f86-9eb5-4f54-bf82-274bf2826b85 req-05eacdc2-b7ba-46f8-8941-bc72b40af9bd service nova] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] No waiting events found dispatching network-vif-plugged-f25b5ade-e1fd-408c-a8a2-3ccc724a64fa {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:20:28 user nova-compute[75391]: WARNING nova.compute.manager [req-0f277f86-9eb5-4f54-bf82-274bf2826b85 req-05eacdc2-b7ba-46f8-8941-bc72b40af9bd service nova] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Received unexpected event network-vif-plugged-f25b5ade-e1fd-408c-a8a2-3ccc724a64fa for instance with vm_state building and task_state spawning.
Nov 15 03:20:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:30 user nova-compute[75391]: DEBUG nova.compute.manager [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 03:20:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 03:20:30 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Instance spawned successfully.
Nov 15 03:20:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 03:20:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:20:30 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:20:30 user nova-compute[75391]: INFO nova.compute.manager [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Took 4.99 seconds to spawn the instance on the hypervisor.
Nov 15 03:20:30 user nova-compute[75391]: DEBUG nova.compute.manager [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 03:20:30 user nova-compute[75391]: INFO nova.compute.manager [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Took 16.03 seconds to build instance.
Nov 15 03:20:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-eb7482b1-61f3-4c3c-af50-4eec3d72e0c4 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "a9635474-cc42-4b7b-975d-6f990fadfdee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.140s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:20:30 user nova-compute[75391]: DEBUG nova.compute.manager [req-002392a4-e3e0-466f-99bb-0b34ddde3a28 req-2dc6bf18-94df-419a-bb7b-3140fbbdd269 service nova] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Received event network-vif-plugged-f25b5ade-e1fd-408c-a8a2-3ccc724a64fa {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:20:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-002392a4-e3e0-466f-99bb-0b34ddde3a28 req-2dc6bf18-94df-419a-bb7b-3140fbbdd269 service nova] Acquiring lock "a9635474-cc42-4b7b-975d-6f990fadfdee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:20:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-002392a4-e3e0-466f-99bb-0b34ddde3a28 req-2dc6bf18-94df-419a-bb7b-3140fbbdd269 service nova] Lock "a9635474-cc42-4b7b-975d-6f990fadfdee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:20:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-002392a4-e3e0-466f-99bb-0b34ddde3a28 req-2dc6bf18-94df-419a-bb7b-3140fbbdd269 service nova] Lock "a9635474-cc42-4b7b-975d-6f990fadfdee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:20:30 user nova-compute[75391]: DEBUG nova.compute.manager [req-002392a4-e3e0-466f-99bb-0b34ddde3a28 req-2dc6bf18-94df-419a-bb7b-3140fbbdd269 service nova] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] No waiting events found dispatching network-vif-plugged-f25b5ade-e1fd-408c-a8a2-3ccc724a64fa {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:20:30 user nova-compute[75391]: WARNING nova.compute.manager [req-002392a4-e3e0-466f-99bb-0b34ddde3a28 req-2dc6bf18-94df-419a-bb7b-3140fbbdd269 service nova] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Received unexpected event network-vif-plugged-f25b5ade-e1fd-408c-a8a2-3ccc724a64fa for instance with vm_state active and task_state None.
Nov 15 03:20:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:20:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:20:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:20:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:20:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:20:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:21:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:21:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:21:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:21:08 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:21:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:21:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:21:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:21:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:21:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:21:11 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:21:12 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:21:14 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:21:14 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:21:14 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:21:14 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 03:21:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-5def6f32-4f27-4e72-8f11-35c5c64ffec5" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:21:14 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-5def6f32-4f27-4e72-8f11-35c5c64ffec5" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:21:14 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:21:14 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lazy-loading 'info_cache' on Instance uuid 5def6f32-4f27-4e72-8f11-35c5c64ffec5 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:21:15 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Updating instance_info_cache with network_info: [{"id": "926bd439-042d-45e7-b14c-c5ebd9b262b3", "address": "fa:16:3e:da:4b:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap926bd439-04", "ovs_interfaceid": "926bd439-042d-45e7-b14c-c5ebd9b262b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:21:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-5def6f32-4f27-4e72-8f11-35c5c64ffec5" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:21:15 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:21:16 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:21:17 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:21:18 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:21:20 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:21:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:21:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:21:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:21:20 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:21:20 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 03:21:20 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 03:21:21 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:21:21 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:21:21 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8931MB free_disk=25.006317138671875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:21:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:21:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:21:21 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 5def6f32-4f27-4e72-8f11-35c5c64ffec5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:21:21 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance a9635474-cc42-4b7b-975d-6f990fadfdee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:21:21 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:21:21 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:21:21 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:21:21 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:21:21 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:21:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:21:21 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:21:21 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:21:21 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:21:21 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:21:21 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:21:21 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:21:23 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:21:23 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:21:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:21:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:21:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:21:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:21:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:21:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:21:27 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:21:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:21:36 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:21:41 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:21:46 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:21:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:21:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:21:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:21:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:21:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:21:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:21:56 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:22:01 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:22:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-2205d8ce-6fcb-4d30-9e6a-746773393f7a req-c9cf4ede-174e-4a7b-a748-c728c4a280f7 service nova] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Received event network-changed-f25b5ade-e1fd-408c-a8a2-3ccc724a64fa {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:22:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-2205d8ce-6fcb-4d30-9e6a-746773393f7a req-c9cf4ede-174e-4a7b-a748-c728c4a280f7 service nova] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Refreshing instance network info cache due to event network-changed-f25b5ade-e1fd-408c-a8a2-3ccc724a64fa. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:22:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2205d8ce-6fcb-4d30-9e6a-746773393f7a req-c9cf4ede-174e-4a7b-a748-c728c4a280f7 service nova] Acquiring lock "refresh_cache-a9635474-cc42-4b7b-975d-6f990fadfdee" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:22:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2205d8ce-6fcb-4d30-9e6a-746773393f7a req-c9cf4ede-174e-4a7b-a748-c728c4a280f7 service nova] Acquired lock "refresh_cache-a9635474-cc42-4b7b-975d-6f990fadfdee" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:22:05 user nova-compute[75391]: DEBUG nova.network.neutron [req-2205d8ce-6fcb-4d30-9e6a-746773393f7a req-c9cf4ede-174e-4a7b-a748-c728c4a280f7 service nova] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Refreshing network info cache for port f25b5ade-e1fd-408c-a8a2-3ccc724a64fa {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:22:05 user nova-compute[75391]: DEBUG nova.network.neutron [req-2205d8ce-6fcb-4d30-9e6a-746773393f7a req-c9cf4ede-174e-4a7b-a748-c728c4a280f7 service nova] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Updated VIF entry in instance network info cache for port f25b5ade-e1fd-408c-a8a2-3ccc724a64fa. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:22:05 user nova-compute[75391]: DEBUG nova.network.neutron [req-2205d8ce-6fcb-4d30-9e6a-746773393f7a req-c9cf4ede-174e-4a7b-a748-c728c4a280f7 service nova] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Updating instance_info_cache with network_info: [{"id": "f25b5ade-e1fd-408c-a8a2-3ccc724a64fa", "address": "fa:16:3e:d5:c7:51", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25b5ade-e1", "ovs_interfaceid": "f25b5ade-e1fd-408c-a8a2-3ccc724a64fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:22:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-2205d8ce-6fcb-4d30-9e6a-746773393f7a req-c9cf4ede-174e-4a7b-a748-c728c4a280f7 service nova] Releasing lock "refresh_cache-a9635474-cc42-4b7b-975d-6f990fadfdee" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:22:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "a9635474-cc42-4b7b-975d-6f990fadfdee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:22:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "a9635474-cc42-4b7b-975d-6f990fadfdee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:22:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "a9635474-cc42-4b7b-975d-6f990fadfdee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:22:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "a9635474-cc42-4b7b-975d-6f990fadfdee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:22:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "a9635474-cc42-4b7b-975d-6f990fadfdee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:22:06 user nova-compute[75391]: INFO nova.compute.manager [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Terminating instance
Nov 15 03:22:06 user nova-compute[75391]: DEBUG nova.compute.manager [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 03:22:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:22:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:22:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-08556f18-d281-4734-9099-b2631faf89dd req-a0d4733f-43df-4699-9366-9aa2204fe94a service nova] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Received event network-vif-unplugged-f25b5ade-e1fd-408c-a8a2-3ccc724a64fa {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-08556f18-d281-4734-9099-b2631faf89dd req-a0d4733f-43df-4699-9366-9aa2204fe94a service nova] Acquiring lock "a9635474-cc42-4b7b-975d-6f990fadfdee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-08556f18-d281-4734-9099-b2631faf89dd req-a0d4733f-43df-4699-9366-9aa2204fe94a service nova] Lock "a9635474-cc42-4b7b-975d-6f990fadfdee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-08556f18-d281-4734-9099-b2631faf89dd req-a0d4733f-43df-4699-9366-9aa2204fe94a service nova] Lock "a9635474-cc42-4b7b-975d-6f990fadfdee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-08556f18-d281-4734-9099-b2631faf89dd req-a0d4733f-43df-4699-9366-9aa2204fe94a service nova] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] No waiting events found dispatching network-vif-unplugged-f25b5ade-e1fd-408c-a8a2-3ccc724a64fa {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-08556f18-d281-4734-9099-b2631faf89dd req-a0d4733f-43df-4699-9366-9aa2204fe94a service nova] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Received event network-vif-unplugged-f25b5ade-e1fd-408c-a8a2-3ccc724a64fa for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-08556f18-d281-4734-9099-b2631faf89dd req-a0d4733f-43df-4699-9366-9aa2204fe94a service nova] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Received event network-vif-plugged-f25b5ade-e1fd-408c-a8a2-3ccc724a64fa {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-08556f18-d281-4734-9099-b2631faf89dd req-a0d4733f-43df-4699-9366-9aa2204fe94a service nova] Acquiring lock "a9635474-cc42-4b7b-975d-6f990fadfdee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-08556f18-d281-4734-9099-b2631faf89dd req-a0d4733f-43df-4699-9366-9aa2204fe94a service nova] Lock "a9635474-cc42-4b7b-975d-6f990fadfdee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-08556f18-d281-4734-9099-b2631faf89dd req-a0d4733f-43df-4699-9366-9aa2204fe94a service nova] Lock "a9635474-cc42-4b7b-975d-6f990fadfdee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-08556f18-d281-4734-9099-b2631faf89dd req-a0d4733f-43df-4699-9366-9aa2204fe94a service nova] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] No waiting events found dispatching network-vif-plugged-f25b5ade-e1fd-408c-a8a2-3ccc724a64fa {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:22:07 user nova-compute[75391]: WARNING nova.compute.manager [req-08556f18-d281-4734-9099-b2631faf89dd req-a0d4733f-43df-4699-9366-9aa2204fe94a service nova] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Received unexpected event network-vif-plugged-f25b5ade-e1fd-408c-a8a2-3ccc724a64fa for instance with vm_state active and task_state deleting.
Nov 15 03:22:07 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Instance destroyed successfully.
Nov 15 03:22:07 user nova-compute[75391]: DEBUG nova.objects.instance [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lazy-loading 'resources' on Instance uuid a9635474-cc42-4b7b-975d-6f990fadfdee {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1268781356',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1268781356',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1268781356',id=49,image_ref='bb0c6ed4-5cb2-4396-b90b-dcb6f6509612',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAR3RnQzVwNvKhk+DIEU/8J+PUEWAVq+tV5EamFAPjdc1BfZ6D3GNze2za+RapIJPKVveOoMeFSy+jbMNaBK8rTCDTOK4KtsLnB1441IG3FChkUOzyhmM+TXvJA3T+pzw==',key_name='tempest-keypair-1501911678',keypairs=<?>,launch_index=0,launched_at=2023-11-15T03:20:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac31667fa4804667afdb398aeb03d616',ramdisk_id='',reservation_id='r-8ywinw83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1108994886',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1108994886-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1108994886',owner_user_name='tempest-TestVolumeBootPattern-1108994886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T03:20:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27184608c0aa47f993c5f2020e5f7df4',uuid=a9635474-cc42-4b7b-975d-6f990fadfdee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f25b5ade-e1fd-408c-a8a2-3ccc724a64fa", "address": "fa:16:3e:d5:c7:51", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25b5ade-e1", "ovs_interfaceid": "f25b5ade-e1fd-408c-a8a2-3ccc724a64fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converting VIF {"id": "f25b5ade-e1fd-408c-a8a2-3ccc724a64fa", "address": "fa:16:3e:d5:c7:51", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25b5ade-e1", "ovs_interfaceid": "f25b5ade-e1fd-408c-a8a2-3ccc724a64fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:c7:51,bridge_name='br-int',has_traffic_filtering=True,id=f25b5ade-e1fd-408c-a8a2-3ccc724a64fa,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf25b5ade-e1') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG os_vif [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:c7:51,bridge_name='br-int',has_traffic_filtering=True,id=f25b5ade-e1fd-408c-a8a2-3ccc724a64fa,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf25b5ade-e1') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf25b5ade-e1, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6bbb8d6a-334a-4a23-8f48-bef56da9c418) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:22:07 user nova-compute[75391]: INFO os_vif [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:c7:51,bridge_name='br-int',has_traffic_filtering=True,id=f25b5ade-e1fd-408c-a8a2-3ccc724a64fa,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf25b5ade-e1')
Nov 15 03:22:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KzxRgVrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:22:07 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:22:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebf3492-ecb8-4ca8-a22c-66511d7b0f32]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 03:22:07 user nova-compute[75391]: No targets found.
Nov 15 03:22:07 user nova-compute[75391]: iSNS:
Nov 15 03:22:07 user nova-compute[75391]: No targets found.
Nov 15 03:22:07 user nova-compute[75391]: STATIC:
Nov 15 03:22:07 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3
Nov 15 03:22:07 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 03:22:07 user nova-compute[75391]:                 Iface Name: default
Nov 15 03:22:07 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c
Nov 15 03:22:07 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 03:22:07 user nova-compute[75391]:                 Iface Name: default
Nov 15 03:22:07 user nova-compute[75391]: FIRMWARE:
Nov 15 03:22:07 user nova-compute[75391]: No targets found.
Nov 15 03:22:07 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 03:22:07 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 03:22:07 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed16265a-dec2-4876-860e-57dede2179cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[003f37b8-4960-4139-beb3-32facbc94de9]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c (non-flash)
Nov 15 03:22:07 user nova-compute[75391]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3 (non-flash)
Nov 15 03:22:07 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c (non-flash)
Nov 15 03:22:07 user nova-compute[75391]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3 (non-flash)
Nov 15 03:22:07 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f622447e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3'): ({'sdc'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Removing single pathed devices sdc {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f70315-5ef4-465b-b96f-148f184b0c59]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[69906c1b-b9bf-4579-95b3-277e6ce3c67a]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Flushing IO for device /dev/sdc {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e113de-d1d5-449d-8c7b-f0292561c3fe]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd39ab4a-c005-4813-b690-1070c4620684]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] SCSI volumes sdc have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23636343162383833', '/dev/disk/by-id/scsi-1SCST_BIO5f82d207-6641b883680dfdb0', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5f82d207') {{(pid=85237) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a46eb80-b5da-4464-a766-d142a9bcee0e]: (4, None) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[37950b6f-dae0-4ced-ad8b-6e508721c09e]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c8329e-a9ed-4102-a4a1-b3c74b751ec1]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3, portal: 172.16.0.220,3260]
Nov 15 03:22:07 user nova-compute[75391]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3, portal: 172.16.0.220,3260] successful.
Nov 15 03:22:07 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09972b68-084c-4a74-bac5-bbfe40d47fd3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26c4e1b-bef8-4c94-8dd2-34a90f0d51ef]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] <== disconnect_volume: return (296ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 03:22:07 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Deleting instance files /opt/stack/data/nova/instances/a9635474-cc42-4b7b-975d-6f990fadfdee_del
Nov 15 03:22:07 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Deletion of /opt/stack/data/nova/instances/a9635474-cc42-4b7b-975d-6f990fadfdee_del complete
Nov 15 03:22:07 user nova-compute[75391]: INFO nova.compute.manager [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 15 03:22:07 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 03:22:07 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 03:22:08 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:22:08 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Took 0.70 seconds to deallocate network for instance.
Nov 15 03:22:08 user nova-compute[75391]: DEBUG nova.compute.manager [req-147fd85f-a0fd-43d3-8c16-a9d6b8dd126b req-c67572e9-65d7-4ed8-bbf6-c3e4d246c436 service nova] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Received event network-vif-deleted-f25b5ade-e1fd-408c-a8a2-3ccc724a64fa {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:22:09 user nova-compute[75391]: INFO nova.compute.manager [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Took 0.71 seconds to detach 1 volumes for instance.
Nov 15 03:22:09 user nova-compute[75391]: DEBUG nova.compute.manager [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: a9635474-cc42-4b7b-975d-6f990fadfdee] Deleting volume: 09972b68-084c-4a74-bac5-bbfe40d47fd3 {{(pid=75391) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 03:22:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:22:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:22:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:22:09 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:22:09 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:22:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:22:09 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Deleted allocations for instance a9635474-cc42-4b7b-975d-6f990fadfdee
Nov 15 03:22:09 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:22:09 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-141b8dab-9c0e-4f37-b0b2-67eb64e96aaa tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "a9635474-cc42-4b7b-975d-6f990fadfdee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.980s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:22:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:22:12 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:22:15 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:22:15 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:22:15 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Didn't find any instances for network info cache update. {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 03:22:16 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:22:17 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:22:19 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:22:19 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:22:20 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:22:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:22:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:22:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:22:20 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:22:20 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 03:22:21 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:22:21 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:22:21 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8995MB free_disk=25.005443572998047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:22:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:22:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:22:21 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 5def6f32-4f27-4e72-8f11-35c5c64ffec5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:22:21 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:22:21 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:22:21 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:22:21 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:22:21 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:22:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:22:22 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:22:23 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:22:23 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:22:23 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:22:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:22:29 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:22:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:22:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:22:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:22:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:22:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:22:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:22:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:22:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:22:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:22:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:22:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:22:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "5def6f32-4f27-4e72-8f11-35c5c64ffec5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:22:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "5def6f32-4f27-4e72-8f11-35c5c64ffec5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:22:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "5def6f32-4f27-4e72-8f11-35c5c64ffec5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:22:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "5def6f32-4f27-4e72-8f11-35c5c64ffec5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:22:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "5def6f32-4f27-4e72-8f11-35c5c64ffec5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:22:59 user nova-compute[75391]: INFO nova.compute.manager [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Terminating instance
Nov 15 03:22:59 user nova-compute[75391]: DEBUG nova.compute.manager [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 03:22:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:22:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:22:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:22:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:22:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:22:59 user nova-compute[75391]: DEBUG nova.compute.manager [req-3fe2f4d7-a7e0-4732-bf85-2cbf27d8d180 req-34ffffa4-2d51-43b4-a28c-eecc88012d05 service nova] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Received event network-vif-unplugged-926bd439-042d-45e7-b14c-c5ebd9b262b3 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:22:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3fe2f4d7-a7e0-4732-bf85-2cbf27d8d180 req-34ffffa4-2d51-43b4-a28c-eecc88012d05 service nova] Acquiring lock "5def6f32-4f27-4e72-8f11-35c5c64ffec5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:22:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3fe2f4d7-a7e0-4732-bf85-2cbf27d8d180 req-34ffffa4-2d51-43b4-a28c-eecc88012d05 service nova] Lock "5def6f32-4f27-4e72-8f11-35c5c64ffec5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:22:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-3fe2f4d7-a7e0-4732-bf85-2cbf27d8d180 req-34ffffa4-2d51-43b4-a28c-eecc88012d05 service nova] Lock "5def6f32-4f27-4e72-8f11-35c5c64ffec5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:22:59 user nova-compute[75391]: DEBUG nova.compute.manager [req-3fe2f4d7-a7e0-4732-bf85-2cbf27d8d180 req-34ffffa4-2d51-43b4-a28c-eecc88012d05 service nova] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] No waiting events found dispatching network-vif-unplugged-926bd439-042d-45e7-b14c-c5ebd9b262b3 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:22:59 user nova-compute[75391]: DEBUG nova.compute.manager [req-3fe2f4d7-a7e0-4732-bf85-2cbf27d8d180 req-34ffffa4-2d51-43b4-a28c-eecc88012d05 service nova] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Received event network-vif-unplugged-926bd439-042d-45e7-b14c-c5ebd9b262b3 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 03:23:00 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Instance destroyed successfully.
Nov 15 03:23:00 user nova-compute[75391]: DEBUG nova.objects.instance [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lazy-loading 'resources' on Instance uuid 5def6f32-4f27-4e72-8f11-35c5c64ffec5 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:18:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-820114808',display_name='tempest-TestVolumeBootPattern-volume-backed-server-820114808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-820114808',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuA6dE9/9yCg8iAw1JxYiTg/Db8I5h1dUjAC32JEUYERV5ldGGuvxrFvb2YZtVkBVjTN3XTUiim8e0XEyqsp9f/lygcOv9+IdIM18fD8UOY4q4jWW0fW4lq17skltC7dQ==',key_name='tempest-keypair-89441821',keypairs=<?>,launch_index=0,launched_at=2023-11-15T03:18:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac31667fa4804667afdb398aeb03d616',ramdisk_id='',reservation_id='r-bjq09z9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1108994886',owner_user_name='tempest-TestVolumeBootPattern-1108994886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T03:18:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27184608c0aa47f993c5f2020e5f7df4',uuid=5def6f32-4f27-4e72-8f11-35c5c64ffec5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "926bd439-042d-45e7-b14c-c5ebd9b262b3", "address": "fa:16:3e:da:4b:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap926bd439-04", "ovs_interfaceid": "926bd439-042d-45e7-b14c-c5ebd9b262b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converting VIF {"id": "926bd439-042d-45e7-b14c-c5ebd9b262b3", "address": "fa:16:3e:da:4b:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap926bd439-04", "ovs_interfaceid": "926bd439-042d-45e7-b14c-c5ebd9b262b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:4b:66,bridge_name='br-int',has_traffic_filtering=True,id=926bd439-042d-45e7-b14c-c5ebd9b262b3,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap926bd439-04') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG os_vif [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:4b:66,bridge_name='br-int',has_traffic_filtering=True,id=926bd439-042d-45e7-b14c-c5ebd9b262b3,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap926bd439-04') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap926bd439-04, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=52a38c85-ee53-4d6e-8c6b-7ad1a1bb1bad) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:23:00 user nova-compute[75391]: INFO os_vif [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:4b:66,bridge_name='br-int',has_traffic_filtering=True,id=926bd439-042d-45e7-b14c-c5ebd9b262b3,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap926bd439-04')
Nov 15 03:23:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PAUxtjJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:23:00 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:23:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24d4380-7276-4a8a-9304-3e14f28d6a27]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 03:23:00 user nova-compute[75391]: No targets found.
Nov 15 03:23:00 user nova-compute[75391]: iSNS:
Nov 15 03:23:00 user nova-compute[75391]: No targets found.
Nov 15 03:23:00 user nova-compute[75391]: STATIC:
Nov 15 03:23:00 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c
Nov 15 03:23:00 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 03:23:00 user nova-compute[75391]:                 Iface Name: default
Nov 15 03:23:00 user nova-compute[75391]: FIRMWARE:
Nov 15 03:23:00 user nova-compute[75391]: No targets found.
Nov 15 03:23:00 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 03:23:00 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 03:23:00 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d65265-d313-47f1-ab3b-78c73dc24825]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafb5083-ff3a-47d4-9c66-1d5d05aa5260]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c (non-flash)
Nov 15 03:23:00 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c (non-flash)
Nov 15 03:23:00 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62245d1480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c'): ({'sdb'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Removing single pathed devices sdb {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[46226e65-b08d-405b-a93b-010104446e10]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9ba046-8ab0-4728-8a43-431974a4b883]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Flushing IO for device /dev/sdb {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfbfbb9-84bc-4bdf-bae6-1b16103b353d]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12e89b5-dc36-488b-8bfd-591576bc4a90]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23062633639383835', '/dev/disk/by-id/scsi-1SCST_BIOa525eb6e-0bc698858df08339', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a525eb6e') {{(pid=85237) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3f7ad6-f4ed-44d9-9059-9e04b8ce3e3c]: (4, None) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[14db5f13-5e63-43fc-9ddb-65a05f892050]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5b962b-507a-4941-93e4-ab85d541ac5e]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c, portal: 172.16.0.220,3260]
Nov 15 03:23:00 user nova-compute[75391]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c, portal: 172.16.0.220,3260] successful.
Nov 15 03:23:00 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd0061d9-e81f-4a36-aa5f-9057f965025c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caa43a6-4c8c-4669-94ad-c8406d5d3413]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] <== disconnect_volume: return (315ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 03:23:00 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Deleting instance files /opt/stack/data/nova/instances/5def6f32-4f27-4e72-8f11-35c5c64ffec5_del
Nov 15 03:23:00 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Deletion of /opt/stack/data/nova/instances/5def6f32-4f27-4e72-8f11-35c5c64ffec5_del complete
Nov 15 03:23:00 user nova-compute[75391]: INFO nova.compute.manager [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 15 03:23:00 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 03:23:00 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 03:23:01 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:23:01 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Took 0.83 seconds to deallocate network for instance.
Nov 15 03:23:01 user nova-compute[75391]: DEBUG nova.compute.manager [req-f00b52fc-e748-48ad-9eaf-b00f98fd4cf1 req-f59ba394-30bf-4ecc-9d61-61138ad24db0 service nova] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Received event network-vif-plugged-926bd439-042d-45e7-b14c-c5ebd9b262b3 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:23:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f00b52fc-e748-48ad-9eaf-b00f98fd4cf1 req-f59ba394-30bf-4ecc-9d61-61138ad24db0 service nova] Acquiring lock "5def6f32-4f27-4e72-8f11-35c5c64ffec5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:23:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f00b52fc-e748-48ad-9eaf-b00f98fd4cf1 req-f59ba394-30bf-4ecc-9d61-61138ad24db0 service nova] Lock "5def6f32-4f27-4e72-8f11-35c5c64ffec5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:23:01 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f00b52fc-e748-48ad-9eaf-b00f98fd4cf1 req-f59ba394-30bf-4ecc-9d61-61138ad24db0 service nova] Lock "5def6f32-4f27-4e72-8f11-35c5c64ffec5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:23:01 user nova-compute[75391]: DEBUG nova.compute.manager [req-f00b52fc-e748-48ad-9eaf-b00f98fd4cf1 req-f59ba394-30bf-4ecc-9d61-61138ad24db0 service nova] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] No waiting events found dispatching network-vif-plugged-926bd439-042d-45e7-b14c-c5ebd9b262b3 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:23:01 user nova-compute[75391]: WARNING nova.compute.manager [req-f00b52fc-e748-48ad-9eaf-b00f98fd4cf1 req-f59ba394-30bf-4ecc-9d61-61138ad24db0 service nova] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Received unexpected event network-vif-plugged-926bd439-042d-45e7-b14c-c5ebd9b262b3 for instance with vm_state active and task_state deleting.
Nov 15 03:23:01 user nova-compute[75391]: DEBUG nova.compute.manager [req-f00b52fc-e748-48ad-9eaf-b00f98fd4cf1 req-f59ba394-30bf-4ecc-9d61-61138ad24db0 service nova] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Received event network-vif-deleted-926bd439-042d-45e7-b14c-c5ebd9b262b3 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:23:02 user nova-compute[75391]: INFO nova.compute.manager [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Took 0.69 seconds to detach 1 volumes for instance.
Nov 15 03:23:02 user nova-compute[75391]: DEBUG nova.compute.manager [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 5def6f32-4f27-4e72-8f11-35c5c64ffec5] Deleting volume: fd0061d9-e81f-4a36-aa5f-9057f965025c {{(pid=75391) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 03:23:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:23:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:23:02 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:23:02 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:23:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:23:02 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Deleted allocations for instance 5def6f32-4f27-4e72-8f11-35c5c64ffec5
Nov 15 03:23:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7854de60-cc8f-4b7c-a35d-6097a1e811ea tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "5def6f32-4f27-4e72-8f11-35c5c64ffec5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.100s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:23:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:23:10 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:23:10 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:23:11 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:23:11 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 03:23:14 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:23:15 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:23:15 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:23:15 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:23:15 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 03:23:15 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Didn't find any instances for network info cache update. {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 03:23:16 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:23:20 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:23:20 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:23:20 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:23:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:23:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:23:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:23:20 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:23:21 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:23:21 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:23:21 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=9142MB free_disk=25.00467300415039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:23:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:23:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:23:21 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:23:21 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:23:21 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Refreshing inventories for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 03:23:21 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Updating ProviderTree inventory for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 03:23:21 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Updating inventory in ProviderTree for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 03:23:21 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Refreshing aggregate associations for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e, aggregates: None {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 03:23:21 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Refreshing trait associations for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 03:23:21 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:23:21 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:23:21 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:23:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.526s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:23:22 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:23:25 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:23:25 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:23:25 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:23:30 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:23:31 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:23:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:23:37 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:23:37 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Cleaning up deleted instances {{(pid=75391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 03:23:37 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] There are 0 instances to clean {{(pid=75391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 03:23:40 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:23:42 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:23:45 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:23:50 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:23:50 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:23:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:23:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "50faba39-14b3-4616-bae7-522df8a0dda6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:23:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "50faba39-14b3-4616-bae7-522df8a0dda6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:23:57 user nova-compute[75391]: DEBUG nova.compute.manager [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 03:23:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:23:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:23:57 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 03:23:57 user nova-compute[75391]: INFO nova.compute.claims [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Claim successful on node user
Nov 15 03:23:57 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:23:57 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:23:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.199s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:23:57 user nova-compute[75391]: DEBUG nova.compute.manager [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 03:23:57 user nova-compute[75391]: DEBUG nova.compute.manager [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 03:23:57 user nova-compute[75391]: DEBUG nova.network.neutron [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 03:23:57 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 03:23:57 user nova-compute[75391]: DEBUG nova.compute.manager [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 03:23:58 user nova-compute[75391]: DEBUG nova.policy [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27184608c0aa47f993c5f2020e5f7df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac31667fa4804667afdb398aeb03d616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 03:23:58 user nova-compute[75391]: INFO nova.virt.block_device [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Booting with volume c3b6085f-c818-41c3-bd6e-6cbf5f1da535 at /dev/vda
Nov 15 03:23:58 user nova-compute[75391]: DEBUG os_brick.utils [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:23:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:23:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:23:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[76373e9f-56e2-4ce1-aa35-8e36993749c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:23:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:23:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:23:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c5d54c-fc59-4047-a6f8-480a61157ac1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:23:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:23:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:23:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f1cb08-840f-4cff-9d70-981c3c0ad9d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:23:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7e3bd6-7959-4453-a7bd-f15a68cc63ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:23:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:23:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:23:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 03:23:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:23:58 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:23:58 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 03:23:58 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5772ec8-c519-4609-98a2-ac1536432f4f]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:23:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 03:23:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 03:23:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 03:23:58 user nova-compute[75391]: DEBUG os_brick.utils [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:23:58 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Updating existing volume attachment record: 803b5bf8-18fe-4e05-bdae-656a6d293763 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 03:23:58 user nova-compute[75391]: DEBUG nova.network.neutron [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Successfully created port: 4a7ee725-bab0-420b-ad41-de2362b61b6c {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 03:23:59 user nova-compute[75391]: DEBUG nova.network.neutron [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Successfully updated port: 4a7ee725-bab0-420b-ad41-de2362b61b6c {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 03:23:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "refresh_cache-50faba39-14b3-4616-bae7-522df8a0dda6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:23:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquired lock "refresh_cache-50faba39-14b3-4616-bae7-522df8a0dda6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:23:59 user nova-compute[75391]: DEBUG nova.network.neutron [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 03:23:59 user nova-compute[75391]: DEBUG nova.compute.manager [req-caf2d73e-269e-4808-b066-2e48065f0c9e req-a771c06a-6c59-4630-91df-8af9a0e5aa4d service nova] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Received event network-changed-4a7ee725-bab0-420b-ad41-de2362b61b6c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:23:59 user nova-compute[75391]: DEBUG nova.compute.manager [req-caf2d73e-269e-4808-b066-2e48065f0c9e req-a771c06a-6c59-4630-91df-8af9a0e5aa4d service nova] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Refreshing instance network info cache due to event network-changed-4a7ee725-bab0-420b-ad41-de2362b61b6c. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:23:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-caf2d73e-269e-4808-b066-2e48065f0c9e req-a771c06a-6c59-4630-91df-8af9a0e5aa4d service nova] Acquiring lock "refresh_cache-50faba39-14b3-4616-bae7-522df8a0dda6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:23:59 user nova-compute[75391]: DEBUG nova.network.neutron [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 03:23:59 user nova-compute[75391]: DEBUG nova.network.neutron [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Updating instance_info_cache with network_info: [{"id": "4a7ee725-bab0-420b-ad41-de2362b61b6c", "address": "fa:16:3e:3d:8b:55", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7ee725-ba", "ovs_interfaceid": "4a7ee725-bab0-420b-ad41-de2362b61b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:23:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Releasing lock "refresh_cache-50faba39-14b3-4616-bae7-522df8a0dda6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:23:59 user nova-compute[75391]: DEBUG nova.compute.manager [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Instance network_info: |[{"id": "4a7ee725-bab0-420b-ad41-de2362b61b6c", "address": "fa:16:3e:3d:8b:55", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7ee725-ba", "ovs_interfaceid": "4a7ee725-bab0-420b-ad41-de2362b61b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 03:23:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-caf2d73e-269e-4808-b066-2e48065f0c9e req-a771c06a-6c59-4630-91df-8af9a0e5aa4d service nova] Acquired lock "refresh_cache-50faba39-14b3-4616-bae7-522df8a0dda6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:23:59 user nova-compute[75391]: DEBUG nova.network.neutron [req-caf2d73e-269e-4808-b066-2e48065f0c9e req-a771c06a-6c59-4630-91df-8af9a0e5aa4d service nova] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Refreshing network info cache for port 4a7ee725-bab0-420b-ad41-de2362b61b6c {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:24:00 user nova-compute[75391]: DEBUG nova.network.neutron [req-caf2d73e-269e-4808-b066-2e48065f0c9e req-a771c06a-6c59-4630-91df-8af9a0e5aa4d service nova] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Updated VIF entry in instance network info cache for port 4a7ee725-bab0-420b-ad41-de2362b61b6c. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:24:00 user nova-compute[75391]: DEBUG nova.network.neutron [req-caf2d73e-269e-4808-b066-2e48065f0c9e req-a771c06a-6c59-4630-91df-8af9a0e5aa4d service nova] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Updating instance_info_cache with network_info: [{"id": "4a7ee725-bab0-420b-ad41-de2362b61b6c", "address": "fa:16:3e:3d:8b:55", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7ee725-ba", "ovs_interfaceid": "4a7ee725-bab0-420b-ad41-de2362b61b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:24:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-caf2d73e-269e-4808-b066-2e48065f0c9e req-a771c06a-6c59-4630-91df-8af9a0e5aa4d service nova] Releasing lock "refresh_cache-50faba39-14b3-4616-bae7-522df8a0dda6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:24:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG nova.compute.manager [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 03:24:02 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Creating image(s)
Nov 15 03:24:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Did not create local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Ensure instance console log exists: /opt/stack/data/nova/instances/50faba39-14b3-4616-bae7-522df8a0dda6/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Start _get_guest_xml network_info=[{"id": "4a7ee725-bab0-420b-ad41-de2362b61b6c", "address": "fa:16:3e:3d:8b:55", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7ee725-ba", "ovs_interfaceid": "4a7ee725-bab0-420b-ad41-de2362b61b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '803b5bf8-18fe-4e05-bdae-656a6d293763', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuIDbqmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '50faba39-14b3-4616-bae7-522df8a0dda6', 'attached_at': '', 'detached_at': '', 'volume_id': 'c3b6085f-c818-41c3-bd6e-6cbf5f1da535', 'serial': 'c3b6085f-c818-41c3-bd6e-6cbf5f1da535'}, 'volume_type': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 03:24:02 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:24:02 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:24:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuIDbqmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:24:02 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:24:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:24:02 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:24:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:24:02 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 03:24:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bf49a2-ab0e-498c-946f-b7fd0434e2e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 03:24:02 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38b4ab0-bbec-431e-9160-e90d206ad688]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535] added
Nov 15 03:24:02 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0069fdb0-faae-4d77-81ea-2472f115f138]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb5a061-24b5-424f-92b9-fd7389a6750b]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QuIDbqmg {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QuIDbqmg" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8baa24a3-6eb9-4d4c-bba3-c4543ed8554a]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QuIDbqmg'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f9ec85-9f42-4214-88b8-5952d14450ca]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf5c205-c5a6-44fa-818c-ba9accfd93ff]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 03:24:02 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 03:24:02 user nova-compute[75391]:  {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:24:02 user nova-compute[75391]: WARNING os_brick.initiator.connectors.iscsi [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 03:24:02 user nova-compute[75391]: 
Nov 15 03:24:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b537ac-0258-44e1-a867-47933701ff3e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535, portal: 172.16.0.220,3260]
Nov 15 03:24:02 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535, portal: 172.16.0.220,3260] successful.
Nov 15 03:24:02 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:24:02 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:24:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:24:03 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35dd6ba-819f-4953-b163-1c95b5ee76e8]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:24:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:24:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:24:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:24:03 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9154e6-1abf-4d02-bc5d-e7e8b7585ec7]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:24:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 (non-flash)
Nov 15 03:24:03 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:24:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 (non-flash)
Nov 15 03:24:03 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:24:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:24:03 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 03:24:03 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 03:24:03 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 03:24:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:24:03 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:24:03 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e740fed1-1063-432c-99b9-dd38a3ad3348]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:24:03 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuIDbqmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26465366365393266', 'path': '/dev/sdb'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465366365393266', 'path': '/dev/sdb'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:23:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1225036149',display_name='tempest-TestVolumeBootPattern-server-1225036149',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1225036149',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJg/JMB6KZiOy3xqiKvUw4wmEoOOkjbbjUUw5YRCNp/4pUbJaMdGH1zK4epAbor0NINaArdvF0eDWEbgAh2qoUGQM0E2tP7PAZxp/Oap0zLOvPJXfcDjuQtWLjTKABzzsg==',key_name='tempest-TestVolumeBootPattern-1562130956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac31667fa4804667afdb398aeb03d616',ramdisk_id='',reservation_id='r-v0vqslrw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1108994886',owner_user_name='tempest-TestVolumeBootPattern-1108994886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:23:58Z,user_data=None,user_id='27184608c0aa47f993c5f2020e5f7df4',uuid=50faba39-14b3-4616-bae7-522df8a0dda6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a7ee725-bab0-420b-ad41-de2362b61b6c", "address": "fa:16:3e:3d:8b:55", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7ee725-ba", "ovs_interfaceid": "4a7ee725-bab0-420b-ad41-de2362b61b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converting VIF {"id": "4a7ee725-bab0-420b-ad41-de2362b61b6c", "address": "fa:16:3e:3d:8b:55", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7ee725-ba", "ovs_interfaceid": "4a7ee725-bab0-420b-ad41-de2362b61b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:8b:55,bridge_name='br-int',has_traffic_filtering=True,id=4a7ee725-bab0-420b-ad41-de2362b61b6c,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a7ee725-ba') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG nova.objects.instance [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lazy-loading 'pci_devices' on Instance uuid 50faba39-14b3-4616-bae7-522df8a0dda6 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 03:24:04 user nova-compute[75391]:   <uuid>50faba39-14b3-4616-bae7-522df8a0dda6</uuid>
Nov 15 03:24:04 user nova-compute[75391]:   <name>instance-00000032</name>
Nov 15 03:24:04 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 03:24:04 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 03:24:04 user nova-compute[75391]:   <metadata>
Nov 15 03:24:04 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 03:24:04 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 03:24:04 user nova-compute[75391]:       <nova:name>tempest-TestVolumeBootPattern-server-1225036149</nova:name>
Nov 15 03:24:04 user nova-compute[75391]:       <nova:creationTime>2023-11-15 03:24:02</nova:creationTime>
Nov 15 03:24:04 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 03:24:04 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 03:24:04 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 03:24:04 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 03:24:04 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 03:24:04 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 03:24:04 user nova-compute[75391]:       </nova:flavor>
Nov 15 03:24:04 user nova-compute[75391]:       <nova:owner>
Nov 15 03:24:04 user nova-compute[75391]:         <nova:user uuid="27184608c0aa47f993c5f2020e5f7df4">tempest-TestVolumeBootPattern-1108994886-project-member</nova:user>
Nov 15 03:24:04 user nova-compute[75391]:         <nova:project uuid="ac31667fa4804667afdb398aeb03d616">tempest-TestVolumeBootPattern-1108994886</nova:project>
Nov 15 03:24:04 user nova-compute[75391]:       </nova:owner>
Nov 15 03:24:04 user nova-compute[75391]:       <nova:ports>
Nov 15 03:24:04 user nova-compute[75391]:         <nova:port uuid="4a7ee725-bab0-420b-ad41-de2362b61b6c">
Nov 15 03:24:04 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 03:24:04 user nova-compute[75391]:         </nova:port>
Nov 15 03:24:04 user nova-compute[75391]:       </nova:ports>
Nov 15 03:24:04 user nova-compute[75391]:     </nova:instance>
Nov 15 03:24:04 user nova-compute[75391]:   </metadata>
Nov 15 03:24:04 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 03:24:04 user nova-compute[75391]:     <system>
Nov 15 03:24:04 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 03:24:04 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 03:24:04 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 03:24:04 user nova-compute[75391]:       <entry name="serial">50faba39-14b3-4616-bae7-522df8a0dda6</entry>
Nov 15 03:24:04 user nova-compute[75391]:       <entry name="uuid">50faba39-14b3-4616-bae7-522df8a0dda6</entry>
Nov 15 03:24:04 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 03:24:04 user nova-compute[75391]:     </system>
Nov 15 03:24:04 user nova-compute[75391]:   </sysinfo>
Nov 15 03:24:04 user nova-compute[75391]:   <os>
Nov 15 03:24:04 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 03:24:04 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 03:24:04 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 03:24:04 user nova-compute[75391]:   </os>
Nov 15 03:24:04 user nova-compute[75391]:   <features>
Nov 15 03:24:04 user nova-compute[75391]:     <acpi/>
Nov 15 03:24:04 user nova-compute[75391]:     <apic/>
Nov 15 03:24:04 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 03:24:04 user nova-compute[75391]:   </features>
Nov 15 03:24:04 user nova-compute[75391]:   <clock offset="utc">
Nov 15 03:24:04 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 03:24:04 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 03:24:04 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 03:24:04 user nova-compute[75391]:   </clock>
Nov 15 03:24:04 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 03:24:04 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 03:24:04 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 03:24:04 user nova-compute[75391]:   </cpu>
Nov 15 03:24:04 user nova-compute[75391]:   <devices>
Nov 15 03:24:04 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 03:24:04 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:24:04 user nova-compute[75391]:       <source dev="/dev/sdb"/>
Nov 15 03:24:04 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 03:24:04 user nova-compute[75391]:       <serial>c3b6085f-c818-41c3-bd6e-6cbf5f1da535</serial>
Nov 15 03:24:04 user nova-compute[75391]:     </disk>
Nov 15 03:24:04 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 03:24:04 user nova-compute[75391]:       <mac address="fa:16:3e:3d:8b:55"/>
Nov 15 03:24:04 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:24:04 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 03:24:04 user nova-compute[75391]:       <target dev="tap4a7ee725-ba"/>
Nov 15 03:24:04 user nova-compute[75391]:     </interface>
Nov 15 03:24:04 user nova-compute[75391]:     <serial type="pty">
Nov 15 03:24:04 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/50faba39-14b3-4616-bae7-522df8a0dda6/console.log" append="off"/>
Nov 15 03:24:04 user nova-compute[75391]:     </serial>
Nov 15 03:24:04 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 03:24:04 user nova-compute[75391]:     <video>
Nov 15 03:24:04 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:24:04 user nova-compute[75391]:     </video>
Nov 15 03:24:04 user nova-compute[75391]:     <rng model="virtio">
Nov 15 03:24:04 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 03:24:04 user nova-compute[75391]:     </rng>
Nov 15 03:24:04 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 03:24:04 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 03:24:04 user nova-compute[75391]:       <stats period="10"/>
Nov 15 03:24:04 user nova-compute[75391]:     </memballoon>
Nov 15 03:24:04 user nova-compute[75391]:   </devices>
Nov 15 03:24:04 user nova-compute[75391]: </domain>
Nov 15 03:24:04 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:23:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1225036149',display_name='tempest-TestVolumeBootPattern-server-1225036149',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1225036149',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJg/JMB6KZiOy3xqiKvUw4wmEoOOkjbbjUUw5YRCNp/4pUbJaMdGH1zK4epAbor0NINaArdvF0eDWEbgAh2qoUGQM0E2tP7PAZxp/Oap0zLOvPJXfcDjuQtWLjTKABzzsg==',key_name='tempest-TestVolumeBootPattern-1562130956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac31667fa4804667afdb398aeb03d616',ramdisk_id='',reservation_id='r-v0vqslrw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1108994886',owner_user_name='tempest-TestVolumeBootPattern-1108994886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:23:58Z,user_data=None,user_id='27184608c0aa47f993c5f2020e5f7df4',uuid=50faba39-14b3-4616-bae7-522df8a0dda6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a7ee725-bab0-420b-ad41-de2362b61b6c", "address": "fa:16:3e:3d:8b:55", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7ee725-ba", "ovs_interfaceid": "4a7ee725-bab0-420b-ad41-de2362b61b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converting VIF {"id": "4a7ee725-bab0-420b-ad41-de2362b61b6c", "address": "fa:16:3e:3d:8b:55", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7ee725-ba", "ovs_interfaceid": "4a7ee725-bab0-420b-ad41-de2362b61b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:8b:55,bridge_name='br-int',has_traffic_filtering=True,id=4a7ee725-bab0-420b-ad41-de2362b61b6c,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a7ee725-ba') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG os_vif [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:8b:55,bridge_name='br-int',has_traffic_filtering=True,id=4a7ee725-bab0-420b-ad41-de2362b61b6c,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a7ee725-ba') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f0edfcf-00aa-577d-af2d-a2eb824069ab', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a7ee725-ba, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a7ee725-ba, col_values=(('qos', UUID('397cfccc-ad5e-44ab-b28f-d35224d0517e')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a7ee725-ba, col_values=(('external_ids', {'iface-id': '4a7ee725-bab0-420b-ad41-de2362b61b6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:8b:55', 'vm-uuid': '50faba39-14b3-4616-bae7-522df8a0dda6'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:24:04 user nova-compute[75391]: INFO os_vif [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:8b:55,bridge_name='br-int',has_traffic_filtering=True,id=4a7ee725-bab0-420b-ad41-de2362b61b6c,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a7ee725-ba')
Nov 15 03:24:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:24:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] No VIF found with MAC fa:16:3e:3d:8b:55, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 03:24:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:24:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:24:05 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:24:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-09fc8e80-8588-4f10-9a1e-b7c7cd01c4ed req-81f53ab6-ae0a-43d0-9462-88ea2861c6d6 service nova] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Received event network-vif-plugged-4a7ee725-bab0-420b-ad41-de2362b61b6c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:24:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-09fc8e80-8588-4f10-9a1e-b7c7cd01c4ed req-81f53ab6-ae0a-43d0-9462-88ea2861c6d6 service nova] Acquiring lock "50faba39-14b3-4616-bae7-522df8a0dda6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:24:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-09fc8e80-8588-4f10-9a1e-b7c7cd01c4ed req-81f53ab6-ae0a-43d0-9462-88ea2861c6d6 service nova] Lock "50faba39-14b3-4616-bae7-522df8a0dda6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:24:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-09fc8e80-8588-4f10-9a1e-b7c7cd01c4ed req-81f53ab6-ae0a-43d0-9462-88ea2861c6d6 service nova] Lock "50faba39-14b3-4616-bae7-522df8a0dda6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:24:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-09fc8e80-8588-4f10-9a1e-b7c7cd01c4ed req-81f53ab6-ae0a-43d0-9462-88ea2861c6d6 service nova] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] No waiting events found dispatching network-vif-plugged-4a7ee725-bab0-420b-ad41-de2362b61b6c {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:24:05 user nova-compute[75391]: WARNING nova.compute.manager [req-09fc8e80-8588-4f10-9a1e-b7c7cd01c4ed req-81f53ab6-ae0a-43d0-9462-88ea2861c6d6 service nova] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Received unexpected event network-vif-plugged-4a7ee725-bab0-420b-ad41-de2362b61b6c for instance with vm_state building and task_state spawning.
Nov 15 03:24:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:24:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:24:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:24:06 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:24:07 user nova-compute[75391]: DEBUG nova.compute.manager [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 03:24:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 03:24:07 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Instance spawned successfully.
Nov 15 03:24:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 03:24:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:24:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:24:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:24:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:24:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:24:07 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:24:07 user nova-compute[75391]: INFO nova.compute.manager [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Took 4.95 seconds to spawn the instance on the hypervisor.
Nov 15 03:24:07 user nova-compute[75391]: DEBUG nova.compute.manager [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 03:24:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-d6f40a9e-293a-4877-af4b-3bed444687d7 req-4107d65e-8e76-4a7a-b8c5-74982d5c06dd service nova] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Received event network-vif-plugged-4a7ee725-bab0-420b-ad41-de2362b61b6c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:24:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d6f40a9e-293a-4877-af4b-3bed444687d7 req-4107d65e-8e76-4a7a-b8c5-74982d5c06dd service nova] Acquiring lock "50faba39-14b3-4616-bae7-522df8a0dda6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:24:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d6f40a9e-293a-4877-af4b-3bed444687d7 req-4107d65e-8e76-4a7a-b8c5-74982d5c06dd service nova] Lock "50faba39-14b3-4616-bae7-522df8a0dda6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:24:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d6f40a9e-293a-4877-af4b-3bed444687d7 req-4107d65e-8e76-4a7a-b8c5-74982d5c06dd service nova] Lock "50faba39-14b3-4616-bae7-522df8a0dda6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:24:07 user nova-compute[75391]: DEBUG nova.compute.manager [req-d6f40a9e-293a-4877-af4b-3bed444687d7 req-4107d65e-8e76-4a7a-b8c5-74982d5c06dd service nova] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] No waiting events found dispatching network-vif-plugged-4a7ee725-bab0-420b-ad41-de2362b61b6c {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:24:07 user nova-compute[75391]: WARNING nova.compute.manager [req-d6f40a9e-293a-4877-af4b-3bed444687d7 req-4107d65e-8e76-4a7a-b8c5-74982d5c06dd service nova] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Received unexpected event network-vif-plugged-4a7ee725-bab0-420b-ad41-de2362b61b6c for instance with vm_state building and task_state spawning.
Nov 15 03:24:07 user nova-compute[75391]: INFO nova.compute.manager [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Took 10.09 seconds to build instance.
Nov 15 03:24:07 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-8f379f1d-6c74-4d30-88e3-2eb75459210c tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "50faba39-14b3-4616-bae7-522df8a0dda6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.204s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:24:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:24:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:24:11 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:24:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:24:14 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:24:15 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:24:15 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:24:15 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 03:24:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-50faba39-14b3-4616-bae7-522df8a0dda6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:24:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-50faba39-14b3-4616-bae7-522df8a0dda6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:24:15 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:24:15 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lazy-loading 'info_cache' on Instance uuid 50faba39-14b3-4616-bae7-522df8a0dda6 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:24:16 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Updating instance_info_cache with network_info: [{"id": "4a7ee725-bab0-420b-ad41-de2362b61b6c", "address": "fa:16:3e:3d:8b:55", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7ee725-ba", "ovs_interfaceid": "4a7ee725-bab0-420b-ad41-de2362b61b6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:24:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-50faba39-14b3-4616-bae7-522df8a0dda6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:24:16 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:24:18 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:24:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:24:20 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:24:21 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:24:22 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:24:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:24:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:24:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:24:22 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:24:22 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 03:24:23 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:24:23 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:24:23 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8949MB free_disk=25.00259017944336GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:24:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:24:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:24:23 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 50faba39-14b3-4616-bae7-522df8a0dda6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:24:23 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:24:23 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:24:23 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:24:23 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:24:23 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:24:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:24:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:24:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:24:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:24:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:24:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:24:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:24:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:24:26 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:24:27 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:24:27 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:24:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:24:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:24:33 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:24:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:24:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:24:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:24:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:24:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:24:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:24:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:24:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:25:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:25:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:25:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:25:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:25:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:25:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:25:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:25:12 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:25:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:25:15 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:25:15 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:25:15 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 03:25:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-50faba39-14b3-4616-bae7-522df8a0dda6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:25:15 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-50faba39-14b3-4616-bae7-522df8a0dda6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:25:15 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:25:15 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lazy-loading 'info_cache' on Instance uuid 50faba39-14b3-4616-bae7-522df8a0dda6 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:25:16 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Updating instance_info_cache with network_info: [{"id": "4a7ee725-bab0-420b-ad41-de2362b61b6c", "address": "fa:16:3e:3d:8b:55", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7ee725-ba", "ovs_interfaceid": "4a7ee725-bab0-420b-ad41-de2362b61b6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:25:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-50faba39-14b3-4616-bae7-522df8a0dda6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:25:16 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:25:16 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:25:18 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:25:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:25:21 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:25:23 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:25:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:25:24 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:25:24 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:25:24 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:25:24 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:25:24 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:25:24 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 03:25:25 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:25:25 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:25:25 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=9006MB free_disk=25.001983642578125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:25:25 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:25:25 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:25:25 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 50faba39-14b3-4616-bae7-522df8a0dda6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:25:25 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:25:25 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:25:25 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:25:25 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:25:25 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:25:25 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:25:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:25:29 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:25:29 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:25:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:25:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:25:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:25:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:25:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:25:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:25:34 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:25:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:25:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:25:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:25:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:25:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:25:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:25:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:25:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:25:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:25:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:25:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:25:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:25:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:25:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:25:49 user nova-compute[75391]: DEBUG nova.compute.manager [req-af798b18-a244-48ad-ab72-5d697bd79b3b req-2b205b53-c23c-47a0-970f-f90256dde4ac service nova] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Received event network-changed-4a7ee725-bab0-420b-ad41-de2362b61b6c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:25:49 user nova-compute[75391]: DEBUG nova.compute.manager [req-af798b18-a244-48ad-ab72-5d697bd79b3b req-2b205b53-c23c-47a0-970f-f90256dde4ac service nova] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Refreshing instance network info cache due to event network-changed-4a7ee725-bab0-420b-ad41-de2362b61b6c. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:25:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-af798b18-a244-48ad-ab72-5d697bd79b3b req-2b205b53-c23c-47a0-970f-f90256dde4ac service nova] Acquiring lock "refresh_cache-50faba39-14b3-4616-bae7-522df8a0dda6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:25:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-af798b18-a244-48ad-ab72-5d697bd79b3b req-2b205b53-c23c-47a0-970f-f90256dde4ac service nova] Acquired lock "refresh_cache-50faba39-14b3-4616-bae7-522df8a0dda6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:25:49 user nova-compute[75391]: DEBUG nova.network.neutron [req-af798b18-a244-48ad-ab72-5d697bd79b3b req-2b205b53-c23c-47a0-970f-f90256dde4ac service nova] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Refreshing network info cache for port 4a7ee725-bab0-420b-ad41-de2362b61b6c {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:25:50 user nova-compute[75391]: DEBUG nova.network.neutron [req-af798b18-a244-48ad-ab72-5d697bd79b3b req-2b205b53-c23c-47a0-970f-f90256dde4ac service nova] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Updated VIF entry in instance network info cache for port 4a7ee725-bab0-420b-ad41-de2362b61b6c. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:25:50 user nova-compute[75391]: DEBUG nova.network.neutron [req-af798b18-a244-48ad-ab72-5d697bd79b3b req-2b205b53-c23c-47a0-970f-f90256dde4ac service nova] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Updating instance_info_cache with network_info: [{"id": "4a7ee725-bab0-420b-ad41-de2362b61b6c", "address": "fa:16:3e:3d:8b:55", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7ee725-ba", "ovs_interfaceid": "4a7ee725-bab0-420b-ad41-de2362b61b6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:25:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-af798b18-a244-48ad-ab72-5d697bd79b3b req-2b205b53-c23c-47a0-970f-f90256dde4ac service nova] Releasing lock "refresh_cache-50faba39-14b3-4616-bae7-522df8a0dda6" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:25:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "50faba39-14b3-4616-bae7-522df8a0dda6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:25:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "50faba39-14b3-4616-bae7-522df8a0dda6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:25:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "50faba39-14b3-4616-bae7-522df8a0dda6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:25:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "50faba39-14b3-4616-bae7-522df8a0dda6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:25:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "50faba39-14b3-4616-bae7-522df8a0dda6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:25:51 user nova-compute[75391]: INFO nova.compute.manager [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Terminating instance
Nov 15 03:25:51 user nova-compute[75391]: DEBUG nova.compute.manager [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 03:25:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:25:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:25:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:25:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:25:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:25:51 user nova-compute[75391]: DEBUG nova.compute.manager [req-276ecd32-e179-424d-947e-5b26522132c4 req-42a0cca5-d855-409e-9542-c326f46e226f service nova] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Received event network-vif-unplugged-4a7ee725-bab0-420b-ad41-de2362b61b6c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:25:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-276ecd32-e179-424d-947e-5b26522132c4 req-42a0cca5-d855-409e-9542-c326f46e226f service nova] Acquiring lock "50faba39-14b3-4616-bae7-522df8a0dda6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:25:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-276ecd32-e179-424d-947e-5b26522132c4 req-42a0cca5-d855-409e-9542-c326f46e226f service nova] Lock "50faba39-14b3-4616-bae7-522df8a0dda6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:25:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-276ecd32-e179-424d-947e-5b26522132c4 req-42a0cca5-d855-409e-9542-c326f46e226f service nova] Lock "50faba39-14b3-4616-bae7-522df8a0dda6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:25:51 user nova-compute[75391]: DEBUG nova.compute.manager [req-276ecd32-e179-424d-947e-5b26522132c4 req-42a0cca5-d855-409e-9542-c326f46e226f service nova] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] No waiting events found dispatching network-vif-unplugged-4a7ee725-bab0-420b-ad41-de2362b61b6c {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:25:51 user nova-compute[75391]: DEBUG nova.compute.manager [req-276ecd32-e179-424d-947e-5b26522132c4 req-42a0cca5-d855-409e-9542-c326f46e226f service nova] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Received event network-vif-unplugged-4a7ee725-bab0-420b-ad41-de2362b61b6c for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 03:25:52 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Instance destroyed successfully.
Nov 15 03:25:52 user nova-compute[75391]: DEBUG nova.objects.instance [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lazy-loading 'resources' on Instance uuid 50faba39-14b3-4616-bae7-522df8a0dda6 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:23:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1225036149',display_name='tempest-TestVolumeBootPattern-server-1225036149',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1225036149',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJg/JMB6KZiOy3xqiKvUw4wmEoOOkjbbjUUw5YRCNp/4pUbJaMdGH1zK4epAbor0NINaArdvF0eDWEbgAh2qoUGQM0E2tP7PAZxp/Oap0zLOvPJXfcDjuQtWLjTKABzzsg==',key_name='tempest-TestVolumeBootPattern-1562130956',keypairs=<?>,launch_index=0,launched_at=2023-11-15T03:24:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac31667fa4804667afdb398aeb03d616',ramdisk_id='',reservation_id='r-v0vqslrw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1108994886',owner_user_name='tempest-TestVolumeBootPattern-1108994886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T03:24:08Z,user_data=None,user_id='27184608c0aa47f993c5f2020e5f7df4',uuid=50faba39-14b3-4616-bae7-522df8a0dda6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a7ee725-bab0-420b-ad41-de2362b61b6c", "address": "fa:16:3e:3d:8b:55", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7ee725-ba", "ovs_interfaceid": "4a7ee725-bab0-420b-ad41-de2362b61b6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converting VIF {"id": "4a7ee725-bab0-420b-ad41-de2362b61b6c", "address": "fa:16:3e:3d:8b:55", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7ee725-ba", "ovs_interfaceid": "4a7ee725-bab0-420b-ad41-de2362b61b6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:8b:55,bridge_name='br-int',has_traffic_filtering=True,id=4a7ee725-bab0-420b-ad41-de2362b61b6c,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a7ee725-ba') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG os_vif [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:8b:55,bridge_name='br-int',has_traffic_filtering=True,id=4a7ee725-bab0-420b-ad41-de2362b61b6c,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a7ee725-ba') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a7ee725-ba, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=397cfccc-ad5e-44ab-b28f-d35224d0517e) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:25:52 user nova-compute[75391]: INFO os_vif [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:8b:55,bridge_name='br-int',has_traffic_filtering=True,id=4a7ee725-bab0-420b-ad41-de2362b61b6c,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a7ee725-ba')
Nov 15 03:25:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuIDbqmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:25:52 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:25:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[632ee32f-a61b-4488-9391-d09434f81840]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 03:25:52 user nova-compute[75391]: No targets found.
Nov 15 03:25:52 user nova-compute[75391]: iSNS:
Nov 15 03:25:52 user nova-compute[75391]: No targets found.
Nov 15 03:25:52 user nova-compute[75391]: STATIC:
Nov 15 03:25:52 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535
Nov 15 03:25:52 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 03:25:52 user nova-compute[75391]:                 Iface Name: default
Nov 15 03:25:52 user nova-compute[75391]: FIRMWARE:
Nov 15 03:25:52 user nova-compute[75391]: No targets found.
Nov 15 03:25:52 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 03:25:52 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 03:25:52 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3522c3ef-43ff-4012-8656-ea353914679c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e390b5f6-4c03-445a-aeae-9c4af7590965]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 (non-flash)
Nov 15 03:25:52 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 (non-flash)
Nov 15 03:25:52 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6245854dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535'): ({'sdb'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Removing single pathed devices sdb {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[846ee5ac-1ae3-4f57-ae56-a3685f69412a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa22f2c-e98a-4081-9f58-16dd500cc992]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Flushing IO for device /dev/sdb {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d122be-945f-4154-8053-756be438e35a]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2586a1d-2ae3-4f90-a55e-8fbc533c21f8]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc11cd8d-074f-4697-9668-875d25788f18]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[baff2de7-1842-4d5a-82f2-31462866951e]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535, portal: 172.16.0.220,3260]
Nov 15 03:25:52 user nova-compute[75391]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535, portal: 172.16.0.220,3260] successful.
Nov 15 03:25:52 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a49ff4-8e44-414d-8623-6b2068b60d4c]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] <== disconnect_volume: return (318ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 03:25:52 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Deleting instance files /opt/stack/data/nova/instances/50faba39-14b3-4616-bae7-522df8a0dda6_del
Nov 15 03:25:52 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Deletion of /opt/stack/data/nova/instances/50faba39-14b3-4616-bae7-522df8a0dda6_del complete
Nov 15 03:25:52 user nova-compute[75391]: INFO nova.compute.manager [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 15 03:25:52 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 03:25:52 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 03:25:53 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:25:53 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Took 0.75 seconds to deallocate network for instance.
Nov 15 03:25:53 user nova-compute[75391]: DEBUG nova.compute.manager [req-a0f52fd6-6b30-49ea-8126-9f9e1ea876da req-e780d072-78b7-44be-8d6d-241b79e6e908 service nova] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Received event network-vif-plugged-4a7ee725-bab0-420b-ad41-de2362b61b6c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:25:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a0f52fd6-6b30-49ea-8126-9f9e1ea876da req-e780d072-78b7-44be-8d6d-241b79e6e908 service nova] Acquiring lock "50faba39-14b3-4616-bae7-522df8a0dda6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:25:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a0f52fd6-6b30-49ea-8126-9f9e1ea876da req-e780d072-78b7-44be-8d6d-241b79e6e908 service nova] Lock "50faba39-14b3-4616-bae7-522df8a0dda6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:25:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a0f52fd6-6b30-49ea-8126-9f9e1ea876da req-e780d072-78b7-44be-8d6d-241b79e6e908 service nova] Lock "50faba39-14b3-4616-bae7-522df8a0dda6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:25:53 user nova-compute[75391]: DEBUG nova.compute.manager [req-a0f52fd6-6b30-49ea-8126-9f9e1ea876da req-e780d072-78b7-44be-8d6d-241b79e6e908 service nova] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] No waiting events found dispatching network-vif-plugged-4a7ee725-bab0-420b-ad41-de2362b61b6c {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:25:53 user nova-compute[75391]: WARNING nova.compute.manager [req-a0f52fd6-6b30-49ea-8126-9f9e1ea876da req-e780d072-78b7-44be-8d6d-241b79e6e908 service nova] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Received unexpected event network-vif-plugged-4a7ee725-bab0-420b-ad41-de2362b61b6c for instance with vm_state active and task_state deleting.
Nov 15 03:25:53 user nova-compute[75391]: DEBUG nova.compute.manager [req-a0f52fd6-6b30-49ea-8126-9f9e1ea876da req-e780d072-78b7-44be-8d6d-241b79e6e908 service nova] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Received event network-vif-deleted-4a7ee725-bab0-420b-ad41-de2362b61b6c {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:25:53 user nova-compute[75391]: INFO nova.compute.manager [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 50faba39-14b3-4616-bae7-522df8a0dda6] Took 0.70 seconds to detach 1 volumes for instance.
Nov 15 03:25:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:25:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:25:54 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:25:54 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:25:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.108s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:25:54 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Deleted allocations for instance 50faba39-14b3-4616-bae7-522df8a0dda6
Nov 15 03:25:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-98b8dcbc-7c2c-48c3-b1a0-16beb865eeae tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "50faba39-14b3-4616-bae7-522df8a0dda6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.911s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:25:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:25:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:26:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:26:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:26:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:26:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:26:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:26:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:26:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:26:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:26:14 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:26:15 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:26:15 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:26:15 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 03:26:15 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Didn't find any instances for network info cache update. {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 03:26:16 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:26:17 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:26:17 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:26:22 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:26:22 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:26:22 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:26:22 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:26:22 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:26:22 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:26:23 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:26:24 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:26:26 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:26:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:26:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:26:26 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:26:26 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:26:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:26:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:26:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:26:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:26:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:26:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:26:27 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:26:27 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:26:27 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=9154MB free_disk=25.00115203857422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:26:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:26:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:26:27 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:26:27 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:26:27 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:26:27 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:26:27 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:26:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:26:31 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:26:31 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:26:31 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:26:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:26:36 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:26:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:26:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:26:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:26:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:26:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:26:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:26:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:26:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:26:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:26:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:26:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:26:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:26:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "304d8217-fa89-4a52-b50b-fa8c27759210" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:26:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "304d8217-fa89-4a52-b50b-fa8c27759210" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:26:42 user nova-compute[75391]: DEBUG nova.compute.manager [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 03:26:43 user nova-compute[75391]: INFO nova.compute.claims [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Claim successful on node user
Nov 15 03:26:43 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.178s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG nova.compute.manager [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG nova.compute.manager [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG nova.network.neutron [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 03:26:43 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 03:26:43 user nova-compute[75391]: DEBUG nova.compute.manager [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 03:26:43 user nova-compute[75391]: INFO nova.virt.block_device [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Booting with volume c3b6085f-c818-41c3-bd6e-6cbf5f1da535 at /dev/vda
Nov 15 03:26:43 user nova-compute[75391]: DEBUG nova.policy [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27184608c0aa47f993c5f2020e5f7df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac31667fa4804667afdb398aeb03d616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG os_brick.utils [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c638b5d-9620-49b0-b5f3-da627278c4a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[be27bfdf-df5b-48a4-8705-c995492b7aff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[490229e5-2d61-47cc-9882-b83846b7c479]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e42c421-074c-4828-84f3-c6ad2acbbbd6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:26:43 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 03:26:43 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e01d416-6717-44fe-898a-dfe535d700b9]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG os_brick.utils [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:26:43 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Updating existing volume attachment record: 4263d3aa-c3ba-4d39-99b1-06f428a3aa4a {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 03:26:44 user nova-compute[75391]: DEBUG nova.network.neutron [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Successfully created port: f7261234-1d4a-4df7-a6d0-d64c460e1ccf {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 03:26:44 user nova-compute[75391]: DEBUG nova.network.neutron [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Successfully updated port: f7261234-1d4a-4df7-a6d0-d64c460e1ccf {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 03:26:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "refresh_cache-304d8217-fa89-4a52-b50b-fa8c27759210" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:26:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquired lock "refresh_cache-304d8217-fa89-4a52-b50b-fa8c27759210" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:26:44 user nova-compute[75391]: DEBUG nova.network.neutron [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 03:26:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-c539322d-2248-417d-8fdd-a1e186af3366 req-9e91619c-d7b6-41ba-a572-816fae2adec0 service nova] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Received event network-changed-f7261234-1d4a-4df7-a6d0-d64c460e1ccf {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:26:44 user nova-compute[75391]: DEBUG nova.compute.manager [req-c539322d-2248-417d-8fdd-a1e186af3366 req-9e91619c-d7b6-41ba-a572-816fae2adec0 service nova] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Refreshing instance network info cache due to event network-changed-f7261234-1d4a-4df7-a6d0-d64c460e1ccf. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:26:44 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c539322d-2248-417d-8fdd-a1e186af3366 req-9e91619c-d7b6-41ba-a572-816fae2adec0 service nova] Acquiring lock "refresh_cache-304d8217-fa89-4a52-b50b-fa8c27759210" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:26:45 user nova-compute[75391]: DEBUG nova.network.neutron [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 03:26:45 user nova-compute[75391]: DEBUG nova.network.neutron [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Updating instance_info_cache with network_info: [{"id": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "address": "fa:16:3e:7b:cb:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7261234-1d", "ovs_interfaceid": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:26:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Releasing lock "refresh_cache-304d8217-fa89-4a52-b50b-fa8c27759210" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:26:45 user nova-compute[75391]: DEBUG nova.compute.manager [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Instance network_info: |[{"id": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "address": "fa:16:3e:7b:cb:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7261234-1d", "ovs_interfaceid": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 03:26:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c539322d-2248-417d-8fdd-a1e186af3366 req-9e91619c-d7b6-41ba-a572-816fae2adec0 service nova] Acquired lock "refresh_cache-304d8217-fa89-4a52-b50b-fa8c27759210" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:26:45 user nova-compute[75391]: DEBUG nova.network.neutron [req-c539322d-2248-417d-8fdd-a1e186af3366 req-9e91619c-d7b6-41ba-a572-816fae2adec0 service nova] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Refreshing network info cache for port f7261234-1d4a-4df7-a6d0-d64c460e1ccf {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:26:45 user nova-compute[75391]: DEBUG nova.network.neutron [req-c539322d-2248-417d-8fdd-a1e186af3366 req-9e91619c-d7b6-41ba-a572-816fae2adec0 service nova] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Updated VIF entry in instance network info cache for port f7261234-1d4a-4df7-a6d0-d64c460e1ccf. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:26:45 user nova-compute[75391]: DEBUG nova.network.neutron [req-c539322d-2248-417d-8fdd-a1e186af3366 req-9e91619c-d7b6-41ba-a572-816fae2adec0 service nova] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Updating instance_info_cache with network_info: [{"id": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "address": "fa:16:3e:7b:cb:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7261234-1d", "ovs_interfaceid": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:26:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-c539322d-2248-417d-8fdd-a1e186af3366 req-9e91619c-d7b6-41ba-a572-816fae2adec0 service nova] Releasing lock "refresh_cache-304d8217-fa89-4a52-b50b-fa8c27759210" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:26:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG nova.compute.manager [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 03:26:48 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Creating image(s)
Nov 15 03:26:48 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Did not create local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Ensure instance console log exists: /opt/stack/data/nova/instances/304d8217-fa89-4a52-b50b-fa8c27759210/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Start _get_guest_xml network_info=[{"id": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "address": "fa:16:3e:7b:cb:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7261234-1d", "ovs_interfaceid": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '4263d3aa-c3ba-4d39-99b1-06f428a3aa4a', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuIDbqmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '304d8217-fa89-4a52-b50b-fa8c27759210', 'attached_at': '', 'detached_at': '', 'volume_id': 'c3b6085f-c818-41c3-bd6e-6cbf5f1da535', 'serial': 'c3b6085f-c818-41c3-bd6e-6cbf5f1da535'}, 'volume_type': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 03:26:48 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:26:48 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:26:48 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuIDbqmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:26:48 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:26:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:26:48 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:26:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:26:48 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[18afc46a-003a-4968-b701-29bb566db704]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 03:26:48 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d8256b-0f8f-4fdd-b508-5bc006854dbf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535] added
Nov 15 03:26:48 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d9b1aa-7544-4b52-8dd1-8fa221ff46f7]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77540f5-b7a8-449c-b287-0bd906092a79]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QuIDbqmg {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QuIDbqmg" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4153fa-28f8-4768-9db7-b265d3bb88ef]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QuIDbqmg'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e650361-95b6-4104-ba83-781cfd47dcc9]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[152a395a-ea6f-49aa-b6b4-b0bb43c74c90]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 03:26:48 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 03:26:48 user nova-compute[75391]:  {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:26:48 user nova-compute[75391]: WARNING os_brick.initiator.connectors.iscsi [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 03:26:48 user nova-compute[75391]: 
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f1acbc-6320-4118-ad44-361eecfaafa9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535, portal: 172.16.0.220,3260]
Nov 15 03:26:48 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535, portal: 172.16.0.220,3260] successful.
Nov 15 03:26:48 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6d30fe-78dd-470e-b41b-26b77a475123]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb829f4a-368e-4015-8546-9bdd8bd92846]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 (non-flash)
Nov 15 03:26:48 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 (non-flash)
Nov 15 03:26:48 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0994a0b-9fc7-4467-a7f4-70feddb7ec8d]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 03:26:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuIDbqmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 03:26:49 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:26:49 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '26465366365393266', 'path': '/dev/sdb'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:26:49 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465366365393266', 'path': '/dev/sdb'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 03:26:49 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:26:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1760317854',display_name='tempest-TestVolumeBootPattern-server-1760317854',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1760317854',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJg/JMB6KZiOy3xqiKvUw4wmEoOOkjbbjUUw5YRCNp/4pUbJaMdGH1zK4epAbor0NINaArdvF0eDWEbgAh2qoUGQM0E2tP7PAZxp/Oap0zLOvPJXfcDjuQtWLjTKABzzsg==',key_name='tempest-TestVolumeBootPattern-1562130956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac31667fa4804667afdb398aeb03d616',ramdisk_id='',reservation_id='r-4090laar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1108994886',owner_user_name='tempest-TestVolumeBootPattern-1108994886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:26:43Z,user_data=None,user_id='27184608c0aa47f993c5f2020e5f7df4',uuid=304d8217-fa89-4a52-b50b-fa8c27759210,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "address": "fa:16:3e:7b:cb:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7261234-1d", "ovs_interfaceid": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 03:26:49 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converting VIF {"id": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "address": "fa:16:3e:7b:cb:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7261234-1d", "ovs_interfaceid": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:26:49 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:cb:66,bridge_name='br-int',has_traffic_filtering=True,id=f7261234-1d4a-4df7-a6d0-d64c460e1ccf,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7261234-1d') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:26:49 user nova-compute[75391]: DEBUG nova.objects.instance [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lazy-loading 'pci_devices' on Instance uuid 304d8217-fa89-4a52-b50b-fa8c27759210 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:26:49 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] End _get_guest_xml xml=<domain type="kvm">
Nov 15 03:26:49 user nova-compute[75391]:   <uuid>304d8217-fa89-4a52-b50b-fa8c27759210</uuid>
Nov 15 03:26:49 user nova-compute[75391]:   <name>instance-00000033</name>
Nov 15 03:26:49 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 03:26:49 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 03:26:49 user nova-compute[75391]:   <metadata>
Nov 15 03:26:49 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 03:26:49 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 03:26:49 user nova-compute[75391]:       <nova:name>tempest-TestVolumeBootPattern-server-1760317854</nova:name>
Nov 15 03:26:49 user nova-compute[75391]:       <nova:creationTime>2023-11-15 03:26:48</nova:creationTime>
Nov 15 03:26:49 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 03:26:49 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 03:26:49 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 03:26:49 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 03:26:49 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 03:26:49 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 03:26:49 user nova-compute[75391]:       </nova:flavor>
Nov 15 03:26:49 user nova-compute[75391]:       <nova:owner>
Nov 15 03:26:49 user nova-compute[75391]:         <nova:user uuid="27184608c0aa47f993c5f2020e5f7df4">tempest-TestVolumeBootPattern-1108994886-project-member</nova:user>
Nov 15 03:26:49 user nova-compute[75391]:         <nova:project uuid="ac31667fa4804667afdb398aeb03d616">tempest-TestVolumeBootPattern-1108994886</nova:project>
Nov 15 03:26:49 user nova-compute[75391]:       </nova:owner>
Nov 15 03:26:49 user nova-compute[75391]:       <nova:ports>
Nov 15 03:26:49 user nova-compute[75391]:         <nova:port uuid="f7261234-1d4a-4df7-a6d0-d64c460e1ccf">
Nov 15 03:26:49 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 03:26:49 user nova-compute[75391]:         </nova:port>
Nov 15 03:26:49 user nova-compute[75391]:       </nova:ports>
Nov 15 03:26:49 user nova-compute[75391]:     </nova:instance>
Nov 15 03:26:49 user nova-compute[75391]:   </metadata>
Nov 15 03:26:49 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 03:26:49 user nova-compute[75391]:     <system>
Nov 15 03:26:49 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 03:26:49 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 03:26:49 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 03:26:49 user nova-compute[75391]:       <entry name="serial">304d8217-fa89-4a52-b50b-fa8c27759210</entry>
Nov 15 03:26:49 user nova-compute[75391]:       <entry name="uuid">304d8217-fa89-4a52-b50b-fa8c27759210</entry>
Nov 15 03:26:49 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 03:26:49 user nova-compute[75391]:     </system>
Nov 15 03:26:49 user nova-compute[75391]:   </sysinfo>
Nov 15 03:26:49 user nova-compute[75391]:   <os>
Nov 15 03:26:49 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 03:26:49 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 03:26:49 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 03:26:49 user nova-compute[75391]:   </os>
Nov 15 03:26:49 user nova-compute[75391]:   <features>
Nov 15 03:26:49 user nova-compute[75391]:     <acpi/>
Nov 15 03:26:49 user nova-compute[75391]:     <apic/>
Nov 15 03:26:49 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 03:26:49 user nova-compute[75391]:   </features>
Nov 15 03:26:49 user nova-compute[75391]:   <clock offset="utc">
Nov 15 03:26:49 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 03:26:49 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 03:26:49 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 03:26:49 user nova-compute[75391]:   </clock>
Nov 15 03:26:49 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 03:26:49 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 03:26:49 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 03:26:49 user nova-compute[75391]:   </cpu>
Nov 15 03:26:49 user nova-compute[75391]:   <devices>
Nov 15 03:26:49 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 03:26:49 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:26:49 user nova-compute[75391]:       <source dev="/dev/sdb"/>
Nov 15 03:26:49 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 03:26:49 user nova-compute[75391]:       <serial>c3b6085f-c818-41c3-bd6e-6cbf5f1da535</serial>
Nov 15 03:26:49 user nova-compute[75391]:     </disk>
Nov 15 03:26:49 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 03:26:49 user nova-compute[75391]:       <mac address="fa:16:3e:7b:cb:66"/>
Nov 15 03:26:49 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:26:49 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 03:26:49 user nova-compute[75391]:       <target dev="tapf7261234-1d"/>
Nov 15 03:26:49 user nova-compute[75391]:     </interface>
Nov 15 03:26:49 user nova-compute[75391]:     <serial type="pty">
Nov 15 03:26:49 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/304d8217-fa89-4a52-b50b-fa8c27759210/console.log" append="off"/>
Nov 15 03:26:49 user nova-compute[75391]:     </serial>
Nov 15 03:26:49 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 03:26:49 user nova-compute[75391]:     <video>
Nov 15 03:26:49 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:26:49 user nova-compute[75391]:     </video>
Nov 15 03:26:49 user nova-compute[75391]:     <rng model="virtio">
Nov 15 03:26:49 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 03:26:49 user nova-compute[75391]:     </rng>
Nov 15 03:26:49 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 03:26:49 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 03:26:49 user nova-compute[75391]:       <stats period="10"/>
Nov 15 03:26:49 user nova-compute[75391]:     </memballoon>
Nov 15 03:26:49 user nova-compute[75391]:   </devices>
Nov 15 03:26:49 user nova-compute[75391]: </domain>
Nov 15 03:26:49 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 03:26:49 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:26:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1760317854',display_name='tempest-TestVolumeBootPattern-server-1760317854',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1760317854',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJg/JMB6KZiOy3xqiKvUw4wmEoOOkjbbjUUw5YRCNp/4pUbJaMdGH1zK4epAbor0NINaArdvF0eDWEbgAh2qoUGQM0E2tP7PAZxp/Oap0zLOvPJXfcDjuQtWLjTKABzzsg==',key_name='tempest-TestVolumeBootPattern-1562130956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac31667fa4804667afdb398aeb03d616',ramdisk_id='',reservation_id='r-4090laar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1108994886',owner_user_name='tempest-TestVolumeBootPattern-1108994886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:26:43Z,user_data=None,user_id='27184608c0aa47f993c5f2020e5f7df4',uuid=304d8217-fa89-4a52-b50b-fa8c27759210,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "address": "fa:16:3e:7b:cb:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7261234-1d", "ovs_interfaceid": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 03:26:49 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converting VIF {"id": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "address": "fa:16:3e:7b:cb:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7261234-1d", "ovs_interfaceid": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:26:49 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:cb:66,bridge_name='br-int',has_traffic_filtering=True,id=f7261234-1d4a-4df7-a6d0-d64c460e1ccf,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7261234-1d') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:26:49 user nova-compute[75391]: DEBUG os_vif [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:cb:66,bridge_name='br-int',has_traffic_filtering=True,id=f7261234-1d4a-4df7-a6d0-d64c460e1ccf,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7261234-1d') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 03:26:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:26:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:26:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 03:26:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:26:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4100430-7942-595d-86cd-8bf29673c80f', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:26:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:26:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:26:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7261234-1d, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:26:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf7261234-1d, col_values=(('qos', UUID('82443132-5c53-4274-9644-e2d7a88d9067')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:26:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf7261234-1d, col_values=(('external_ids', {'iface-id': 'f7261234-1d4a-4df7-a6d0-d64c460e1ccf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:cb:66', 'vm-uuid': '304d8217-fa89-4a52-b50b-fa8c27759210'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:26:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:26:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:26:49 user nova-compute[75391]: INFO os_vif [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:cb:66,bridge_name='br-int',has_traffic_filtering=True,id=f7261234-1d4a-4df7-a6d0-d64c460e1ccf,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7261234-1d')
Nov 15 03:26:49 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:26:49 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] No VIF found with MAC fa:16:3e:7b:cb:66, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 03:26:50 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:26:50 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:26:50 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:26:51 user nova-compute[75391]: DEBUG nova.compute.manager [req-5cded617-55c8-410e-a26d-717614f76be0 req-31e056bf-e505-45ab-8974-dc9444d587ff service nova] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Received event network-vif-plugged-f7261234-1d4a-4df7-a6d0-d64c460e1ccf {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:26:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5cded617-55c8-410e-a26d-717614f76be0 req-31e056bf-e505-45ab-8974-dc9444d587ff service nova] Acquiring lock "304d8217-fa89-4a52-b50b-fa8c27759210-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:26:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5cded617-55c8-410e-a26d-717614f76be0 req-31e056bf-e505-45ab-8974-dc9444d587ff service nova] Lock "304d8217-fa89-4a52-b50b-fa8c27759210-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:26:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5cded617-55c8-410e-a26d-717614f76be0 req-31e056bf-e505-45ab-8974-dc9444d587ff service nova] Lock "304d8217-fa89-4a52-b50b-fa8c27759210-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:26:51 user nova-compute[75391]: DEBUG nova.compute.manager [req-5cded617-55c8-410e-a26d-717614f76be0 req-31e056bf-e505-45ab-8974-dc9444d587ff service nova] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] No waiting events found dispatching network-vif-plugged-f7261234-1d4a-4df7-a6d0-d64c460e1ccf {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:26:51 user nova-compute[75391]: WARNING nova.compute.manager [req-5cded617-55c8-410e-a26d-717614f76be0 req-31e056bf-e505-45ab-8974-dc9444d587ff service nova] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Received unexpected event network-vif-plugged-f7261234-1d4a-4df7-a6d0-d64c460e1ccf for instance with vm_state building and task_state spawning.
Nov 15 03:26:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:26:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:26:51 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:26:53 user nova-compute[75391]: DEBUG nova.compute.manager [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 03:26:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 03:26:53 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Instance spawned successfully.
Nov 15 03:26:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 03:26:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:26:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:26:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:26:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:26:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:26:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:26:53 user nova-compute[75391]: DEBUG nova.compute.manager [req-90875fb3-096e-4fb8-98ff-5ace28105474 req-3916e49b-ad3e-4d0e-8ea5-4947bbb74437 service nova] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Received event network-vif-plugged-f7261234-1d4a-4df7-a6d0-d64c460e1ccf {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:26:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-90875fb3-096e-4fb8-98ff-5ace28105474 req-3916e49b-ad3e-4d0e-8ea5-4947bbb74437 service nova] Acquiring lock "304d8217-fa89-4a52-b50b-fa8c27759210-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:26:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-90875fb3-096e-4fb8-98ff-5ace28105474 req-3916e49b-ad3e-4d0e-8ea5-4947bbb74437 service nova] Lock "304d8217-fa89-4a52-b50b-fa8c27759210-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:26:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-90875fb3-096e-4fb8-98ff-5ace28105474 req-3916e49b-ad3e-4d0e-8ea5-4947bbb74437 service nova] Lock "304d8217-fa89-4a52-b50b-fa8c27759210-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:26:53 user nova-compute[75391]: DEBUG nova.compute.manager [req-90875fb3-096e-4fb8-98ff-5ace28105474 req-3916e49b-ad3e-4d0e-8ea5-4947bbb74437 service nova] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] No waiting events found dispatching network-vif-plugged-f7261234-1d4a-4df7-a6d0-d64c460e1ccf {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:26:53 user nova-compute[75391]: WARNING nova.compute.manager [req-90875fb3-096e-4fb8-98ff-5ace28105474 req-3916e49b-ad3e-4d0e-8ea5-4947bbb74437 service nova] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Received unexpected event network-vif-plugged-f7261234-1d4a-4df7-a6d0-d64c460e1ccf for instance with vm_state building and task_state spawning.
Nov 15 03:26:53 user nova-compute[75391]: INFO nova.compute.manager [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 15 03:26:53 user nova-compute[75391]: DEBUG nova.compute.manager [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 03:26:53 user nova-compute[75391]: INFO nova.compute.manager [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Took 10.32 seconds to build instance.
Nov 15 03:26:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-e3151982-0fb3-4f67-9dbf-e50e32b1f718 tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "304d8217-fa89-4a52-b50b-fa8c27759210" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.411s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:26:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:26:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:26:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:26:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:26:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:26:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:26:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:26:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:27:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:27:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:27:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:27:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:27:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:27:16 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:27:16 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:27:16 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 03:27:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-304d8217-fa89-4a52-b50b-fa8c27759210" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:27:16 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-304d8217-fa89-4a52-b50b-fa8c27759210" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:27:16 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:27:16 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lazy-loading 'info_cache' on Instance uuid 304d8217-fa89-4a52-b50b-fa8c27759210 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:27:17 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Updating instance_info_cache with network_info: [{"id": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "address": "fa:16:3e:7b:cb:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7261234-1d", "ovs_interfaceid": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:27:17 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-304d8217-fa89-4a52-b50b-fa8c27759210" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:27:17 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:27:17 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:27:17 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:27:17 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:27:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:27:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:27:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:27:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:27:25 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:27:26 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:27:28 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:27:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:27:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:27:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:27:28 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:27:28 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 03:27:29 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:27:29 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:27:29 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8988MB free_disk=24.99163818359375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:27:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:27:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:27:29 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 304d8217-fa89-4a52-b50b-fa8c27759210 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:27:29 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:27:29 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:27:29 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:27:29 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:27:29 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:27:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:27:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:27:33 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:27:33 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:27:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:27:38 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:27:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:27:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:27:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:27:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:27:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:28:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:28:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:28:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:28:16 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:28:18 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:28:18 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:28:18 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:28:18 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 03:28:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-304d8217-fa89-4a52-b50b-fa8c27759210" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:28:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-304d8217-fa89-4a52-b50b-fa8c27759210" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:28:19 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:28:19 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lazy-loading 'info_cache' on Instance uuid 304d8217-fa89-4a52-b50b-fa8c27759210 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:28:19 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Updating instance_info_cache with network_info: [{"id": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "address": "fa:16:3e:7b:cb:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7261234-1d", "ovs_interfaceid": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:28:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-304d8217-fa89-4a52-b50b-fa8c27759210" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:28:19 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:28:19 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:28:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:28:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:28:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:28:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:28:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:28:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:28:21 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:28:21 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 03:28:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:28:26 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:28:28 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:28:28 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:28:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:28:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:28:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:28:28 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:28:28 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 03:28:29 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:28:29 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:28:29 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=9019MB free_disk=24.991100311279297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:28:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:28:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:28:29 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 304d8217-fa89-4a52-b50b-fa8c27759210 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:28:29 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:28:29 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:28:29 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Refreshing inventories for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 03:28:29 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Updating ProviderTree inventory for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 03:28:29 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Updating inventory in ProviderTree for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 03:28:29 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Refreshing aggregate associations for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e, aggregates: None {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 03:28:29 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Refreshing trait associations for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 03:28:29 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:28:29 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:28:29 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:28:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.401s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:28:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:28:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:28:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:28:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:28:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:28:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:28:32 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:28:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:28:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:28:34 user nova-compute[75391]: DEBUG nova.compute.manager [req-ec401b96-50ba-49e5-87b9-51a5ad62caf7 req-44955bca-cffd-498e-9884-742d36a9e8e5 service nova] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Received event network-changed-f7261234-1d4a-4df7-a6d0-d64c460e1ccf {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:28:34 user nova-compute[75391]: DEBUG nova.compute.manager [req-ec401b96-50ba-49e5-87b9-51a5ad62caf7 req-44955bca-cffd-498e-9884-742d36a9e8e5 service nova] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Refreshing instance network info cache due to event network-changed-f7261234-1d4a-4df7-a6d0-d64c460e1ccf. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:28:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ec401b96-50ba-49e5-87b9-51a5ad62caf7 req-44955bca-cffd-498e-9884-742d36a9e8e5 service nova] Acquiring lock "refresh_cache-304d8217-fa89-4a52-b50b-fa8c27759210" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:28:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ec401b96-50ba-49e5-87b9-51a5ad62caf7 req-44955bca-cffd-498e-9884-742d36a9e8e5 service nova] Acquired lock "refresh_cache-304d8217-fa89-4a52-b50b-fa8c27759210" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:28:34 user nova-compute[75391]: DEBUG nova.network.neutron [req-ec401b96-50ba-49e5-87b9-51a5ad62caf7 req-44955bca-cffd-498e-9884-742d36a9e8e5 service nova] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Refreshing network info cache for port f7261234-1d4a-4df7-a6d0-d64c460e1ccf {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:28:34 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:28:34 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:28:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:28:34 user nova-compute[75391]: DEBUG nova.network.neutron [req-ec401b96-50ba-49e5-87b9-51a5ad62caf7 req-44955bca-cffd-498e-9884-742d36a9e8e5 service nova] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Updated VIF entry in instance network info cache for port f7261234-1d4a-4df7-a6d0-d64c460e1ccf. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:28:34 user nova-compute[75391]: DEBUG nova.network.neutron [req-ec401b96-50ba-49e5-87b9-51a5ad62caf7 req-44955bca-cffd-498e-9884-742d36a9e8e5 service nova] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Updating instance_info_cache with network_info: [{"id": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "address": "fa:16:3e:7b:cb:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7261234-1d", "ovs_interfaceid": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:28:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ec401b96-50ba-49e5-87b9-51a5ad62caf7 req-44955bca-cffd-498e-9884-742d36a9e8e5 service nova] Releasing lock "refresh_cache-304d8217-fa89-4a52-b50b-fa8c27759210" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:28:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:28:39 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:28:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "89b612ee-2379-429a-9305-7ff11a774413" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "89b612ee-2379-429a-9305-7ff11a774413" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG nova.compute.manager [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 03:28:40 user nova-compute[75391]: INFO nova.compute.claims [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Claim successful on node user
Nov 15 03:28:40 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.250s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG nova.compute.manager [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG nova.compute.manager [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG nova.network.neutron [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 03:28:40 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 03:28:40 user nova-compute[75391]: DEBUG nova.compute.manager [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 03:28:40 user nova-compute[75391]: INFO nova.virt.block_device [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Booting with volume 3ae822b5-4632-4b07-8ef3-233a108c377f at /dev/vda
Nov 15 03:28:40 user nova-compute[75391]: DEBUG nova.policy [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27184608c0aa47f993c5f2020e5f7df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac31667fa4804667afdb398aeb03d616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG os_brick.utils [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f761c2e-411b-4850-a876-09d29e611004]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[24293850-cbca-47b2-87b9-d4517893a92c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0091834f-ab2b-4b8c-a2b8-2ec0c6b20a21]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[135eb8b4-6678-4b50-8ed4-5ec03ceb54ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:28:40 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 03:28:40 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8010dc06-f321-412c-a03c-31ecdd40ef47]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG os_brick.utils [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:28:40 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Updating existing volume attachment record: 7bd73936-73c2-4b4e-a01b-0cdf6d1be72a {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 03:28:41 user nova-compute[75391]: DEBUG nova.network.neutron [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Successfully created port: b2814e28-1dde-4af5-8721-fff7b1729b58 {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 03:28:41 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:28:41 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Cleaning up deleted instances {{(pid=75391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 03:28:41 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] There are 0 instances to clean {{(pid=75391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 03:28:42 user nova-compute[75391]: DEBUG nova.network.neutron [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Successfully updated port: b2814e28-1dde-4af5-8721-fff7b1729b58 {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 03:28:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "refresh_cache-89b612ee-2379-429a-9305-7ff11a774413" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:28:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquired lock "refresh_cache-89b612ee-2379-429a-9305-7ff11a774413" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:28:42 user nova-compute[75391]: DEBUG nova.network.neutron [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 03:28:42 user nova-compute[75391]: DEBUG nova.network.neutron [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 03:28:42 user nova-compute[75391]: DEBUG nova.compute.manager [req-a6e61dd6-d3f6-4286-9a0e-d36711c0a0c8 req-76f06f9d-9994-4bdd-93c9-93cea9f18561 service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Received event network-changed-b2814e28-1dde-4af5-8721-fff7b1729b58 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:28:42 user nova-compute[75391]: DEBUG nova.compute.manager [req-a6e61dd6-d3f6-4286-9a0e-d36711c0a0c8 req-76f06f9d-9994-4bdd-93c9-93cea9f18561 service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Refreshing instance network info cache due to event network-changed-b2814e28-1dde-4af5-8721-fff7b1729b58. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:28:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a6e61dd6-d3f6-4286-9a0e-d36711c0a0c8 req-76f06f9d-9994-4bdd-93c9-93cea9f18561 service nova] Acquiring lock "refresh_cache-89b612ee-2379-429a-9305-7ff11a774413" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:28:42 user nova-compute[75391]: DEBUG nova.network.neutron [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Updating instance_info_cache with network_info: [{"id": "b2814e28-1dde-4af5-8721-fff7b1729b58", "address": "fa:16:3e:5a:ad:6f", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2814e28-1d", "ovs_interfaceid": "b2814e28-1dde-4af5-8721-fff7b1729b58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:28:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Releasing lock "refresh_cache-89b612ee-2379-429a-9305-7ff11a774413" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:28:42 user nova-compute[75391]: DEBUG nova.compute.manager [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Instance network_info: |[{"id": "b2814e28-1dde-4af5-8721-fff7b1729b58", "address": "fa:16:3e:5a:ad:6f", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2814e28-1d", "ovs_interfaceid": "b2814e28-1dde-4af5-8721-fff7b1729b58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 03:28:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a6e61dd6-d3f6-4286-9a0e-d36711c0a0c8 req-76f06f9d-9994-4bdd-93c9-93cea9f18561 service nova] Acquired lock "refresh_cache-89b612ee-2379-429a-9305-7ff11a774413" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:28:42 user nova-compute[75391]: DEBUG nova.network.neutron [req-a6e61dd6-d3f6-4286-9a0e-d36711c0a0c8 req-76f06f9d-9994-4bdd-93c9-93cea9f18561 service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Refreshing network info cache for port b2814e28-1dde-4af5-8721-fff7b1729b58 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:28:42 user nova-compute[75391]: DEBUG nova.network.neutron [req-a6e61dd6-d3f6-4286-9a0e-d36711c0a0c8 req-76f06f9d-9994-4bdd-93c9-93cea9f18561 service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Updated VIF entry in instance network info cache for port b2814e28-1dde-4af5-8721-fff7b1729b58. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:28:42 user nova-compute[75391]: DEBUG nova.network.neutron [req-a6e61dd6-d3f6-4286-9a0e-d36711c0a0c8 req-76f06f9d-9994-4bdd-93c9-93cea9f18561 service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Updating instance_info_cache with network_info: [{"id": "b2814e28-1dde-4af5-8721-fff7b1729b58", "address": "fa:16:3e:5a:ad:6f", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2814e28-1d", "ovs_interfaceid": "b2814e28-1dde-4af5-8721-fff7b1729b58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:28:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a6e61dd6-d3f6-4286-9a0e-d36711c0a0c8 req-76f06f9d-9994-4bdd-93c9-93cea9f18561 service nova] Releasing lock "refresh_cache-89b612ee-2379-429a-9305-7ff11a774413" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:28:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:28:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG nova.compute.manager [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 03:28:46 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Creating image(s)
Nov 15 03:28:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Did not create local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Ensure instance console log exists: /opt/stack/data/nova/instances/89b612ee-2379-429a-9305-7ff11a774413/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Start _get_guest_xml network_info=[{"id": "b2814e28-1dde-4af5-8721-fff7b1729b58", "address": "fa:16:3e:5a:ad:6f", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2814e28-1d", "ovs_interfaceid": "b2814e28-1dde-4af5-8721-fff7b1729b58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '7bd73936-73c2-4b4e-a01b-0cdf6d1be72a', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byZVvzkE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '89b612ee-2379-429a-9305-7ff11a774413', 'attached_at': '', 'detached_at': '', 'volume_id': '3ae822b5-4632-4b07-8ef3-233a108c377f', 'serial': '3ae822b5-4632-4b07-8ef3-233a108c377f'}, 'volume_type': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 03:28:46 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:28:46 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:28:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byZVvzkE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:28:46 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:28:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:28:46 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:28:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:28:46 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[849be07f-3c92-4d42-a4a8-0edd39339c6f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 03:28:46 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e13af05-ef37-44a3-82d2-6026f1888724]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f] added
Nov 15 03:28:46 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d23fd6e-7015-427f-8881-b3269a62d3f4]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7589d22-487e-4f0b-8354-eb9a8b200581]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v byZVvzkE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v byZVvzkE" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a431ec-c76e-407b-9b5e-348d4ef15c32]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'byZVvzkE'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7084b1ad-86a0-4d5e-b174-eb2e64b3534e]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba3da0e-d286-4bf0-a0ad-072d81a9bd85]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 (non-flash)
Nov 15 03:28:46 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 (non-flash)
Nov 15 03:28:46 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fd9a97-3c9c-4ab3-8411-72fb84f1bc48]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f, portal: 172.16.0.220,3260]
Nov 15 03:28:46 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f, portal: 172.16.0.220,3260] successful.
Nov 15 03:28:46 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cb5f9d-1038-4b33-bfef-08eec9136031]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[191e9f86-713e-41f3-bf65-8f1429ff819d]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 (non-flash)
Nov 15 03:28:46 user nova-compute[75391]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f (non-flash)
Nov 15 03:28:46 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 (non-flash)
Nov 15 03:28:46 user nova-compute[75391]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f (non-flash)
Nov 15 03:28:46 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aba301f-fc93-4224-b2b1-d5794fa8f51c]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:28:46 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: None {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 03:28:47 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 03:28:47 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byZVvzkE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 03:28:47 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:28:47 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26533363130353661', 'path': '/dev/sdc'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:28:47 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533363130353661', 'path': '/dev/sdc'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 03:28:47 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:28:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-671929190',display_name='tempest-TestVolumeBootPattern-server-671929190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-671929190',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJg/JMB6KZiOy3xqiKvUw4wmEoOOkjbbjUUw5YRCNp/4pUbJaMdGH1zK4epAbor0NINaArdvF0eDWEbgAh2qoUGQM0E2tP7PAZxp/Oap0zLOvPJXfcDjuQtWLjTKABzzsg==',key_name='tempest-TestVolumeBootPattern-1562130956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac31667fa4804667afdb398aeb03d616',ramdisk_id='',reservation_id='r-ehy8fz0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1108994886',owner_user_name='tempest-TestVolumeBootPattern-1108994886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:28:41Z,user_data=None,user_id='27184608c0aa47f993c5f2020e5f7df4',uuid=89b612ee-2379-429a-9305-7ff11a774413,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2814e28-1dde-4af5-8721-fff7b1729b58", "address": "fa:16:3e:5a:ad:6f", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2814e28-1d", "ovs_interfaceid": "b2814e28-1dde-4af5-8721-fff7b1729b58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 03:28:47 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converting VIF {"id": "b2814e28-1dde-4af5-8721-fff7b1729b58", "address": "fa:16:3e:5a:ad:6f", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2814e28-1d", "ovs_interfaceid": "b2814e28-1dde-4af5-8721-fff7b1729b58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:28:47 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ad:6f,bridge_name='br-int',has_traffic_filtering=True,id=b2814e28-1dde-4af5-8721-fff7b1729b58,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2814e28-1d') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:28:47 user nova-compute[75391]: DEBUG nova.objects.instance [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lazy-loading 'pci_devices' on Instance uuid 89b612ee-2379-429a-9305-7ff11a774413 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:28:47 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] End _get_guest_xml xml=<domain type="kvm">
Nov 15 03:28:47 user nova-compute[75391]:   <uuid>89b612ee-2379-429a-9305-7ff11a774413</uuid>
Nov 15 03:28:47 user nova-compute[75391]:   <name>instance-00000034</name>
Nov 15 03:28:47 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 03:28:47 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 03:28:47 user nova-compute[75391]:   <metadata>
Nov 15 03:28:47 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 03:28:47 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 03:28:47 user nova-compute[75391]:       <nova:name>tempest-TestVolumeBootPattern-server-671929190</nova:name>
Nov 15 03:28:47 user nova-compute[75391]:       <nova:creationTime>2023-11-15 03:28:46</nova:creationTime>
Nov 15 03:28:47 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 03:28:47 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 03:28:47 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 03:28:47 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 03:28:47 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 03:28:47 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 03:28:47 user nova-compute[75391]:       </nova:flavor>
Nov 15 03:28:47 user nova-compute[75391]:       <nova:owner>
Nov 15 03:28:47 user nova-compute[75391]:         <nova:user uuid="27184608c0aa47f993c5f2020e5f7df4">tempest-TestVolumeBootPattern-1108994886-project-member</nova:user>
Nov 15 03:28:47 user nova-compute[75391]:         <nova:project uuid="ac31667fa4804667afdb398aeb03d616">tempest-TestVolumeBootPattern-1108994886</nova:project>
Nov 15 03:28:47 user nova-compute[75391]:       </nova:owner>
Nov 15 03:28:47 user nova-compute[75391]:       <nova:ports>
Nov 15 03:28:47 user nova-compute[75391]:         <nova:port uuid="b2814e28-1dde-4af5-8721-fff7b1729b58">
Nov 15 03:28:47 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 03:28:47 user nova-compute[75391]:         </nova:port>
Nov 15 03:28:47 user nova-compute[75391]:       </nova:ports>
Nov 15 03:28:47 user nova-compute[75391]:     </nova:instance>
Nov 15 03:28:47 user nova-compute[75391]:   </metadata>
Nov 15 03:28:47 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 03:28:47 user nova-compute[75391]:     <system>
Nov 15 03:28:47 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 03:28:47 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 03:28:47 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 03:28:47 user nova-compute[75391]:       <entry name="serial">89b612ee-2379-429a-9305-7ff11a774413</entry>
Nov 15 03:28:47 user nova-compute[75391]:       <entry name="uuid">89b612ee-2379-429a-9305-7ff11a774413</entry>
Nov 15 03:28:47 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 03:28:47 user nova-compute[75391]:     </system>
Nov 15 03:28:47 user nova-compute[75391]:   </sysinfo>
Nov 15 03:28:47 user nova-compute[75391]:   <os>
Nov 15 03:28:47 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 03:28:47 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 03:28:47 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 03:28:47 user nova-compute[75391]:   </os>
Nov 15 03:28:47 user nova-compute[75391]:   <features>
Nov 15 03:28:47 user nova-compute[75391]:     <acpi/>
Nov 15 03:28:47 user nova-compute[75391]:     <apic/>
Nov 15 03:28:47 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 03:28:47 user nova-compute[75391]:   </features>
Nov 15 03:28:47 user nova-compute[75391]:   <clock offset="utc">
Nov 15 03:28:47 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 03:28:47 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 03:28:47 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 03:28:47 user nova-compute[75391]:   </clock>
Nov 15 03:28:47 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 03:28:47 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 03:28:47 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 03:28:47 user nova-compute[75391]:   </cpu>
Nov 15 03:28:47 user nova-compute[75391]:   <devices>
Nov 15 03:28:47 user nova-compute[75391]:     <disk type="block" device="disk">
Nov 15 03:28:47 user nova-compute[75391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:28:47 user nova-compute[75391]:       <source dev="/dev/sdc"/>
Nov 15 03:28:47 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 03:28:47 user nova-compute[75391]:       <serial>3ae822b5-4632-4b07-8ef3-233a108c377f</serial>
Nov 15 03:28:47 user nova-compute[75391]:     </disk>
Nov 15 03:28:47 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 03:28:47 user nova-compute[75391]:       <mac address="fa:16:3e:5a:ad:6f"/>
Nov 15 03:28:47 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:28:47 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 03:28:47 user nova-compute[75391]:       <target dev="tapb2814e28-1d"/>
Nov 15 03:28:47 user nova-compute[75391]:     </interface>
Nov 15 03:28:47 user nova-compute[75391]:     <serial type="pty">
Nov 15 03:28:47 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/89b612ee-2379-429a-9305-7ff11a774413/console.log" append="off"/>
Nov 15 03:28:47 user nova-compute[75391]:     </serial>
Nov 15 03:28:47 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 03:28:47 user nova-compute[75391]:     <video>
Nov 15 03:28:47 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:28:47 user nova-compute[75391]:     </video>
Nov 15 03:28:47 user nova-compute[75391]:     <rng model="virtio">
Nov 15 03:28:47 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 03:28:47 user nova-compute[75391]:     </rng>
Nov 15 03:28:47 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 03:28:47 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 03:28:47 user nova-compute[75391]:       <stats period="10"/>
Nov 15 03:28:47 user nova-compute[75391]:     </memballoon>
Nov 15 03:28:47 user nova-compute[75391]:   </devices>
Nov 15 03:28:47 user nova-compute[75391]: </domain>
Nov 15 03:28:47 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 03:28:47 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:28:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-671929190',display_name='tempest-TestVolumeBootPattern-server-671929190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-671929190',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJg/JMB6KZiOy3xqiKvUw4wmEoOOkjbbjUUw5YRCNp/4pUbJaMdGH1zK4epAbor0NINaArdvF0eDWEbgAh2qoUGQM0E2tP7PAZxp/Oap0zLOvPJXfcDjuQtWLjTKABzzsg==',key_name='tempest-TestVolumeBootPattern-1562130956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac31667fa4804667afdb398aeb03d616',ramdisk_id='',reservation_id='r-ehy8fz0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1108994886',owner_user_name='tempest-TestVolumeBootPattern-1108994886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:28:41Z,user_data=None,user_id='27184608c0aa47f993c5f2020e5f7df4',uuid=89b612ee-2379-429a-9305-7ff11a774413,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2814e28-1dde-4af5-8721-fff7b1729b58", "address": "fa:16:3e:5a:ad:6f", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2814e28-1d", "ovs_interfaceid": "b2814e28-1dde-4af5-8721-fff7b1729b58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 03:28:47 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converting VIF {"id": "b2814e28-1dde-4af5-8721-fff7b1729b58", "address": "fa:16:3e:5a:ad:6f", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2814e28-1d", "ovs_interfaceid": "b2814e28-1dde-4af5-8721-fff7b1729b58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:28:47 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ad:6f,bridge_name='br-int',has_traffic_filtering=True,id=b2814e28-1dde-4af5-8721-fff7b1729b58,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2814e28-1d') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:28:47 user nova-compute[75391]: DEBUG os_vif [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ad:6f,bridge_name='br-int',has_traffic_filtering=True,id=b2814e28-1dde-4af5-8721-fff7b1729b58,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2814e28-1d') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 03:28:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:28:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:28:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 03:28:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:28:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '631a22ff-7770-5c29-86b0-2e1036cf69d8', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:28:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:28:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:28:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:28:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2814e28-1d, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:28:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb2814e28-1d, col_values=(('qos', UUID('e9f6717c-612f-4632-b5a0-542693b71dc7')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:28:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb2814e28-1d, col_values=(('external_ids', {'iface-id': 'b2814e28-1dde-4af5-8721-fff7b1729b58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:ad:6f', 'vm-uuid': '89b612ee-2379-429a-9305-7ff11a774413'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:28:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:28:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:28:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:28:47 user nova-compute[75391]: INFO os_vif [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ad:6f,bridge_name='br-int',has_traffic_filtering=True,id=b2814e28-1dde-4af5-8721-fff7b1729b58,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2814e28-1d')
Nov 15 03:28:48 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:28:48 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] No VIF found with MAC fa:16:3e:5a:ad:6f, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 03:28:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:28:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:28:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:28:49 user nova-compute[75391]: DEBUG nova.compute.manager [req-5a4510c4-9902-44fc-a464-fa86fa4e7b84 req-0c1a28c6-eedd-4227-a921-c7a42417846e service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Received event network-vif-plugged-b2814e28-1dde-4af5-8721-fff7b1729b58 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:28:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a4510c4-9902-44fc-a464-fa86fa4e7b84 req-0c1a28c6-eedd-4227-a921-c7a42417846e service nova] Acquiring lock "89b612ee-2379-429a-9305-7ff11a774413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:28:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a4510c4-9902-44fc-a464-fa86fa4e7b84 req-0c1a28c6-eedd-4227-a921-c7a42417846e service nova] Lock "89b612ee-2379-429a-9305-7ff11a774413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:28:49 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a4510c4-9902-44fc-a464-fa86fa4e7b84 req-0c1a28c6-eedd-4227-a921-c7a42417846e service nova] Lock "89b612ee-2379-429a-9305-7ff11a774413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:28:49 user nova-compute[75391]: DEBUG nova.compute.manager [req-5a4510c4-9902-44fc-a464-fa86fa4e7b84 req-0c1a28c6-eedd-4227-a921-c7a42417846e service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] No waiting events found dispatching network-vif-plugged-b2814e28-1dde-4af5-8721-fff7b1729b58 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:28:49 user nova-compute[75391]: WARNING nova.compute.manager [req-5a4510c4-9902-44fc-a464-fa86fa4e7b84 req-0c1a28c6-eedd-4227-a921-c7a42417846e service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Received unexpected event network-vif-plugged-b2814e28-1dde-4af5-8721-fff7b1729b58 for instance with vm_state building and task_state spawning.
Nov 15 03:28:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:28:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:28:51 user nova-compute[75391]: DEBUG nova.compute.manager [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 03:28:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 03:28:51 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Instance spawned successfully.
Nov 15 03:28:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 03:28:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:28:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:28:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:28:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:28:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:28:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:28:51 user nova-compute[75391]: INFO nova.compute.manager [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Took 5.05 seconds to spawn the instance on the hypervisor.
Nov 15 03:28:51 user nova-compute[75391]: DEBUG nova.compute.manager [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 03:28:51 user nova-compute[75391]: DEBUG nova.compute.manager [req-f7eead86-6dcf-4a97-b6a5-3f48bde32cf6 req-5311ecb6-3a11-4745-b861-88f678fcc24f service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Received event network-vif-plugged-b2814e28-1dde-4af5-8721-fff7b1729b58 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:28:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f7eead86-6dcf-4a97-b6a5-3f48bde32cf6 req-5311ecb6-3a11-4745-b861-88f678fcc24f service nova] Acquiring lock "89b612ee-2379-429a-9305-7ff11a774413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:28:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f7eead86-6dcf-4a97-b6a5-3f48bde32cf6 req-5311ecb6-3a11-4745-b861-88f678fcc24f service nova] Lock "89b612ee-2379-429a-9305-7ff11a774413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:28:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-f7eead86-6dcf-4a97-b6a5-3f48bde32cf6 req-5311ecb6-3a11-4745-b861-88f678fcc24f service nova] Lock "89b612ee-2379-429a-9305-7ff11a774413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:28:51 user nova-compute[75391]: DEBUG nova.compute.manager [req-f7eead86-6dcf-4a97-b6a5-3f48bde32cf6 req-5311ecb6-3a11-4745-b861-88f678fcc24f service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] No waiting events found dispatching network-vif-plugged-b2814e28-1dde-4af5-8721-fff7b1729b58 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:28:51 user nova-compute[75391]: WARNING nova.compute.manager [req-f7eead86-6dcf-4a97-b6a5-3f48bde32cf6 req-5311ecb6-3a11-4745-b861-88f678fcc24f service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Received unexpected event network-vif-plugged-b2814e28-1dde-4af5-8721-fff7b1729b58 for instance with vm_state building and task_state spawning.
Nov 15 03:28:51 user nova-compute[75391]: INFO nova.compute.manager [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Took 11.25 seconds to build instance.
Nov 15 03:28:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4a3adbe2-75ac-4e29-87fc-dba44d6a0a9a tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "89b612ee-2379-429a-9305-7ff11a774413" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.364s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:28:51 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:28:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:28:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:28:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:29:02 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:29:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:29:07 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:29:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:29:12 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:29:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:29:17 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:29:18 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:29:18 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:29:18 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 03:29:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-304d8217-fa89-4a52-b50b-fa8c27759210" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:29:18 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-304d8217-fa89-4a52-b50b-fa8c27759210" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:29:18 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:29:18 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lazy-loading 'info_cache' on Instance uuid 304d8217-fa89-4a52-b50b-fa8c27759210 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:29:19 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Updating instance_info_cache with network_info: [{"id": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "address": "fa:16:3e:7b:cb:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7261234-1d", "ovs_interfaceid": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:29:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-304d8217-fa89-4a52-b50b-fa8c27759210" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:29:19 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:29:19 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:29:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:29:20 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:29:20 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:29:22 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:29:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:29:28 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:29:29 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:29:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:29:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:29:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:29:29 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:29:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 03:29:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 03:29:30 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:29:30 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:29:30 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8905MB free_disk=24.989246368408203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:29:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:29:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:29:30 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 304d8217-fa89-4a52-b50b-fa8c27759210 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:29:30 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 89b612ee-2379-429a-9305-7ff11a774413 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:29:30 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:29:30 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:29:30 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:29:30 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:29:30 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:29:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:29:31 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:29:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:29:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:29:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:29:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:29:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:29:32 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:29:35 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:29:35 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:29:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:29:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:29:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:29:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:29:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:29:37 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:29:39 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:29:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:29:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:29:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:29:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:29:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:29:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:29:45 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_power_states {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:29:45 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid 304d8217-fa89-4a52-b50b-fa8c27759210 {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 03:29:45 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid 89b612ee-2379-429a-9305-7ff11a774413 {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 03:29:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "304d8217-fa89-4a52-b50b-fa8c27759210" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:29:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "304d8217-fa89-4a52-b50b-fa8c27759210" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:29:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "89b612ee-2379-429a-9305-7ff11a774413" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:29:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "89b612ee-2379-429a-9305-7ff11a774413" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:29:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "304d8217-fa89-4a52-b50b-fa8c27759210" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:29:45 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "89b612ee-2379-429a-9305-7ff11a774413" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:29:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:29:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:29:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:29:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:29:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:29:47 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:29:52 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:29:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:29:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:29:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:29:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:29:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:29:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:30:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:30:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:30:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:30:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:30:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:30:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:30:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:30:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:30:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:30:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:30:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:30:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:30:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:30:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:30:18 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:30:19 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:30:19 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:30:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-89b612ee-2379-429a-9305-7ff11a774413" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:30:19 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-89b612ee-2379-429a-9305-7ff11a774413" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:30:19 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:30:20 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Updating instance_info_cache with network_info: [{"id": "b2814e28-1dde-4af5-8721-fff7b1729b58", "address": "fa:16:3e:5a:ad:6f", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2814e28-1d", "ovs_interfaceid": "b2814e28-1dde-4af5-8721-fff7b1729b58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:30:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-89b612ee-2379-429a-9305-7ff11a774413" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:30:20 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:30:21 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:30:21 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:30:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:30:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:30:28 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:30:29 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:30:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:30:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:30:29 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:30:29 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:30:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 03:30:29 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 03:30:30 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:30:30 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:30:30 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8938MB free_disk=24.988693237304688GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:30:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:30:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:30:30 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 304d8217-fa89-4a52-b50b-fa8c27759210 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:30:30 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 89b612ee-2379-429a-9305-7ff11a774413 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:30:30 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:30:30 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:30:30 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:30:30 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:30:30 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:30:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:30:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:30:31 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:30:32 user nova-compute[75391]: DEBUG nova.compute.manager [req-b1926961-5de3-4f22-a56c-3bc1431bcedd req-58f43d85-a184-4044-a2ad-dc30df60b9cb service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Received event network-changed-b2814e28-1dde-4af5-8721-fff7b1729b58 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:30:32 user nova-compute[75391]: DEBUG nova.compute.manager [req-b1926961-5de3-4f22-a56c-3bc1431bcedd req-58f43d85-a184-4044-a2ad-dc30df60b9cb service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Refreshing instance network info cache due to event network-changed-b2814e28-1dde-4af5-8721-fff7b1729b58. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:30:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b1926961-5de3-4f22-a56c-3bc1431bcedd req-58f43d85-a184-4044-a2ad-dc30df60b9cb service nova] Acquiring lock "refresh_cache-89b612ee-2379-429a-9305-7ff11a774413" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:30:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b1926961-5de3-4f22-a56c-3bc1431bcedd req-58f43d85-a184-4044-a2ad-dc30df60b9cb service nova] Acquired lock "refresh_cache-89b612ee-2379-429a-9305-7ff11a774413" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:30:32 user nova-compute[75391]: DEBUG nova.network.neutron [req-b1926961-5de3-4f22-a56c-3bc1431bcedd req-58f43d85-a184-4044-a2ad-dc30df60b9cb service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Refreshing network info cache for port b2814e28-1dde-4af5-8721-fff7b1729b58 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:30:32 user nova-compute[75391]: DEBUG nova.network.neutron [req-b1926961-5de3-4f22-a56c-3bc1431bcedd req-58f43d85-a184-4044-a2ad-dc30df60b9cb service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Updated VIF entry in instance network info cache for port b2814e28-1dde-4af5-8721-fff7b1729b58. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:30:32 user nova-compute[75391]: DEBUG nova.network.neutron [req-b1926961-5de3-4f22-a56c-3bc1431bcedd req-58f43d85-a184-4044-a2ad-dc30df60b9cb service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Updating instance_info_cache with network_info: [{"id": "b2814e28-1dde-4af5-8721-fff7b1729b58", "address": "fa:16:3e:5a:ad:6f", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2814e28-1d", "ovs_interfaceid": "b2814e28-1dde-4af5-8721-fff7b1729b58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:30:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-b1926961-5de3-4f22-a56c-3bc1431bcedd req-58f43d85-a184-4044-a2ad-dc30df60b9cb service nova] Releasing lock "refresh_cache-89b612ee-2379-429a-9305-7ff11a774413" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-5f854bf4-eee8-453e-8e2b-484c41baa1c7 req-66f963f0-f2bd-44b4-8b75-ed8609e183ee service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Received event network-changed-b2814e28-1dde-4af5-8721-fff7b1729b58 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG nova.compute.manager [req-5f854bf4-eee8-453e-8e2b-484c41baa1c7 req-66f963f0-f2bd-44b4-8b75-ed8609e183ee service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Refreshing instance network info cache due to event network-changed-b2814e28-1dde-4af5-8721-fff7b1729b58. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5f854bf4-eee8-453e-8e2b-484c41baa1c7 req-66f963f0-f2bd-44b4-8b75-ed8609e183ee service nova] Acquiring lock "refresh_cache-89b612ee-2379-429a-9305-7ff11a774413" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5f854bf4-eee8-453e-8e2b-484c41baa1c7 req-66f963f0-f2bd-44b4-8b75-ed8609e183ee service nova] Acquired lock "refresh_cache-89b612ee-2379-429a-9305-7ff11a774413" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG nova.network.neutron [req-5f854bf4-eee8-453e-8e2b-484c41baa1c7 req-66f963f0-f2bd-44b4-8b75-ed8609e183ee service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Refreshing network info cache for port b2814e28-1dde-4af5-8721-fff7b1729b58 {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "89b612ee-2379-429a-9305-7ff11a774413" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "89b612ee-2379-429a-9305-7ff11a774413" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "89b612ee-2379-429a-9305-7ff11a774413-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "89b612ee-2379-429a-9305-7ff11a774413-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "89b612ee-2379-429a-9305-7ff11a774413-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:30:33 user nova-compute[75391]: INFO nova.compute.manager [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Terminating instance
Nov 15 03:30:33 user nova-compute[75391]: DEBUG nova.compute.manager [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG nova.network.neutron [req-5f854bf4-eee8-453e-8e2b-484c41baa1c7 req-66f963f0-f2bd-44b4-8b75-ed8609e183ee service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Updated VIF entry in instance network info cache for port b2814e28-1dde-4af5-8721-fff7b1729b58. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG nova.network.neutron [req-5f854bf4-eee8-453e-8e2b-484c41baa1c7 req-66f963f0-f2bd-44b4-8b75-ed8609e183ee service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Updating instance_info_cache with network_info: [{"id": "b2814e28-1dde-4af5-8721-fff7b1729b58", "address": "fa:16:3e:5a:ad:6f", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2814e28-1d", "ovs_interfaceid": "b2814e28-1dde-4af5-8721-fff7b1729b58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5f854bf4-eee8-453e-8e2b-484c41baa1c7 req-66f963f0-f2bd-44b4-8b75-ed8609e183ee service nova] Releasing lock "refresh_cache-89b612ee-2379-429a-9305-7ff11a774413" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:30:33 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Instance destroyed successfully.
Nov 15 03:30:33 user nova-compute[75391]: DEBUG nova.objects.instance [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lazy-loading 'resources' on Instance uuid 89b612ee-2379-429a-9305-7ff11a774413 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:28:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-671929190',display_name='tempest-TestVolumeBootPattern-server-671929190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-671929190',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJg/JMB6KZiOy3xqiKvUw4wmEoOOkjbbjUUw5YRCNp/4pUbJaMdGH1zK4epAbor0NINaArdvF0eDWEbgAh2qoUGQM0E2tP7PAZxp/Oap0zLOvPJXfcDjuQtWLjTKABzzsg==',key_name='tempest-TestVolumeBootPattern-1562130956',keypairs=<?>,launch_index=0,launched_at=2023-11-15T03:28:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac31667fa4804667afdb398aeb03d616',ramdisk_id='',reservation_id='r-ehy8fz0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1108994886',owner_user_name='tempest-TestVolumeBootPattern-1108994886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T03:28:52Z,user_data=None,user_id='27184608c0aa47f993c5f2020e5f7df4',uuid=89b612ee-2379-429a-9305-7ff11a774413,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2814e28-1dde-4af5-8721-fff7b1729b58", "address": "fa:16:3e:5a:ad:6f", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2814e28-1d", "ovs_interfaceid": "b2814e28-1dde-4af5-8721-fff7b1729b58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converting VIF {"id": "b2814e28-1dde-4af5-8721-fff7b1729b58", "address": "fa:16:3e:5a:ad:6f", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2814e28-1d", "ovs_interfaceid": "b2814e28-1dde-4af5-8721-fff7b1729b58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:ad:6f,bridge_name='br-int',has_traffic_filtering=True,id=b2814e28-1dde-4af5-8721-fff7b1729b58,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2814e28-1d') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG os_vif [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:ad:6f,bridge_name='br-int',has_traffic_filtering=True,id=b2814e28-1dde-4af5-8721-fff7b1729b58,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2814e28-1d') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2814e28-1d, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9f6717c-612f-4632-b5a0-542693b71dc7) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:30:33 user nova-compute[75391]: INFO os_vif [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:ad:6f,bridge_name='br-int',has_traffic_filtering=True,id=b2814e28-1dde-4af5-8721-fff7b1729b58,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2814e28-1d')
Nov 15 03:30:33 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byZVvzkE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:30:33 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:30:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8361bdf3-26ca-41bd-a8e8-d19ca906feeb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 03:30:33 user nova-compute[75391]: No targets found.
Nov 15 03:30:33 user nova-compute[75391]: iSNS:
Nov 15 03:30:33 user nova-compute[75391]: No targets found.
Nov 15 03:30:33 user nova-compute[75391]: STATIC:
Nov 15 03:30:33 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f
Nov 15 03:30:33 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 03:30:33 user nova-compute[75391]:                 Iface Name: default
Nov 15 03:30:33 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535
Nov 15 03:30:33 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 03:30:33 user nova-compute[75391]:                 Iface Name: default
Nov 15 03:30:33 user nova-compute[75391]: FIRMWARE:
Nov 15 03:30:33 user nova-compute[75391]: No targets found.
Nov 15 03:30:33 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 03:30:33 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 03:30:33 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[55deb32b-de2d-4d00-971a-8b35b4572727]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:30:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[614ad4b1-7459-45d6-9bd8-c653cad430e0]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 (non-flash)
Nov 15 03:30:34 user nova-compute[75391]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f (non-flash)
Nov 15 03:30:34 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 (non-flash)
Nov 15 03:30:34 user nova-compute[75391]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f (non-flash)
Nov 15 03:30:34 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f623c141d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f'): ({'sdc'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Removing single pathed devices sdc {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[246084cb-91b0-4d17-b629-72eb5e7ec54f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a230f7e7-f124-4143-a474-e2d43424fe56]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Flushing IO for device /dev/sdc {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9365926f-0c33-4334-b8bf-b8afb19a3808]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1d8cc9-fc0f-412e-b33c-f3a567f1e875]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] SCSI volumes sdc have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOcce7ac92-e361056a24006250', '/dev/disk/by-id/scsi-26533363130353661', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_cce7ac92') {{(pid=85237) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[844e05ad-341e-40ee-b724-f4d3df11d43d]: (4, None) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2fe478-e91f-4575-9b6c-375701461cc2]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[81477b28-9ffa-47da-8f77-abed60aa78f3]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f, portal: 172.16.0.220,3260]
Nov 15 03:30:34 user nova-compute[75391]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f, portal: 172.16.0.220,3260] successful.
Nov 15 03:30:34 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae822b5-4632-4b07-8ef3-233a108c377f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6149dc39-f9b1-407a-bcff-ffd104a0833f]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] <== disconnect_volume: return (310ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 03:30:34 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Deleting instance files /opt/stack/data/nova/instances/89b612ee-2379-429a-9305-7ff11a774413_del
Nov 15 03:30:34 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Deletion of /opt/stack/data/nova/instances/89b612ee-2379-429a-9305-7ff11a774413_del complete
Nov 15 03:30:34 user nova-compute[75391]: INFO nova.compute.manager [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 15 03:30:34 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 89b612ee-2379-429a-9305-7ff11a774413] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:30:34 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:30:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-8b3787ad-fdc6-4795-bef2-a7d63a8fff38 req-5290910d-96a3-4a42-8140-db1f73c7cfd8 service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Received event network-vif-unplugged-b2814e28-1dde-4af5-8721-fff7b1729b58 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:30:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8b3787ad-fdc6-4795-bef2-a7d63a8fff38 req-5290910d-96a3-4a42-8140-db1f73c7cfd8 service nova] Acquiring lock "89b612ee-2379-429a-9305-7ff11a774413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:30:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8b3787ad-fdc6-4795-bef2-a7d63a8fff38 req-5290910d-96a3-4a42-8140-db1f73c7cfd8 service nova] Lock "89b612ee-2379-429a-9305-7ff11a774413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:30:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8b3787ad-fdc6-4795-bef2-a7d63a8fff38 req-5290910d-96a3-4a42-8140-db1f73c7cfd8 service nova] Lock "89b612ee-2379-429a-9305-7ff11a774413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:30:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-8b3787ad-fdc6-4795-bef2-a7d63a8fff38 req-5290910d-96a3-4a42-8140-db1f73c7cfd8 service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] No waiting events found dispatching network-vif-unplugged-b2814e28-1dde-4af5-8721-fff7b1729b58 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:30:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-8b3787ad-fdc6-4795-bef2-a7d63a8fff38 req-5290910d-96a3-4a42-8140-db1f73c7cfd8 service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Received event network-vif-unplugged-b2814e28-1dde-4af5-8721-fff7b1729b58 for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 03:30:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-8b3787ad-fdc6-4795-bef2-a7d63a8fff38 req-5290910d-96a3-4a42-8140-db1f73c7cfd8 service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Received event network-vif-plugged-b2814e28-1dde-4af5-8721-fff7b1729b58 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:30:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8b3787ad-fdc6-4795-bef2-a7d63a8fff38 req-5290910d-96a3-4a42-8140-db1f73c7cfd8 service nova] Acquiring lock "89b612ee-2379-429a-9305-7ff11a774413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:30:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8b3787ad-fdc6-4795-bef2-a7d63a8fff38 req-5290910d-96a3-4a42-8140-db1f73c7cfd8 service nova] Lock "89b612ee-2379-429a-9305-7ff11a774413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:30:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-8b3787ad-fdc6-4795-bef2-a7d63a8fff38 req-5290910d-96a3-4a42-8140-db1f73c7cfd8 service nova] Lock "89b612ee-2379-429a-9305-7ff11a774413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:30:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-8b3787ad-fdc6-4795-bef2-a7d63a8fff38 req-5290910d-96a3-4a42-8140-db1f73c7cfd8 service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] No waiting events found dispatching network-vif-plugged-b2814e28-1dde-4af5-8721-fff7b1729b58 {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:30:35 user nova-compute[75391]: WARNING nova.compute.manager [req-8b3787ad-fdc6-4795-bef2-a7d63a8fff38 req-5290910d-96a3-4a42-8140-db1f73c7cfd8 service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Received unexpected event network-vif-plugged-b2814e28-1dde-4af5-8721-fff7b1729b58 for instance with vm_state active and task_state deleting.
Nov 15 03:30:35 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:30:35 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Took 0.86 seconds to deallocate network for instance.
Nov 15 03:30:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-d5cb57a3-03b0-4f0d-bea1-201725ab40a5 req-21ced9a3-c32f-49e8-b64d-3809933f2438 service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Received event network-vif-deleted-b2814e28-1dde-4af5-8721-fff7b1729b58 {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:30:35 user nova-compute[75391]: INFO nova.compute.manager [req-d5cb57a3-03b0-4f0d-bea1-201725ab40a5 req-21ced9a3-c32f-49e8-b64d-3809933f2438 service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Neutron deleted interface b2814e28-1dde-4af5-8721-fff7b1729b58; detaching it from the instance and deleting it from the info cache
Nov 15 03:30:35 user nova-compute[75391]: DEBUG nova.network.neutron [req-d5cb57a3-03b0-4f0d-bea1-201725ab40a5 req-21ced9a3-c32f-49e8-b64d-3809933f2438 service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:30:35 user nova-compute[75391]: DEBUG nova.compute.manager [req-d5cb57a3-03b0-4f0d-bea1-201725ab40a5 req-21ced9a3-c32f-49e8-b64d-3809933f2438 service nova] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Detach interface failed, port_id=b2814e28-1dde-4af5-8721-fff7b1729b58, reason: Instance 89b612ee-2379-429a-9305-7ff11a774413 could not be found. {{(pid=75391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 03:30:35 user nova-compute[75391]: INFO nova.compute.manager [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 89b612ee-2379-429a-9305-7ff11a774413] Took 0.72 seconds to detach 1 volumes for instance.
Nov 15 03:30:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:30:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:30:36 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:30:36 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:30:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.133s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:30:36 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Deleted allocations for instance 89b612ee-2379-429a-9305-7ff11a774413
Nov 15 03:30:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-01cf805c-a7d3-4957-82fe-2d7fbe75845b tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "89b612ee-2379-429a-9305-7ff11a774413" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.090s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:30:36 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:30:36 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:30:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:30:40 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:30:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:30:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:30:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:30:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:31:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:31:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:31:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:31:18 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:31:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:31:21 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:31:21 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:31:21 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:31:21 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 03:31:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-304d8217-fa89-4a52-b50b-fa8c27759210" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:31:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-304d8217-fa89-4a52-b50b-fa8c27759210" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:31:21 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:31:21 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lazy-loading 'info_cache' on Instance uuid 304d8217-fa89-4a52-b50b-fa8c27759210 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:31:22 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Updating instance_info_cache with network_info: [{"id": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "address": "fa:16:3e:7b:cb:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7261234-1d", "ovs_interfaceid": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:31:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-304d8217-fa89-4a52-b50b-fa8c27759210" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:31:22 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:31:22 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:31:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:31:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-51c798aa-48c5-40d7-a053-563e089a07a2 req-7b136ff5-1f2b-4f42-9cb2-fc959f8e7f5c service nova] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Received event network-changed-f7261234-1d4a-4df7-a6d0-d64c460e1ccf {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:31:27 user nova-compute[75391]: DEBUG nova.compute.manager [req-51c798aa-48c5-40d7-a053-563e089a07a2 req-7b136ff5-1f2b-4f42-9cb2-fc959f8e7f5c service nova] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Refreshing instance network info cache due to event network-changed-f7261234-1d4a-4df7-a6d0-d64c460e1ccf. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:31:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-51c798aa-48c5-40d7-a053-563e089a07a2 req-7b136ff5-1f2b-4f42-9cb2-fc959f8e7f5c service nova] Acquiring lock "refresh_cache-304d8217-fa89-4a52-b50b-fa8c27759210" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:31:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-51c798aa-48c5-40d7-a053-563e089a07a2 req-7b136ff5-1f2b-4f42-9cb2-fc959f8e7f5c service nova] Acquired lock "refresh_cache-304d8217-fa89-4a52-b50b-fa8c27759210" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:31:27 user nova-compute[75391]: DEBUG nova.network.neutron [req-51c798aa-48c5-40d7-a053-563e089a07a2 req-7b136ff5-1f2b-4f42-9cb2-fc959f8e7f5c service nova] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Refreshing network info cache for port f7261234-1d4a-4df7-a6d0-d64c460e1ccf {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:31:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "304d8217-fa89-4a52-b50b-fa8c27759210" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:31:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "304d8217-fa89-4a52-b50b-fa8c27759210" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:31:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "304d8217-fa89-4a52-b50b-fa8c27759210-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:31:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "304d8217-fa89-4a52-b50b-fa8c27759210-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:31:27 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "304d8217-fa89-4a52-b50b-fa8c27759210-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:31:27 user nova-compute[75391]: INFO nova.compute.manager [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Terminating instance
Nov 15 03:31:27 user nova-compute[75391]: DEBUG nova.compute.manager [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 03:31:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:31:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:31:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:31:27 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG nova.network.neutron [req-51c798aa-48c5-40d7-a053-563e089a07a2 req-7b136ff5-1f2b-4f42-9cb2-fc959f8e7f5c service nova] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Updated VIF entry in instance network info cache for port f7261234-1d4a-4df7-a6d0-d64c460e1ccf. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG nova.network.neutron [req-51c798aa-48c5-40d7-a053-563e089a07a2 req-7b136ff5-1f2b-4f42-9cb2-fc959f8e7f5c service nova] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Updating instance_info_cache with network_info: [{"id": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "address": "fa:16:3e:7b:cb:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7261234-1d", "ovs_interfaceid": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG nova.compute.manager [req-e5abb043-15b1-428c-a2c9-aebcee7ca9ab req-7ef9fad7-8e5a-45c4-bb05-fb9e7ffb661f service nova] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Received event network-vif-unplugged-f7261234-1d4a-4df7-a6d0-d64c460e1ccf {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e5abb043-15b1-428c-a2c9-aebcee7ca9ab req-7ef9fad7-8e5a-45c4-bb05-fb9e7ffb661f service nova] Acquiring lock "304d8217-fa89-4a52-b50b-fa8c27759210-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e5abb043-15b1-428c-a2c9-aebcee7ca9ab req-7ef9fad7-8e5a-45c4-bb05-fb9e7ffb661f service nova] Lock "304d8217-fa89-4a52-b50b-fa8c27759210-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e5abb043-15b1-428c-a2c9-aebcee7ca9ab req-7ef9fad7-8e5a-45c4-bb05-fb9e7ffb661f service nova] Lock "304d8217-fa89-4a52-b50b-fa8c27759210-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG nova.compute.manager [req-e5abb043-15b1-428c-a2c9-aebcee7ca9ab req-7ef9fad7-8e5a-45c4-bb05-fb9e7ffb661f service nova] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] No waiting events found dispatching network-vif-unplugged-f7261234-1d4a-4df7-a6d0-d64c460e1ccf {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG nova.compute.manager [req-e5abb043-15b1-428c-a2c9-aebcee7ca9ab req-7ef9fad7-8e5a-45c4-bb05-fb9e7ffb661f service nova] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Received event network-vif-unplugged-f7261234-1d4a-4df7-a6d0-d64c460e1ccf for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-51c798aa-48c5-40d7-a053-563e089a07a2 req-7b136ff5-1f2b-4f42-9cb2-fc959f8e7f5c service nova] Releasing lock "refresh_cache-304d8217-fa89-4a52-b50b-fa8c27759210" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:31:28 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Instance destroyed successfully.
Nov 15 03:31:28 user nova-compute[75391]: DEBUG nova.objects.instance [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lazy-loading 'resources' on Instance uuid 304d8217-fa89-4a52-b50b-fa8c27759210 {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:26:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1760317854',display_name='tempest-TestVolumeBootPattern-server-1760317854',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1760317854',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJg/JMB6KZiOy3xqiKvUw4wmEoOOkjbbjUUw5YRCNp/4pUbJaMdGH1zK4epAbor0NINaArdvF0eDWEbgAh2qoUGQM0E2tP7PAZxp/Oap0zLOvPJXfcDjuQtWLjTKABzzsg==',key_name='tempest-TestVolumeBootPattern-1562130956',keypairs=<?>,launch_index=0,launched_at=2023-11-15T03:26:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac31667fa4804667afdb398aeb03d616',ramdisk_id='',reservation_id='r-4090laar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1108994886',owner_user_name='tempest-TestVolumeBootPattern-1108994886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T03:26:53Z,user_data=None,user_id='27184608c0aa47f993c5f2020e5f7df4',uuid=304d8217-fa89-4a52-b50b-fa8c27759210,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "address": "fa:16:3e:7b:cb:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7261234-1d", "ovs_interfaceid": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converting VIF {"id": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "address": "fa:16:3e:7b:cb:66", "network": {"id": "b7d5db0e-616c-4908-9681-c87ecb0b3413", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1118573954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac31667fa4804667afdb398aeb03d616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7261234-1d", "ovs_interfaceid": "f7261234-1d4a-4df7-a6d0-d64c460e1ccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:cb:66,bridge_name='br-int',has_traffic_filtering=True,id=f7261234-1d4a-4df7-a6d0-d64c460e1ccf,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7261234-1d') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG os_vif [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:cb:66,bridge_name='br-int',has_traffic_filtering=True,id=f7261234-1d4a-4df7-a6d0-d64c460e1ccf,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7261234-1d') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7261234-1d, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82443132-5c53-4274-9644-e2d7a88d9067) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:31:28 user nova-compute[75391]: INFO os_vif [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:cb:66,bridge_name='br-int',has_traffic_filtering=True,id=f7261234-1d4a-4df7-a6d0-d64c460e1ccf,network=Network(b7d5db0e-616c-4908-9681-c87ecb0b3413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7261234-1d')
Nov 15 03:31:28 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuIDbqmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:31:28 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:31:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b416eb-a337-431d-934a-ab2928f7fb8e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 03:31:28 user nova-compute[75391]: No targets found.
Nov 15 03:31:28 user nova-compute[75391]: iSNS:
Nov 15 03:31:28 user nova-compute[75391]: No targets found.
Nov 15 03:31:28 user nova-compute[75391]: STATIC:
Nov 15 03:31:28 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535
Nov 15 03:31:28 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 03:31:28 user nova-compute[75391]:                 Iface Name: default
Nov 15 03:31:28 user nova-compute[75391]: FIRMWARE:
Nov 15 03:31:28 user nova-compute[75391]: No targets found.
Nov 15 03:31:28 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 03:31:28 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 03:31:28 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de9eccc-a807-44a9-88ec-6f48761f38df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf1189e-b1f6-4c52-a647-316f6d1be091]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 (non-flash)
Nov 15 03:31:28 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 (non-flash)
Nov 15 03:31:28 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f623c143d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535'): ({'sdb'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Removing single pathed devices sdb {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5931476-9ebc-4f35-af78-02357c3544c5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0deae2b1-0c65-46f6-a566-dcfeebe9dedf]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Flushing IO for device /dev/sdb {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7478ba-da13-4a3a-9d38-d2a06be64c4f]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba35ddc9-04e8-4d02-9d21-de3db3d7ca5c]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_92cb5e78', '/dev/disk/by-id/scsi-1SCST_BIO92cb5e78-de6ce92ffbe04d96', '/dev/disk/by-id/scsi-26465366365393266') {{(pid=85237) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 03:31:28 user nova-compute[75391]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO92cb5e78-de6ce92ffbe04d96
Nov 15 03:31:28 user nova-compute[75391]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26465366365393266
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[811f6c21-64ab-4080-b2cb-8361bc69eeb7]: (4, None) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1337dc9-a306-4801-a471-d9c654af7033]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e0fc02-36f7-4a6f-9113-b735dafd3cdc]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535, portal: 172.16.0.220,3260]
Nov 15 03:31:28 user nova-compute[75391]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535, portal: 172.16.0.220,3260] successful.
Nov 15 03:31:28 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b6085f-c818-41c3-bd6e-6cbf5f1da535 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddeff899-219f-49bb-a782-c849199131b8]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] <== disconnect_volume: return (301ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 03:31:28 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Deleting instance files /opt/stack/data/nova/instances/304d8217-fa89-4a52-b50b-fa8c27759210_del
Nov 15 03:31:28 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Deletion of /opt/stack/data/nova/instances/304d8217-fa89-4a52-b50b-fa8c27759210_del complete
Nov 15 03:31:28 user nova-compute[75391]: INFO nova.compute.manager [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 15 03:31:28 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 03:31:28 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 03:31:29 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:31:29 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Took 0.45 seconds to deallocate network for instance.
Nov 15 03:31:29 user nova-compute[75391]: DEBUG nova.compute.manager [req-4c073e04-ecc9-4df1-bf4d-231d8cd359af req-23ded77a-6d1b-48d9-ad6f-daa1ee2b6f7b service nova] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Received event network-vif-deleted-f7261234-1d4a-4df7-a6d0-d64c460e1ccf {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:31:29 user nova-compute[75391]: INFO nova.compute.manager [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Took 0.73 seconds to detach 1 volumes for instance.
Nov 15 03:31:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:31:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:31:30 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:31:30 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:31:30 user nova-compute[75391]: DEBUG nova.compute.manager [req-d18325ad-1a98-4571-b861-065ea3baa708 req-d28d83f6-c6ad-4e2e-a875-477f85e968cf service nova] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Received event network-vif-plugged-f7261234-1d4a-4df7-a6d0-d64c460e1ccf {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:31:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d18325ad-1a98-4571-b861-065ea3baa708 req-d28d83f6-c6ad-4e2e-a875-477f85e968cf service nova] Acquiring lock "304d8217-fa89-4a52-b50b-fa8c27759210-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:31:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d18325ad-1a98-4571-b861-065ea3baa708 req-d28d83f6-c6ad-4e2e-a875-477f85e968cf service nova] Lock "304d8217-fa89-4a52-b50b-fa8c27759210-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:31:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-d18325ad-1a98-4571-b861-065ea3baa708 req-d28d83f6-c6ad-4e2e-a875-477f85e968cf service nova] Lock "304d8217-fa89-4a52-b50b-fa8c27759210-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:31:30 user nova-compute[75391]: DEBUG nova.compute.manager [req-d18325ad-1a98-4571-b861-065ea3baa708 req-d28d83f6-c6ad-4e2e-a875-477f85e968cf service nova] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] No waiting events found dispatching network-vif-plugged-f7261234-1d4a-4df7-a6d0-d64c460e1ccf {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:31:30 user nova-compute[75391]: WARNING nova.compute.manager [req-d18325ad-1a98-4571-b861-065ea3baa708 req-d28d83f6-c6ad-4e2e-a875-477f85e968cf service nova] [instance: 304d8217-fa89-4a52-b50b-fa8c27759210] Received unexpected event network-vif-plugged-f7261234-1d4a-4df7-a6d0-d64c460e1ccf for instance with vm_state deleted and task_state None.
Nov 15 03:31:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:31:30 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Deleted allocations for instance 304d8217-fa89-4a52-b50b-fa8c27759210
Nov 15 03:31:30 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-2227c678-bbfc-42f7-8ccd-b6872dc15feb tempest-TestVolumeBootPattern-1108994886 tempest-TestVolumeBootPattern-1108994886-project-member] Lock "304d8217-fa89-4a52-b50b-fa8c27759210" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.631s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:31:30 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:31:31 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:31:31 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:31:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:31:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:31:31 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:31:31 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:31:32 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:31:32 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:31:32 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=9123MB free_disk=24.987503051757812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:31:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:31:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:31:32 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:31:32 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:31:32 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:31:32 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:31:32 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:31:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:31:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:31:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:31:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:31:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:31:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:31:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:31:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:31:39 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:31:39 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:31:42 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:31:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:31:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:31:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:31:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:31:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:31:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:31:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:31:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:31:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:32:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:32:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:32:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:32:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:32:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:32:19 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:32:21 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:32:21 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:32:21 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 03:32:21 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Didn't find any instances for network info cache update. {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 03:32:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:32:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:32:23 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:32:23 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:32:26 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:32:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:32:30 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:32:32 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:32:32 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:32:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:32:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:32:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:32:32 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:32:33 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:32:33 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:32:33 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=9140MB free_disk=24.986175537109375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:32:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:32:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:32:33 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:32:33 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:32:33 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:32:33 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:32:33 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:32:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:32:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:32:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:32:39 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:32:39 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:32:39 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:32:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:32:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:32:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:32:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:32:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:32:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:32:44 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:32:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:32:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:32:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:33:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:33:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:33:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:33:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:33:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:33:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:20 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:33:21 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:33:21 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:33:21 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 03:33:21 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Didn't find any instances for network info cache update. {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 03:33:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:23 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:33:25 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:33:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:33:31 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:31 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:33:31 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 03:33:32 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:33:32 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:33:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:33:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:33:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:33:32 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:33:33 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:33:33 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:33:33 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8854MB free_disk=24.982784271240234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:33:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:33:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:33:33 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:33:33 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:33:33 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Refreshing inventories for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 03:33:33 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Updating ProviderTree inventory for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 03:33:33 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Updating inventory in ProviderTree for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 03:33:33 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Refreshing aggregate associations for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e, aggregates: None {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 03:33:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:33 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Refreshing trait associations for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 03:33:33 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:33:33 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:33:33 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:33:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.429s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:33:34 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:33:35 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:40 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:33:40 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:33:42 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:44 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:33:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:45 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:33:45 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Cleaning up deleted instances {{(pid=75391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 03:33:45 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] There are 0 instances to clean {{(pid=75391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 03:33:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "5afb8419-6e05-44e1-9b78-d55134d3495d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:33:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:33:50 user nova-compute[75391]: DEBUG nova.compute.manager [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Starting instance... {{(pid=75391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 03:33:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:33:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:33:50 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 03:33:50 user nova-compute[75391]: INFO nova.compute.claims [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Claim successful on node user
Nov 15 03:33:50 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:33:50 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:33:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:33:50 user nova-compute[75391]: DEBUG nova.compute.manager [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Start building networks asynchronously for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 03:33:50 user nova-compute[75391]: DEBUG nova.compute.manager [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Allocating IP information in the background. {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 03:33:50 user nova-compute[75391]: DEBUG nova.network.neutron [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] allocate_for_instance() {{(pid=75391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 03:33:50 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 03:33:50 user nova-compute[75391]: DEBUG nova.compute.manager [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Start building block device mappings for instance. {{(pid=75391) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 03:33:51 user nova-compute[75391]: DEBUG nova.policy [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddac74f27abf4da3801187adec2d3fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d565bc9eb1410284c91f0cc78385d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75391) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 03:33:51 user nova-compute[75391]: DEBUG nova.compute.manager [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Start spawning the instance on the hypervisor. {{(pid=75391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 03:33:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Creating instance directory {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 03:33:51 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Creating image(s)
Nov 15 03:33:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "/opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:33:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "/opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:33:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "/opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:33:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:33:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.177s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:33:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:33:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:33:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:33:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.193s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:33:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk 1073741824 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:33:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a,backing_fmt=raw /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk 1073741824" returned: 0 in 0.059s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:33:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "6ed2fe621f8f11a6cdcf5ac879df64cad95c324a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:33:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:33:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ed2fe621f8f11a6cdcf5ac879df64cad95c324a --force-share --output=json" returned: 0 in 0.182s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:33:51 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk. size=1073741824 {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 03:33:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:33:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:33:51 user nova-compute[75391]: DEBUG nova.virt.disk.api [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Cannot resize image /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk to a smaller size. {{(pid=75391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 03:33:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Created local disks {{(pid=75391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 03:33:51 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Ensure instance console log exists: /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/console.log {{(pid=75391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 03:33:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:33:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:33:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:33:52 user nova-compute[75391]: DEBUG nova.network.neutron [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Successfully created port: bd126cbc-824c-485d-a172-126b763e27fc {{(pid=75391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 03:33:52 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:33:52 user nova-compute[75391]: DEBUG nova.network.neutron [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Successfully updated port: bd126cbc-824c-485d-a172-126b763e27fc {{(pid=75391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 03:33:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "refresh_cache-5afb8419-6e05-44e1-9b78-d55134d3495d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:33:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquired lock "refresh_cache-5afb8419-6e05-44e1-9b78-d55134d3495d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:33:52 user nova-compute[75391]: DEBUG nova.network.neutron [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Building network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 03:33:52 user nova-compute[75391]: DEBUG nova.network.neutron [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Instance cache missing network info. {{(pid=75391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 03:33:52 user nova-compute[75391]: DEBUG nova.compute.manager [req-e37cc917-5d66-4540-831c-dc5e60767b5f req-ad175b3e-3e6a-406c-95c8-c86ce38a8ae1 service nova] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Received event network-changed-bd126cbc-824c-485d-a172-126b763e27fc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:33:52 user nova-compute[75391]: DEBUG nova.compute.manager [req-e37cc917-5d66-4540-831c-dc5e60767b5f req-ad175b3e-3e6a-406c-95c8-c86ce38a8ae1 service nova] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Refreshing instance network info cache due to event network-changed-bd126cbc-824c-485d-a172-126b763e27fc. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:33:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e37cc917-5d66-4540-831c-dc5e60767b5f req-ad175b3e-3e6a-406c-95c8-c86ce38a8ae1 service nova] Acquiring lock "refresh_cache-5afb8419-6e05-44e1-9b78-d55134d3495d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.network.neutron [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Updating instance_info_cache with network_info: [{"id": "bd126cbc-824c-485d-a172-126b763e27fc", "address": "fa:16:3e:62:8a:11", "network": {"id": "943aff4f-4c65-4489-b8ce-bb8c1dd61e9d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-959600161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d565bc9eb1410284c91f0cc78385d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd126cbc-82", "ovs_interfaceid": "bd126cbc-824c-485d-a172-126b763e27fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Releasing lock "refresh_cache-5afb8419-6e05-44e1-9b78-d55134d3495d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.compute.manager [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Instance network_info: |[{"id": "bd126cbc-824c-485d-a172-126b763e27fc", "address": "fa:16:3e:62:8a:11", "network": {"id": "943aff4f-4c65-4489-b8ce-bb8c1dd61e9d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-959600161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d565bc9eb1410284c91f0cc78385d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd126cbc-82", "ovs_interfaceid": "bd126cbc-824c-485d-a172-126b763e27fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e37cc917-5d66-4540-831c-dc5e60767b5f req-ad175b3e-3e6a-406c-95c8-c86ce38a8ae1 service nova] Acquired lock "refresh_cache-5afb8419-6e05-44e1-9b78-d55134d3495d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.network.neutron [req-e37cc917-5d66-4540-831c-dc5e60767b5f req-ad175b3e-3e6a-406c-95c8-c86ce38a8ae1 service nova] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Refreshing network info cache for port bd126cbc-824c-485d-a172-126b763e27fc {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Start _get_guest_xml network_info=[{"id": "bd126cbc-824c-485d-a172-126b763e27fc", "address": "fa:16:3e:62:8a:11", "network": {"id": "943aff4f-4c65-4489-b8ce-bb8c1dd61e9d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-959600161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d565bc9eb1410284c91f0cc78385d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd126cbc-82", "ovs_interfaceid": "bd126cbc-824c-485d-a172-126b763e27fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'f31cb507-389e-424c-b4dc-02c610b0b558'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 03:33:53 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:33:53 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] CPU controller missing on host. {{(pid=75391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.host [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] CPU controller found on host. {{(pid=75391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T02:37:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T02:38:06Z,direct_url=<?>,disk_format='qcow2',id=f31cb507-389e-424c-b4dc-02c610b0b558,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94d41b4ea2134098830087c7a9bd0c5b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T02:38:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Flavor limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Image limits 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Flavor pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Image pref 0:0:0 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Got 1 possible topologies {{(pid=75391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.virt.hardware [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:33:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-191839143',display_name='tempest-SnapshotDataIntegrityTests-server-191839143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-191839143',id=53,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIqwz4vOKv5g5LujiGjQOa+0ttuQ+9WXnU+qbnHd/+QHdUMHjEOVvv1h6TJRGVDJoVLfr/aKS7qyS+avGSwq0T4yiJMFpQHh+ItpwXhdgElb2Celk284MFex7jbk5NjVg==',key_name='tempest-keypair-1245200549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2d565bc9eb1410284c91f0cc78385d7',ramdisk_id='',reservation_id='r-2q0nqbwy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-640033110',owner_user_name='tempest-SnapshotDataIntegrityTests-640033110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:33:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddac74f27abf4da3801187adec2d3fd8',uuid=5afb8419-6e05-44e1-9b78-d55134d3495d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd126cbc-824c-485d-a172-126b763e27fc", "address": "fa:16:3e:62:8a:11", "network": {"id": "943aff4f-4c65-4489-b8ce-bb8c1dd61e9d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-959600161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d565bc9eb1410284c91f0cc78385d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd126cbc-82", "ovs_interfaceid": "bd126cbc-824c-485d-a172-126b763e27fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Converting VIF {"id": "bd126cbc-824c-485d-a172-126b763e27fc", "address": "fa:16:3e:62:8a:11", "network": {"id": "943aff4f-4c65-4489-b8ce-bb8c1dd61e9d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-959600161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d565bc9eb1410284c91f0cc78385d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd126cbc-82", "ovs_interfaceid": "bd126cbc-824c-485d-a172-126b763e27fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:8a:11,bridge_name='br-int',has_traffic_filtering=True,id=bd126cbc-824c-485d-a172-126b763e27fc,network=Network(943aff4f-4c65-4489-b8ce-bb8c1dd61e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd126cbc-82') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.objects.instance [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lazy-loading 'pci_devices' on Instance uuid 5afb8419-6e05-44e1-9b78-d55134d3495d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 03:33:53 user nova-compute[75391]:   <uuid>5afb8419-6e05-44e1-9b78-d55134d3495d</uuid>
Nov 15 03:33:53 user nova-compute[75391]:   <name>instance-00000035</name>
Nov 15 03:33:53 user nova-compute[75391]:   <memory>524288</memory>
Nov 15 03:33:53 user nova-compute[75391]:   <vcpu>1</vcpu>
Nov 15 03:33:53 user nova-compute[75391]:   <metadata>
Nov 15 03:33:53 user nova-compute[75391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 03:33:53 user nova-compute[75391]:       <nova:package version="0.0.0"/>
Nov 15 03:33:53 user nova-compute[75391]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-191839143</nova:name>
Nov 15 03:33:53 user nova-compute[75391]:       <nova:creationTime>2023-11-15 03:33:53</nova:creationTime>
Nov 15 03:33:53 user nova-compute[75391]:       <nova:flavor name="m1.tiny">
Nov 15 03:33:53 user nova-compute[75391]:         <nova:memory>512</nova:memory>
Nov 15 03:33:53 user nova-compute[75391]:         <nova:disk>1</nova:disk>
Nov 15 03:33:53 user nova-compute[75391]:         <nova:swap>0</nova:swap>
Nov 15 03:33:53 user nova-compute[75391]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 03:33:53 user nova-compute[75391]:         <nova:vcpus>1</nova:vcpus>
Nov 15 03:33:53 user nova-compute[75391]:       </nova:flavor>
Nov 15 03:33:53 user nova-compute[75391]:       <nova:owner>
Nov 15 03:33:53 user nova-compute[75391]:         <nova:user uuid="ddac74f27abf4da3801187adec2d3fd8">tempest-SnapshotDataIntegrityTests-640033110-project-member</nova:user>
Nov 15 03:33:53 user nova-compute[75391]:         <nova:project uuid="e2d565bc9eb1410284c91f0cc78385d7">tempest-SnapshotDataIntegrityTests-640033110</nova:project>
Nov 15 03:33:53 user nova-compute[75391]:       </nova:owner>
Nov 15 03:33:53 user nova-compute[75391]:       <nova:root type="image" uuid="f31cb507-389e-424c-b4dc-02c610b0b558"/>
Nov 15 03:33:53 user nova-compute[75391]:       <nova:ports>
Nov 15 03:33:53 user nova-compute[75391]:         <nova:port uuid="bd126cbc-824c-485d-a172-126b763e27fc">
Nov 15 03:33:53 user nova-compute[75391]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 03:33:53 user nova-compute[75391]:         </nova:port>
Nov 15 03:33:53 user nova-compute[75391]:       </nova:ports>
Nov 15 03:33:53 user nova-compute[75391]:     </nova:instance>
Nov 15 03:33:53 user nova-compute[75391]:   </metadata>
Nov 15 03:33:53 user nova-compute[75391]:   <sysinfo type="smbios">
Nov 15 03:33:53 user nova-compute[75391]:     <system>
Nov 15 03:33:53 user nova-compute[75391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 03:33:53 user nova-compute[75391]:       <entry name="product">OpenStack Nova</entry>
Nov 15 03:33:53 user nova-compute[75391]:       <entry name="version">0.0.0</entry>
Nov 15 03:33:53 user nova-compute[75391]:       <entry name="serial">5afb8419-6e05-44e1-9b78-d55134d3495d</entry>
Nov 15 03:33:53 user nova-compute[75391]:       <entry name="uuid">5afb8419-6e05-44e1-9b78-d55134d3495d</entry>
Nov 15 03:33:53 user nova-compute[75391]:       <entry name="family">Virtual Machine</entry>
Nov 15 03:33:53 user nova-compute[75391]:     </system>
Nov 15 03:33:53 user nova-compute[75391]:   </sysinfo>
Nov 15 03:33:53 user nova-compute[75391]:   <os>
Nov 15 03:33:53 user nova-compute[75391]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 03:33:53 user nova-compute[75391]:     <boot dev="hd"/>
Nov 15 03:33:53 user nova-compute[75391]:     <smbios mode="sysinfo"/>
Nov 15 03:33:53 user nova-compute[75391]:   </os>
Nov 15 03:33:53 user nova-compute[75391]:   <features>
Nov 15 03:33:53 user nova-compute[75391]:     <acpi/>
Nov 15 03:33:53 user nova-compute[75391]:     <apic/>
Nov 15 03:33:53 user nova-compute[75391]:     <vmcoreinfo/>
Nov 15 03:33:53 user nova-compute[75391]:   </features>
Nov 15 03:33:53 user nova-compute[75391]:   <clock offset="utc">
Nov 15 03:33:53 user nova-compute[75391]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 03:33:53 user nova-compute[75391]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 03:33:53 user nova-compute[75391]:     <timer name="hpet" present="no"/>
Nov 15 03:33:53 user nova-compute[75391]:   </clock>
Nov 15 03:33:53 user nova-compute[75391]:   <cpu mode="custom" match="exact">
Nov 15 03:33:53 user nova-compute[75391]:     <model>Nehalem</model>
Nov 15 03:33:53 user nova-compute[75391]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 03:33:53 user nova-compute[75391]:   </cpu>
Nov 15 03:33:53 user nova-compute[75391]:   <devices>
Nov 15 03:33:53 user nova-compute[75391]:     <disk type="file" device="disk">
Nov 15 03:33:53 user nova-compute[75391]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 03:33:53 user nova-compute[75391]:       <source file="/opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk"/>
Nov 15 03:33:53 user nova-compute[75391]:       <target dev="vda" bus="virtio"/>
Nov 15 03:33:53 user nova-compute[75391]:     </disk>
Nov 15 03:33:53 user nova-compute[75391]:     <interface type="ethernet">
Nov 15 03:33:53 user nova-compute[75391]:       <mac address="fa:16:3e:62:8a:11"/>
Nov 15 03:33:53 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:33:53 user nova-compute[75391]:       <mtu size="1442"/>
Nov 15 03:33:53 user nova-compute[75391]:       <target dev="tapbd126cbc-82"/>
Nov 15 03:33:53 user nova-compute[75391]:     </interface>
Nov 15 03:33:53 user nova-compute[75391]:     <serial type="pty">
Nov 15 03:33:53 user nova-compute[75391]:       <log file="/opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/console.log" append="off"/>
Nov 15 03:33:53 user nova-compute[75391]:     </serial>
Nov 15 03:33:53 user nova-compute[75391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 03:33:53 user nova-compute[75391]:     <video>
Nov 15 03:33:53 user nova-compute[75391]:       <model type="virtio"/>
Nov 15 03:33:53 user nova-compute[75391]:     </video>
Nov 15 03:33:53 user nova-compute[75391]:     <rng model="virtio">
Nov 15 03:33:53 user nova-compute[75391]:       <backend model="random">/dev/urandom</backend>
Nov 15 03:33:53 user nova-compute[75391]:     </rng>
Nov 15 03:33:53 user nova-compute[75391]:     <controller type="usb" index="0" model="none"/>
Nov 15 03:33:53 user nova-compute[75391]:     <memballoon model="virtio">
Nov 15 03:33:53 user nova-compute[75391]:       <stats period="10"/>
Nov 15 03:33:53 user nova-compute[75391]:     </memballoon>
Nov 15 03:33:53 user nova-compute[75391]:   </devices>
Nov 15 03:33:53 user nova-compute[75391]: </domain>
Nov 15 03:33:53 user nova-compute[75391]:  {{(pid=75391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:33:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-191839143',display_name='tempest-SnapshotDataIntegrityTests-server-191839143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-191839143',id=53,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIqwz4vOKv5g5LujiGjQOa+0ttuQ+9WXnU+qbnHd/+QHdUMHjEOVvv1h6TJRGVDJoVLfr/aKS7qyS+avGSwq0T4yiJMFpQHh+ItpwXhdgElb2Celk284MFex7jbk5NjVg==',key_name='tempest-keypair-1245200549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2d565bc9eb1410284c91f0cc78385d7',ramdisk_id='',reservation_id='r-2q0nqbwy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-640033110',owner_user_name='tempest-SnapshotDataIntegrityTests-640033110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T03:33:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddac74f27abf4da3801187adec2d3fd8',uuid=5afb8419-6e05-44e1-9b78-d55134d3495d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd126cbc-824c-485d-a172-126b763e27fc", "address": "fa:16:3e:62:8a:11", "network": {"id": "943aff4f-4c65-4489-b8ce-bb8c1dd61e9d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-959600161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d565bc9eb1410284c91f0cc78385d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd126cbc-82", "ovs_interfaceid": "bd126cbc-824c-485d-a172-126b763e27fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Converting VIF {"id": "bd126cbc-824c-485d-a172-126b763e27fc", "address": "fa:16:3e:62:8a:11", "network": {"id": "943aff4f-4c65-4489-b8ce-bb8c1dd61e9d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-959600161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d565bc9eb1410284c91f0cc78385d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd126cbc-82", "ovs_interfaceid": "bd126cbc-824c-485d-a172-126b763e27fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:8a:11,bridge_name='br-int',has_traffic_filtering=True,id=bd126cbc-824c-485d-a172-126b763e27fc,network=Network(943aff4f-4c65-4489-b8ce-bb8c1dd61e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd126cbc-82') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG os_vif [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:8a:11,bridge_name='br-int',has_traffic_filtering=True,id=bd126cbc-824c-485d-a172-126b763e27fc,network=Network(943aff4f-4c65-4489-b8ce-bb8c1dd61e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd126cbc-82') {{(pid=75391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22269094-b686-5eae-9681-ed7693105a40', '_type': 'linux-noop'}}, row=False) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd126cbc-82, may_exist=True, interface_attrs={}) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd126cbc-82, col_values=(('qos', UUID('0cddfa9f-a0df-449f-9581-40201a8fc2ec')),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd126cbc-82, col_values=(('external_ids', {'iface-id': 'bd126cbc-824c-485d-a172-126b763e27fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:8a:11', 'vm-uuid': '5afb8419-6e05-44e1-9b78-d55134d3495d'}),), if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:53 user nova-compute[75391]: INFO os_vif [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:8a:11,bridge_name='br-int',has_traffic_filtering=True,id=bd126cbc-824c-485d-a172-126b763e27fc,network=Network(943aff4f-4c65-4489-b8ce-bb8c1dd61e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd126cbc-82')
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] No VIF found with MAC fa:16:3e:62:8a:11, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.network.neutron [req-e37cc917-5d66-4540-831c-dc5e60767b5f req-ad175b3e-3e6a-406c-95c8-c86ce38a8ae1 service nova] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Updated VIF entry in instance network info cache for port bd126cbc-824c-485d-a172-126b763e27fc. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG nova.network.neutron [req-e37cc917-5d66-4540-831c-dc5e60767b5f req-ad175b3e-3e6a-406c-95c8-c86ce38a8ae1 service nova] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Updating instance_info_cache with network_info: [{"id": "bd126cbc-824c-485d-a172-126b763e27fc", "address": "fa:16:3e:62:8a:11", "network": {"id": "943aff4f-4c65-4489-b8ce-bb8c1dd61e9d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-959600161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d565bc9eb1410284c91f0cc78385d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd126cbc-82", "ovs_interfaceid": "bd126cbc-824c-485d-a172-126b763e27fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:33:53 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-e37cc917-5d66-4540-831c-dc5e60767b5f req-ad175b3e-3e6a-406c-95c8-c86ce38a8ae1 service nova] Releasing lock "refresh_cache-5afb8419-6e05-44e1-9b78-d55134d3495d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:33:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:54 user nova-compute[75391]: DEBUG nova.compute.manager [req-aa310e83-97a8-4b00-81a8-ee1c3c45321d req-ca72b4b6-9a7d-42ae-a97f-5056cd1c0d1b service nova] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Received event network-vif-plugged-bd126cbc-824c-485d-a172-126b763e27fc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:33:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-aa310e83-97a8-4b00-81a8-ee1c3c45321d req-ca72b4b6-9a7d-42ae-a97f-5056cd1c0d1b service nova] Acquiring lock "5afb8419-6e05-44e1-9b78-d55134d3495d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:33:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-aa310e83-97a8-4b00-81a8-ee1c3c45321d req-ca72b4b6-9a7d-42ae-a97f-5056cd1c0d1b service nova] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:33:54 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-aa310e83-97a8-4b00-81a8-ee1c3c45321d req-ca72b4b6-9a7d-42ae-a97f-5056cd1c0d1b service nova] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:33:54 user nova-compute[75391]: DEBUG nova.compute.manager [req-aa310e83-97a8-4b00-81a8-ee1c3c45321d req-ca72b4b6-9a7d-42ae-a97f-5056cd1c0d1b service nova] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] No waiting events found dispatching network-vif-plugged-bd126cbc-824c-485d-a172-126b763e27fc {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:33:54 user nova-compute[75391]: WARNING nova.compute.manager [req-aa310e83-97a8-4b00-81a8-ee1c3c45321d req-ca72b4b6-9a7d-42ae-a97f-5056cd1c0d1b service nova] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Received unexpected event network-vif-plugged-bd126cbc-824c-485d-a172-126b763e27fc for instance with vm_state building and task_state spawning.
Nov 15 03:33:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:55 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:56 user nova-compute[75391]: DEBUG nova.compute.manager [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Instance event wait completed in 0 seconds for  {{(pid=75391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 03:33:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Guest created on hypervisor {{(pid=75391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 03:33:56 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Instance spawned successfully.
Nov 15 03:33:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 03:33:56 user nova-compute[75391]: DEBUG nova.compute.manager [req-a49c8d34-39d8-4db1-a705-b79977beb223 req-087c981f-351e-45f8-ac46-cf5350c6aaed service nova] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Received event network-vif-plugged-bd126cbc-824c-485d-a172-126b763e27fc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:33:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a49c8d34-39d8-4db1-a705-b79977beb223 req-087c981f-351e-45f8-ac46-cf5350c6aaed service nova] Acquiring lock "5afb8419-6e05-44e1-9b78-d55134d3495d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:33:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a49c8d34-39d8-4db1-a705-b79977beb223 req-087c981f-351e-45f8-ac46-cf5350c6aaed service nova] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:33:56 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-a49c8d34-39d8-4db1-a705-b79977beb223 req-087c981f-351e-45f8-ac46-cf5350c6aaed service nova] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:33:56 user nova-compute[75391]: DEBUG nova.compute.manager [req-a49c8d34-39d8-4db1-a705-b79977beb223 req-087c981f-351e-45f8-ac46-cf5350c6aaed service nova] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] No waiting events found dispatching network-vif-plugged-bd126cbc-824c-485d-a172-126b763e27fc {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:33:56 user nova-compute[75391]: WARNING nova.compute.manager [req-a49c8d34-39d8-4db1-a705-b79977beb223 req-087c981f-351e-45f8-ac46-cf5350c6aaed service nova] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Received unexpected event network-vif-plugged-bd126cbc-824c-485d-a172-126b763e27fc for instance with vm_state building and task_state spawning.
Nov 15 03:33:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Found default for hw_cdrom_bus of ide {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:33:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Found default for hw_disk_bus of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:33:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Found default for hw_input_bus of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:33:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Found default for hw_pointer_model of None {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:33:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Found default for hw_video_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:33:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Found default for hw_vif_model of virtio {{(pid=75391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 03:33:57 user nova-compute[75391]: INFO nova.compute.manager [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Took 5.87 seconds to spawn the instance on the hypervisor.
Nov 15 03:33:57 user nova-compute[75391]: DEBUG nova.compute.manager [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Checking state {{(pid=75391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 03:33:57 user nova-compute[75391]: INFO nova.compute.manager [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Took 6.71 seconds to build instance.
Nov 15 03:33:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-02a41f33-a65b-41a6-8541-8e8f3432a3b5 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.836s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:33:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:33:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:34:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:34:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:34:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:34:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:34:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:34:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:34:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:34:21 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:34:21 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:34:21 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 03:34:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-5afb8419-6e05-44e1-9b78-d55134d3495d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:34:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-5afb8419-6e05-44e1-9b78-d55134d3495d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:34:21 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:34:21 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lazy-loading 'info_cache' on Instance uuid 5afb8419-6e05-44e1-9b78-d55134d3495d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:34:22 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Updating instance_info_cache with network_info: [{"id": "bd126cbc-824c-485d-a172-126b763e27fc", "address": "fa:16:3e:62:8a:11", "network": {"id": "943aff4f-4c65-4489-b8ce-bb8c1dd61e9d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-959600161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d565bc9eb1410284c91f0cc78385d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd126cbc-82", "ovs_interfaceid": "bd126cbc-824c-485d-a172-126b763e27fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:34:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-5afb8419-6e05-44e1-9b78-d55134d3495d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:34:22 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:34:22 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:34:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:34:23 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:34:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:34:25 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:34:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:34:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:34:32 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:34:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:34:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:34:32 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:34:32 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:34:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:34:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:34:32 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:34:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:34:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:34:33 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:34:33 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:34:33 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8976MB free_disk=24.94054412841797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:34:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:34:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:34:33 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 5afb8419-6e05-44e1-9b78-d55134d3495d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:34:33 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:34:33 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:34:33 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:34:33 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:34:33 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:34:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:34:34 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:34:35 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:34:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:34:42 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:34:42 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:34:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:34:44 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:34:45 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:34:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:34:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:34:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:35:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:35:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:35:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:35:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:35:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:35:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:35:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:35:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:35:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:35:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:35:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:35:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:35:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:35:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:35:21 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:35:21 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:35:21 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 03:35:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-5afb8419-6e05-44e1-9b78-d55134d3495d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:35:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-5afb8419-6e05-44e1-9b78-d55134d3495d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:35:21 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:35:21 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lazy-loading 'info_cache' on Instance uuid 5afb8419-6e05-44e1-9b78-d55134d3495d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:35:22 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Updating instance_info_cache with network_info: [{"id": "bd126cbc-824c-485d-a172-126b763e27fc", "address": "fa:16:3e:62:8a:11", "network": {"id": "943aff4f-4c65-4489-b8ce-bb8c1dd61e9d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-959600161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d565bc9eb1410284c91f0cc78385d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd126cbc-82", "ovs_interfaceid": "bd126cbc-824c-485d-a172-126b763e27fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:35:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-5afb8419-6e05-44e1-9b78-d55134d3495d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:35:22 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:35:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:35:23 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:35:24 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:35:25 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:35:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:35:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:35:33 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:35:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:35:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:35:33 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:35:33 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:35:33 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:35:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:35:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:35:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:35:34 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:35:34 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:35:34 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=9010MB free_disk=24.93999481201172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:35:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:35:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:35:34 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 5afb8419-6e05-44e1-9b78-d55134d3495d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:35:34 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:35:34 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:35:34 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:35:34 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:35:34 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:35:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:35:35 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:35:36 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:35:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:35:41 user nova-compute[75391]: DEBUG nova.compute.manager [req-ed8d4b57-acbe-4d22-8054-5bbb15438b6a req-6c805456-9ed3-49d3-9acf-8239b64cc975 service nova] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Received event network-changed-bd126cbc-824c-485d-a172-126b763e27fc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:35:41 user nova-compute[75391]: DEBUG nova.compute.manager [req-ed8d4b57-acbe-4d22-8054-5bbb15438b6a req-6c805456-9ed3-49d3-9acf-8239b64cc975 service nova] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Refreshing instance network info cache due to event network-changed-bd126cbc-824c-485d-a172-126b763e27fc. {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 03:35:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ed8d4b57-acbe-4d22-8054-5bbb15438b6a req-6c805456-9ed3-49d3-9acf-8239b64cc975 service nova] Acquiring lock "refresh_cache-5afb8419-6e05-44e1-9b78-d55134d3495d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:35:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ed8d4b57-acbe-4d22-8054-5bbb15438b6a req-6c805456-9ed3-49d3-9acf-8239b64cc975 service nova] Acquired lock "refresh_cache-5afb8419-6e05-44e1-9b78-d55134d3495d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:35:41 user nova-compute[75391]: DEBUG nova.network.neutron [req-ed8d4b57-acbe-4d22-8054-5bbb15438b6a req-6c805456-9ed3-49d3-9acf-8239b64cc975 service nova] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Refreshing network info cache for port bd126cbc-824c-485d-a172-126b763e27fc {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 03:35:41 user nova-compute[75391]: DEBUG nova.network.neutron [req-ed8d4b57-acbe-4d22-8054-5bbb15438b6a req-6c805456-9ed3-49d3-9acf-8239b64cc975 service nova] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Updated VIF entry in instance network info cache for port bd126cbc-824c-485d-a172-126b763e27fc. {{(pid=75391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 03:35:41 user nova-compute[75391]: DEBUG nova.network.neutron [req-ed8d4b57-acbe-4d22-8054-5bbb15438b6a req-6c805456-9ed3-49d3-9acf-8239b64cc975 service nova] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Updating instance_info_cache with network_info: [{"id": "bd126cbc-824c-485d-a172-126b763e27fc", "address": "fa:16:3e:62:8a:11", "network": {"id": "943aff4f-4c65-4489-b8ce-bb8c1dd61e9d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-959600161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d565bc9eb1410284c91f0cc78385d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd126cbc-82", "ovs_interfaceid": "bd126cbc-824c-485d-a172-126b763e27fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:35:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-ed8d4b57-acbe-4d22-8054-5bbb15438b6a req-6c805456-9ed3-49d3-9acf-8239b64cc975 service nova] Releasing lock "refresh_cache-5afb8419-6e05-44e1-9b78-d55134d3495d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:35:42 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:35:42 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:35:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:35:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "5afb8419-6e05-44e1-9b78-d55134d3495d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:35:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:35:43 user nova-compute[75391]: DEBUG nova.objects.instance [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lazy-loading 'flavor' on Instance uuid 5afb8419-6e05-44e1-9b78-d55134d3495d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:35:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:35:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "5afb8419-6e05-44e1-9b78-d55134d3495d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:35:43 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:35:43 user nova-compute[75391]: INFO nova.compute.manager [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Attaching volume e0dbd9c1-53a4-42b9-9dd2-4015d123255f to /dev/vdb
Nov 15 03:35:43 user nova-compute[75391]: DEBUG os_brick.utils [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:35:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:35:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:35:43 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2794c56-334b-49c5-abc5-28744405bfea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:35:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:35:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:35:43 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c354b60a-bd78-43fa-aef4-73e5a450a2fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:35:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:35:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:35:43 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a0554e-0a8b-4f6a-a2b5-7a096daa20a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:35:43 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d29eae-ef4e-400e-a000-87df31b0a450]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:35:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:35:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:35:43 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 03:35:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:35:43 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:35:43 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 03:35:43 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf54f518-0a6f-4f9c-8e7b-ca3d081a4bd5]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:35:43 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 03:35:43 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 03:35:43 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 03:35:43 user nova-compute[75391]: DEBUG os_brick.utils [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:35:43 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Updating existing volume attachment record: 19a8d567-7360-4c02-b7d9-105894c4b3c3 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 03:35:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:35:46 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yOfsQWnY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:35:48 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:35:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:35:48 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:35:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:35:48 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[563a9b59-6f44-45cd-9a39-70d660af8fcc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 03:35:48 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe76f4f-8e46-4ecd-8676-e05be064d524]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f] added
Nov 15 03:35:48 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43bd4b1-f316-47a3-b012-da19d97b65ca]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[862d410a-f2c7-47a5-8d7a-dcf295e69987]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yOfsQWnY {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yOfsQWnY" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58b6962-c83d-4f19-b9c7-42d4bf826f3b]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yOfsQWnY'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[54825be4-ca5c-4e54-bacb-e67ecab192d4]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f54487a-b975-4154-b81c-e16254ddc091]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 03:35:48 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 03:35:48 user nova-compute[75391]:  {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:35:48 user nova-compute[75391]: WARNING os_brick.initiator.connectors.iscsi [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 03:35:48 user nova-compute[75391]: 
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90c4473-2878-4a85-a60d-99eb4a13dc1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f, portal: 172.16.0.220,3260]
Nov 15 03:35:48 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f, portal: 172.16.0.220,3260] successful.
Nov 15 03:35:48 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05bdfee-93b3-4d30-a4da-f8af0ae28997]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30cb2f4-a679-49bd-8ede-4aaf2db275f4]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f (non-flash)
Nov 15 03:35:48 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f (non-flash)
Nov 15 03:35:48 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[12318f99-e5ec-4658-b83b-0af9a76fceaf]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:35:48 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 03:35:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:35:49 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 03:35:49 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yOfsQWnY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 03:35:49 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:35:49 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '23238656130313731', 'path': '/dev/sdb'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:35:49 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238656130313731', 'path': '/dev/sdb'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 03:35:49 user nova-compute[75391]: DEBUG nova.objects.instance [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lazy-loading 'flavor' on Instance uuid 5afb8419-6e05-44e1-9b78-d55134d3495d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:35:49 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 03:35:49 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:35:49 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 03:35:49 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 03:35:49 user nova-compute[75391]:   <serial>e0dbd9c1-53a4-42b9-9dd2-4015d123255f</serial>
Nov 15 03:35:49 user nova-compute[75391]: </disk>
Nov 15 03:35:49 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 03:35:50 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:35:50 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:35:50 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] No VIF found with MAC fa:16:3e:62:8a:11, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 03:35:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-1a7371c7-6d37-4210-98a8-e06996cbd0a3 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.383s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:35:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:35:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:35:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:35:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "5afb8419-6e05-44e1-9b78-d55134d3495d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:35:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:35:58 user nova-compute[75391]: INFO nova.compute.manager [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Detaching volume e0dbd9c1-53a4-42b9-9dd2-4015d123255f
Nov 15 03:35:58 user nova-compute[75391]: INFO nova.virt.block_device [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Attempting to driver detach volume e0dbd9c1-53a4-42b9-9dd2-4015d123255f from mountpoint /dev/vdb
Nov 15 03:35:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Attempting to detach device vdb from instance 5afb8419-6e05-44e1-9b78-d55134d3495d from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 03:35:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 03:35:58 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:35:58 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 03:35:58 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 03:35:58 user nova-compute[75391]:   <serial>e0dbd9c1-53a4-42b9-9dd2-4015d123255f</serial>
Nov 15 03:35:58 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 03:35:58 user nova-compute[75391]: </disk>
Nov 15 03:35:58 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 03:35:58 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Successfully detached device vdb from instance 5afb8419-6e05-44e1-9b78-d55134d3495d from the persistent domain config.
Nov 15 03:35:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5afb8419-6e05-44e1-9b78-d55134d3495d from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 03:35:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 03:35:58 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:35:58 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 03:35:58 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 03:35:58 user nova-compute[75391]:   <serial>e0dbd9c1-53a4-42b9-9dd2-4015d123255f</serial>
Nov 15 03:35:58 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 03:35:58 user nova-compute[75391]: </disk>
Nov 15 03:35:58 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 03:35:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5afb8419-6e05-44e1-9b78-d55134d3495d {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 03:35:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:36:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:36:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:36:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:36:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:36:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:36:19 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5afb8419-6e05-44e1-9b78-d55134d3495d is timed out.
Nov 15 03:36:19 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Successfully detached device vdb from instance 5afb8419-6e05-44e1-9b78-d55134d3495d from the live domain config.
Nov 15 03:36:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yOfsQWnY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:36:19 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:36:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9d89dd-5e61-401f-b57c-a541d1267050]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 03:36:19 user nova-compute[75391]: No targets found.
Nov 15 03:36:19 user nova-compute[75391]: iSNS:
Nov 15 03:36:19 user nova-compute[75391]: No targets found.
Nov 15 03:36:19 user nova-compute[75391]: STATIC:
Nov 15 03:36:19 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f
Nov 15 03:36:19 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 03:36:19 user nova-compute[75391]:                 Iface Name: default
Nov 15 03:36:19 user nova-compute[75391]: FIRMWARE:
Nov 15 03:36:19 user nova-compute[75391]: No targets found.
Nov 15 03:36:19 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 03:36:19 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 03:36:19 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c2b534-f8d3-470c-893c-88c57c6624fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca93664-735c-4222-a232-7a23269c270a]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f (non-flash)
Nov 15 03:36:19 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f (non-flash)
Nov 15 03:36:19 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62447584c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f'): ({'sdb'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Removing single pathed devices sdb {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53009f1-5510-44c1-9f50-ad44e713d205]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f776f19-242d-4d32-9029-2db8269378cb]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Flushing IO for device /dev/sdb {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0207c4f8-b6b6-4013-8695-e4e1b570eaa9]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f795a72-d0ff-4395-8ac9-b2102e833eff]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ac6c8b-8a22-46bf-9ab0-0fbf6e70c148]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b77179a-c677-4fc9-88ff-f696f9ea4a19]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f, portal: 172.16.0.220,3260]
Nov 15 03:36:19 user nova-compute[75391]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f, portal: 172.16.0.220,3260] successful.
Nov 15 03:36:19 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dbd9c1-53a4-42b9-9dd2-4015d123255f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[709a220f-995c-4edc-9509-eee9d5303c7d]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] <== disconnect_volume: return (272ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:36:19 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 03:36:20 user nova-compute[75391]: DEBUG nova.objects.instance [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lazy-loading 'flavor' on Instance uuid 5afb8419-6e05-44e1-9b78-d55134d3495d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:36:20 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-6d7bef8a-3ffb-4411-b8bb-a69e5efc8104 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.659s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:36:21 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:36:21 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:36:21 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 03:36:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-5afb8419-6e05-44e1-9b78-d55134d3495d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:36:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-5afb8419-6e05-44e1-9b78-d55134d3495d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:36:21 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:36:21 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lazy-loading 'info_cache' on Instance uuid 5afb8419-6e05-44e1-9b78-d55134d3495d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:36:22 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Updating instance_info_cache with network_info: [{"id": "bd126cbc-824c-485d-a172-126b763e27fc", "address": "fa:16:3e:62:8a:11", "network": {"id": "943aff4f-4c65-4489-b8ce-bb8c1dd61e9d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-959600161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d565bc9eb1410284c91f0cc78385d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd126cbc-82", "ovs_interfaceid": "bd126cbc-824c-485d-a172-126b763e27fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:36:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-5afb8419-6e05-44e1-9b78-d55134d3495d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:36:22 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:36:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:36:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:36:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:36:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:36:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:36:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:36:23 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:36:24 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:36:27 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:36:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:36:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:36:34 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:36:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:36:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:36:34 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:36:34 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:36:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:36:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:36:34 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:36:35 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:36:35 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:36:35 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:36:35 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8993MB free_disk=24.938655853271484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:36:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:36:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:36:35 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 5afb8419-6e05-44e1-9b78-d55134d3495d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:36:35 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:36:35 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:36:35 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:36:35 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:36:35 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:36:35 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.403s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:36:36 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:36:36 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:36:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:36:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:36:44 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:36:44 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:36:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:36:48 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:36:49 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:36:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "5afb8419-6e05-44e1-9b78-d55134d3495d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:36:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:36:50 user nova-compute[75391]: DEBUG nova.objects.instance [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lazy-loading 'flavor' on Instance uuid 5afb8419-6e05-44e1-9b78-d55134d3495d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:36:50 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:36:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "5afb8419-6e05-44e1-9b78-d55134d3495d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:36:51 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:36:51 user nova-compute[75391]: INFO nova.compute.manager [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Attaching volume 219a8b87-622c-424f-b36d-26639deabf9c to /dev/vdb
Nov 15 03:36:51 user nova-compute[75391]: DEBUG os_brick.utils [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:36:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:36:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:36:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[96800da6-834b-441e-9772-8d44d458eb72]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:36:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:36:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:36:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f9e63a-0c1a-4b59-a331-67ee49cc016c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:36:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:36:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:36:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64356b7-a7fa-4ef6-bb73-f7c5fa14fd8c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:36:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[defbda08-7b38-43b5-b7cc-ba55d19c976b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:36:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:36:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:36:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 03:36:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:36:51 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:36:51 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 03:36:51 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[daad74a6-5e9b-443b-80a6-57e459f24fc4]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:36:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 03:36:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 03:36:51 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 03:36:51 user nova-compute[75391]: DEBUG os_brick.utils [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:36:51 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Updating existing volume attachment record: 1237a162-7585-4ced-8c72-abec71ac4841 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 03:36:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:36:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:36:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:36:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:36:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:36:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:36:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'peRyqYjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:36:55 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:36:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:36:55 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:36:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:36:55 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 03:36:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[218a38ca-2bcb-4218-9a41-06300c192245]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 03:36:55 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[472bcf1e-fd14-4537-9395-1df4bdb7bf0a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c] added
Nov 15 03:36:55 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b581df7-bb4d-4ad0-98a0-b33992c7c42f]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca888753-a842-4dee-8b93-d99a266b247c]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v peRyqYjP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v peRyqYjP" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b362d684-238c-4f4d-b286-2eb562362433]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'peRyqYjP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[957224e0-bf9c-43bb-b739-0fa1ab57e1ec]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc791d78-2b88-43c7-8181-f63dbd230e78]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 03:36:55 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 03:36:55 user nova-compute[75391]:  {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:36:55 user nova-compute[75391]: WARNING os_brick.initiator.connectors.iscsi [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 03:36:55 user nova-compute[75391]: 
Nov 15 03:36:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[178f4a06-b604-40a6-a31e-b95e49d740d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c, portal: 172.16.0.220,3260]
Nov 15 03:36:55 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c, portal: 172.16.0.220,3260] successful.
Nov 15 03:36:55 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:36:55 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:36:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.164s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:36:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[039792e5-43cc-4f0f-8060-1e10c4c4d01d]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:36:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:36:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:36:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:36:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[39973d5a-9a61-40f5-8050-848420d45955]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:36:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c (non-flash)
Nov 15 03:36:56 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:36:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c (non-flash)
Nov 15 03:36:56 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:36:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.407s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:36:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 03:36:56 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 03:36:56 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 03:36:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:36:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:36:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c647cff3-bf56-4dbc-a860-10bfa3630814]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:36:56 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 03:36:57 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 03:36:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'peRyqYjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 03:36:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:36:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] <== connect_volume: return (1440ms) {'type': 'block', 'scsi_wwn': '23135623233356232', 'path': '/dev/sdb'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:36:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135623233356232', 'path': '/dev/sdb'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 03:36:57 user nova-compute[75391]: DEBUG nova.objects.instance [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lazy-loading 'flavor' on Instance uuid 5afb8419-6e05-44e1-9b78-d55134d3495d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:36:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 03:36:57 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:36:57 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 03:36:57 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 03:36:57 user nova-compute[75391]:   <serial>219a8b87-622c-424f-b36d-26639deabf9c</serial>
Nov 15 03:36:57 user nova-compute[75391]: </disk>
Nov 15 03:36:57 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 03:36:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:36:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:36:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] No VIF found with MAC fa:16:3e:62:8a:11, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 03:36:57 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-129abb6c-df32-49ae-9aa3-d5350ee97305 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.568s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:36:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:36:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:37:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "5afb8419-6e05-44e1-9b78-d55134d3495d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:37:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:37:00 user nova-compute[75391]: INFO nova.compute.manager [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Detaching volume 219a8b87-622c-424f-b36d-26639deabf9c
Nov 15 03:37:00 user nova-compute[75391]: INFO nova.virt.block_device [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Attempting to driver detach volume 219a8b87-622c-424f-b36d-26639deabf9c from mountpoint /dev/vdb
Nov 15 03:37:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Attempting to detach device vdb from instance 5afb8419-6e05-44e1-9b78-d55134d3495d from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 03:37:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 03:37:00 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:37:00 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 03:37:00 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 03:37:00 user nova-compute[75391]:   <serial>219a8b87-622c-424f-b36d-26639deabf9c</serial>
Nov 15 03:37:00 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 03:37:00 user nova-compute[75391]: </disk>
Nov 15 03:37:00 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 03:37:00 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Successfully detached device vdb from instance 5afb8419-6e05-44e1-9b78-d55134d3495d from the persistent domain config.
Nov 15 03:37:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5afb8419-6e05-44e1-9b78-d55134d3495d from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 03:37:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 03:37:00 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:37:00 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 03:37:00 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 03:37:00 user nova-compute[75391]:   <serial>219a8b87-622c-424f-b36d-26639deabf9c</serial>
Nov 15 03:37:00 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 03:37:00 user nova-compute[75391]: </disk>
Nov 15 03:37:00 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 03:37:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5afb8419-6e05-44e1-9b78-d55134d3495d {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 03:37:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:37:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:37:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:37:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:37:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:37:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:37:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:37:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:37:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:37:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:37:20 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5afb8419-6e05-44e1-9b78-d55134d3495d is timed out.
Nov 15 03:37:20 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Successfully detached device vdb from instance 5afb8419-6e05-44e1-9b78-d55134d3495d from the live domain config.
Nov 15 03:37:20 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'peRyqYjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:37:20 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:37:20 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[13518a44-b9d3-4544-8c76-0410296ee418]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 03:37:20 user nova-compute[75391]: No targets found.
Nov 15 03:37:20 user nova-compute[75391]: iSNS:
Nov 15 03:37:20 user nova-compute[75391]: No targets found.
Nov 15 03:37:20 user nova-compute[75391]: STATIC:
Nov 15 03:37:20 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c
Nov 15 03:37:20 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 03:37:20 user nova-compute[75391]:                 Iface Name: default
Nov 15 03:37:20 user nova-compute[75391]: FIRMWARE:
Nov 15 03:37:20 user nova-compute[75391]: No targets found.
Nov 15 03:37:20 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 03:37:20 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 03:37:20 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5a0556-8380-465d-ace4-5e5774099fd9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1ddcac-f05c-4f27-bbc0-e379d83ead62]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c (non-flash)
Nov 15 03:37:20 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c (non-flash)
Nov 15 03:37:20 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6248cc71c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c'): ({'sdb'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Removing single pathed devices sdb {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[461163a0-734f-478b-845e-786308d49592]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6987c4b-0dbc-46e0-8de3-dbb40945ffe4]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Flushing IO for device /dev/sdb {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b36a33-b041-4a03-b63f-c71f829e5226]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[57335044-b67c-4cf6-a857-7cd5baf60ea0]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[256b4e27-631a-4f48-9ed3-085b904d4750]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:37:20 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:37:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:37:21 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3645037-893e-4454-ae78-fc0dda4c810a]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:37:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c, portal: 172.16.0.220,3260]
Nov 15 03:37:21 user nova-compute[75391]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c, portal: 172.16.0.220,3260] successful.
Nov 15 03:37:21 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:37:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:37:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:219a8b87-622c-424f-b36d-26639deabf9c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:37:21 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f87e23b-ed82-4ae1-a0c1-512d65c805bc]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:37:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:37:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:37:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] <== disconnect_volume: return (296ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:37:21 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 03:37:21 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:37:21 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:37:21 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 03:37:21 user nova-compute[75391]: DEBUG nova.objects.instance [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lazy-loading 'flavor' on Instance uuid 5afb8419-6e05-44e1-9b78-d55134d3495d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:37:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-5afb8419-6e05-44e1-9b78-d55134d3495d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:37:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-5afb8419-6e05-44e1-9b78-d55134d3495d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:37:21 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:37:21 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lazy-loading 'info_cache' on Instance uuid 5afb8419-6e05-44e1-9b78-d55134d3495d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:37:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-4af29eb4-f160-4778-b0c5-f98759d5c6fe tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.598s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:37:22 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Updating instance_info_cache with network_info: [{"id": "bd126cbc-824c-485d-a172-126b763e27fc", "address": "fa:16:3e:62:8a:11", "network": {"id": "943aff4f-4c65-4489-b8ce-bb8c1dd61e9d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-959600161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d565bc9eb1410284c91f0cc78385d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd126cbc-82", "ovs_interfaceid": "bd126cbc-824c-485d-a172-126b763e27fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:37:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-5afb8419-6e05-44e1-9b78-d55134d3495d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:37:22 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:37:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:37:25 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:37:25 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:37:27 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:37:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:37:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:37:35 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:37:36 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:37:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:37:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:37:36 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:37:36 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:37:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:37:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:37:36 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:37:37 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:37:37 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:37:37 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:37:37 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8977MB free_disk=24.937721252441406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:37:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:37:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:37:37 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 5afb8419-6e05-44e1-9b78-d55134d3495d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:37:37 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:37:37 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:37:37 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:37:37 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:37:37 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:37:37 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:37:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:37:38 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:37:38 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:37:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:37:46 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:37:46 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:37:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:37:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:37:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:37:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:37:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:37:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:37:48 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:37:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "5afb8419-6e05-44e1-9b78-d55134d3495d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:37:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:37:52 user nova-compute[75391]: DEBUG nova.objects.instance [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lazy-loading 'flavor' on Instance uuid 5afb8419-6e05-44e1-9b78-d55134d3495d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:37:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:37:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "5afb8419-6e05-44e1-9b78-d55134d3495d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:37:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:37:52 user nova-compute[75391]: INFO nova.compute.manager [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Attaching volume 3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 to /dev/vdb
Nov 15 03:37:52 user nova-compute[75391]: DEBUG os_brick.utils [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:37:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:37:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:37:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[19936a7c-8b01-439d-a27f-36e2bef9bcce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:37:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:37:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:37:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e907cf-7cde-4fb5-b2ed-d9f14b1463e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:37:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:37:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:37:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[40304e0c-3482-4361-9b6d-9bdeff35acca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:37:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2bcbb0-0adf-467f-bac7-181f0b883ea3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:37:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:37:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:37:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 03:37:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:37:52 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:37:52 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 03:37:52 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc597c28-8ab1-44fb-b258-04d49959cfc0]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:37:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 03:37:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 03:37:52 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 03:37:52 user nova-compute[75391]: DEBUG os_brick.utils [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:37:52 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Updating existing volume attachment record: 5fc0becf-3c8c-41a5-af6f-fe37489a97e1 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 03:37:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:37:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:37:56 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 03:37:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EQmYAXfF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:37:56 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:37:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:37:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:37:56 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:37:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:37:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:37:56 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 03:37:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:37:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:37:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a9a87d-d39b-46ed-a84d-07c2f84da186]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:37:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 03:37:56 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:37:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:37:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:37:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34adbf4-4f3a-4820-a50e-8aed229ea78b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:37:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0] added
Nov 15 03:37:56 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:37:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:37:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:37:56 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1d2a40-ac83-4dfb-aee6-43d391ec0e5f]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:37:56 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:37:56 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[201f5eaa-6fda-48d4-8439-66def58d13d3]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EQmYAXfF {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EQmYAXfF" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fbd393-05ae-480f-b289-c15dcaeb31a9]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EQmYAXfF'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1153266a-6f6f-4701-98b5-911571b637bb]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[508edbe0-26e2-4f37-89b9-02806a6888a2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 03:37:57 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 03:37:57 user nova-compute[75391]:  {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:37:57 user nova-compute[75391]: WARNING os_brick.initiator.connectors.iscsi [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 03:37:57 user nova-compute[75391]: 
Nov 15 03:37:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ec26a9-a0a6-4eff-9975-c02d562f108c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0, portal: 172.16.0.220,3260]
Nov 15 03:37:57 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0, portal: 172.16.0.220,3260] successful.
Nov 15 03:37:57 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52fd5a9-7419-4721-841c-82e0898a671c]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[abaca0fd-400e-4170-b657-429664f3c830]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 (non-flash)
Nov 15 03:37:57 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 (non-flash)
Nov 15 03:37:57 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35d817e-c6b3-4161-9bcd-34faa98b7f7b]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:37:57 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 03:37:58 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 03:37:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EQmYAXfF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 03:37:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:37:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23230386465636136', 'path': '/dev/sdb'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:37:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230386465636136', 'path': '/dev/sdb'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 03:37:58 user nova-compute[75391]: DEBUG nova.objects.instance [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lazy-loading 'flavor' on Instance uuid 5afb8419-6e05-44e1-9b78-d55134d3495d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:37:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 03:37:58 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:37:58 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 03:37:58 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 03:37:58 user nova-compute[75391]:   <serial>3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0</serial>
Nov 15 03:37:58 user nova-compute[75391]: </disk>
Nov 15 03:37:58 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 03:37:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:37:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:37:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:37:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] No VIF found with MAC fa:16:3e:62:8a:11, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 03:37:58 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-819304d7-07bd-4b44-9338-7d3df89d6341 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.324s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:37:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:38:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "5afb8419-6e05-44e1-9b78-d55134d3495d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:38:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:38:00 user nova-compute[75391]: INFO nova.compute.manager [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Detaching volume 3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0
Nov 15 03:38:00 user nova-compute[75391]: INFO nova.virt.block_device [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Attempting to driver detach volume 3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 from mountpoint /dev/vdb
Nov 15 03:38:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Attempting to detach device vdb from instance 5afb8419-6e05-44e1-9b78-d55134d3495d from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 03:38:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 03:38:00 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:38:00 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 03:38:00 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 03:38:00 user nova-compute[75391]:   <serial>3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0</serial>
Nov 15 03:38:00 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 03:38:00 user nova-compute[75391]: </disk>
Nov 15 03:38:00 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 03:38:00 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Successfully detached device vdb from instance 5afb8419-6e05-44e1-9b78-d55134d3495d from the persistent domain config.
Nov 15 03:38:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5afb8419-6e05-44e1-9b78-d55134d3495d from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 03:38:00 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 03:38:00 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:38:00 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 03:38:00 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 03:38:00 user nova-compute[75391]:   <serial>3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0</serial>
Nov 15 03:38:00 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 03:38:00 user nova-compute[75391]: </disk>
Nov 15 03:38:00 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 03:38:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5afb8419-6e05-44e1-9b78-d55134d3495d {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 03:38:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:38:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:38:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:38:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:38:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:38:21 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5afb8419-6e05-44e1-9b78-d55134d3495d is timed out.
Nov 15 03:38:21 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Successfully detached device vdb from instance 5afb8419-6e05-44e1-9b78-d55134d3495d from the live domain config.
Nov 15 03:38:21 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EQmYAXfF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:38:21 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:38:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f639a99-4f6e-49c1-a1bf-2fda9902428f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 03:38:21 user nova-compute[75391]: No targets found.
Nov 15 03:38:21 user nova-compute[75391]: iSNS:
Nov 15 03:38:21 user nova-compute[75391]: No targets found.
Nov 15 03:38:21 user nova-compute[75391]: STATIC:
Nov 15 03:38:21 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0
Nov 15 03:38:21 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 03:38:21 user nova-compute[75391]:                 Iface Name: default
Nov 15 03:38:21 user nova-compute[75391]: FIRMWARE:
Nov 15 03:38:21 user nova-compute[75391]: No targets found.
Nov 15 03:38:21 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 03:38:21 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 03:38:21 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b586b9-2201-48b7-9809-db9db0cf4f5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42cf551-c9e9-4e12-8882-dcc6b169d65c]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 (non-flash)
Nov 15 03:38:21 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 (non-flash)
Nov 15 03:38:21 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62247917e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0'): ({'sdb'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Removing single pathed devices sdb {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2357c7ca-23b1-4114-88be-f266b80a224e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3562a74c-d4cf-4327-a452-e0dee921174c]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Flushing IO for device /dev/sdb {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffdb8bf-9cdf-4695-bebe-1f562df4b742]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a78a5ab-380a-4e2d-8609-2021dd6bdddd]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[02489c4c-358f-4abd-b707-2eb9c0afe0f8]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6210ad0-d3ae-44b9-b8a2-c9c562f5c727]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0, portal: 172.16.0.220,3260]
Nov 15 03:38:21 user nova-compute[75391]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0, portal: 172.16.0.220,3260] successful.
Nov 15 03:38:21 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c9bba2d-7fa4-44a4-b08a-a37dfd9017a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6423fb1b-27ae-48a5-a4b7-2c1e84fd85aa]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] <== disconnect_volume: return (290ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-5afb8419-6e05-44e1-9b78-d55134d3495d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-5afb8419-6e05-44e1-9b78-d55134d3495d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:38:21 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lazy-loading 'info_cache' on Instance uuid 5afb8419-6e05-44e1-9b78-d55134d3495d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:38:22 user nova-compute[75391]: DEBUG nova.objects.instance [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lazy-loading 'flavor' on Instance uuid 5afb8419-6e05-44e1-9b78-d55134d3495d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:38:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-f80afe2a-80c4-4990-9865-49f58f4886ea tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.578s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:38:22 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Updating instance_info_cache with network_info: [{"id": "bd126cbc-824c-485d-a172-126b763e27fc", "address": "fa:16:3e:62:8a:11", "network": {"id": "943aff4f-4c65-4489-b8ce-bb8c1dd61e9d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-959600161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d565bc9eb1410284c91f0cc78385d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd126cbc-82", "ovs_interfaceid": "bd126cbc-824c-485d-a172-126b763e27fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:38:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-5afb8419-6e05-44e1-9b78-d55134d3495d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:38:22 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:38:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:38:25 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:38:25 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:38:27 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:38:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:38:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:38:35 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:38:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:38:38 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:38:38 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:38:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:38:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:38:38 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:38:38 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:38:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:38:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:38:38 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:38:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:38:39 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:38:39 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:38:39 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8995MB free_disk=24.936748504638672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:38:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:38:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:38:39 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 5afb8419-6e05-44e1-9b78-d55134d3495d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:38:39 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:38:39 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:38:39 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Refreshing inventories for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 03:38:39 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Updating ProviderTree inventory for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 03:38:39 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Updating inventory in ProviderTree for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 03:38:39 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Refreshing aggregate associations for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e, aggregates: None {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 03:38:39 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Refreshing trait associations for resource provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW {{(pid=75391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 03:38:39 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:38:39 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:38:39 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:38:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:38:39 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:38:39 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 03:38:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:38:47 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:38:47 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:38:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:38:49 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:38:50 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:38:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "5afb8419-6e05-44e1-9b78-d55134d3495d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:38:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:38:52 user nova-compute[75391]: DEBUG nova.objects.instance [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lazy-loading 'flavor' on Instance uuid 5afb8419-6e05-44e1-9b78-d55134d3495d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:38:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:38:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "5afb8419-6e05-44e1-9b78-d55134d3495d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:38:52 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:38:52 user nova-compute[75391]: INFO nova.compute.manager [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Attaching volume 361ae563-12c0-4c64-b57f-1680bd263493 to /dev/vdb
Nov 15 03:38:53 user nova-compute[75391]: DEBUG os_brick.utils [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:38:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:38:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:38:53 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ff1281-bbdf-46a6-939e-7c7743e0202f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fc2b68c3fd1e\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:38:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:38:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:38:53 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7528c6d8-536a-432c-a000-3ea55573d6be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:38:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:38:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:38:53 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[109006f6-be41-45b0-8fdc-9be6bfe3b51b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:38:53 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[af40021b-102d-4334-9d24-5027ae3316d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:38:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Running cmd (subprocess): nvme version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:38:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] 'nvme version' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:38:53 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] nvme not present on system {{(pid=75391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 03:38:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:38:53 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 03:38:53 user nova-compute[75391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 03:38:53 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac21233-f9a3-4323-ba63-8702014b96c1]: (4, '') {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:38:53 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 03:38:53 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 03:38:53 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.lightos [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] LIGHTOS: no hostnqn found. {{(pid=75391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 03:38:53 user nova-compute[75391]: DEBUG os_brick.utils [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fc2b68c3fd1e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:38:53 user nova-compute[75391]: DEBUG nova.virt.block_device [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Updating existing volume attachment record: 19e87368-04f8-4188-b4fe-d9a9a35dde35 {{(pid=75391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 03:38:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:38:53 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:38:53 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Cleaning up deleted instances {{(pid=75391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 03:38:53 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] There are 0 instances to clean {{(pid=75391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 03:38:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Calling os-brick to attach iSCSI Volume {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bEwvcshF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:38:57 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:38:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:38:57 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:38:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:38:57 user nova-compute[75391]: INFO os_brick.initiator.connectors.iscsi [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493 -p 172.16.0.220:3260 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f77b79-9f70-40d3-b548-8c0aadf94233]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 03:38:57 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493 -p 172.16.0.220:3260 --interface default --op new {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71a6cff-490b-47b3-895d-512a43a3dfb8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493] added\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493] added
Nov 15 03:38:57 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84a3883-ad5c-4e63-b5c8-ccdf17c7d75f]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1175eab4-0148-4b74-8074-b90a67b7c858]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bEwvcshF {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bEwvcshF" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a0df1b-50d3-4fa9-b20e-61288753a6a9]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bEwvcshF'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f5bd57-bbca-449e-81e4-2cc284503997]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c867f2-9f36-4452-ba99-6ec576d7c768]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 03:38:57 user nova-compute[75391]:  {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 03:38:57 user nova-compute[75391]:  {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:38:57 user nova-compute[75391]: WARNING os_brick.initiator.connectors.iscsi [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 03:38:57 user nova-compute[75391]: 
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493 -p 172.16.0.220:3260 --login {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24f3534-8d06-4a3d-8551-4b68b4b57ea8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493, portal: 172.16.0.220,3260]
Nov 15 03:38:57 user nova-compute[75391]: Login to [iface: default, target: iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493, portal: 172.16.0.220,3260] successful.
Nov 15 03:38:57 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[675e7aee-53e6-4302-b7e6-f107442b5a64]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[446c4403-fa60-405b-b431-a6a35d67d69c]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493 (non-flash)
Nov 15 03:38:57 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493 (non-flash)
Nov 15 03:38:57 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Connected to 172.16.0.220:3260 {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0bb3f5-56a1-4425-b795-40d0dec6d2b3]: (4, ('- - 0', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 03:38:57 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bEwvcshF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 03:38:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:38:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.268s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:38:58 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] <== connect_volume: return (1270ms) {'type': 'block', 'scsi_wwn': '23236663432366562', 'path': '/dev/sdb'} {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:38:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236663432366562', 'path': '/dev/sdb'} {{(pid=75391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 03:38:58 user nova-compute[75391]: DEBUG nova.objects.instance [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lazy-loading 'flavor' on Instance uuid 5afb8419-6e05-44e1-9b78-d55134d3495d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:38:58 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 03:38:58 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:38:58 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 03:38:58 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 03:38:58 user nova-compute[75391]:   <serial>361ae563-12c0-4c64-b57f-1680bd263493</serial>
Nov 15 03:38:58 user nova-compute[75391]: </disk>
Nov 15 03:38:58 user nova-compute[75391]:  {{(pid=75391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 03:38:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] No BDM found with device name vda, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:38:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 03:38:59 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] No VIF found with MAC fa:16:3e:62:8a:11, not building metadata {{(pid=75391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 03:38:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-7df3add9-65a2-4838-a177-33a004b7eed4 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.281s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:38:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:39:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "5afb8419-6e05-44e1-9b78-d55134d3495d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:39:00 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:39:00 user nova-compute[75391]: INFO nova.compute.manager [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Detaching volume 361ae563-12c0-4c64-b57f-1680bd263493
Nov 15 03:39:01 user nova-compute[75391]: INFO nova.virt.block_device [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Attempting to driver detach volume 361ae563-12c0-4c64-b57f-1680bd263493 from mountpoint /dev/vdb
Nov 15 03:39:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Attempting to detach device vdb from instance 5afb8419-6e05-44e1-9b78-d55134d3495d from the persistent domain config. {{(pid=75391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 03:39:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 03:39:01 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:39:01 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 03:39:01 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 03:39:01 user nova-compute[75391]:   <serial>361ae563-12c0-4c64-b57f-1680bd263493</serial>
Nov 15 03:39:01 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 03:39:01 user nova-compute[75391]: </disk>
Nov 15 03:39:01 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 03:39:01 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Successfully detached device vdb from instance 5afb8419-6e05-44e1-9b78-d55134d3495d from the persistent domain config.
Nov 15 03:39:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5afb8419-6e05-44e1-9b78-d55134d3495d from the live domain config. {{(pid=75391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 03:39:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.guest [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 03:39:01 user nova-compute[75391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 03:39:01 user nova-compute[75391]:   <source dev="/dev/sdb"/>
Nov 15 03:39:01 user nova-compute[75391]:   <target dev="vdb" bus="virtio"/>
Nov 15 03:39:01 user nova-compute[75391]:   <serial>361ae563-12c0-4c64-b57f-1680bd263493</serial>
Nov 15 03:39:01 user nova-compute[75391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 03:39:01 user nova-compute[75391]: </disk>
Nov 15 03:39:01 user nova-compute[75391]:  {{(pid=75391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 03:39:01 user nova-compute[75391]: DEBUG nova.virt.libvirt.driver [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5afb8419-6e05-44e1-9b78-d55134d3495d {{(pid=75391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 03:39:02 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:39:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:39:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:39:08 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:39:13 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:39:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:39:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:39:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:39:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:39:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:39:18 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:39:21 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5afb8419-6e05-44e1-9b78-d55134d3495d is timed out.
Nov 15 03:39:21 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Successfully detached device vdb from instance 5afb8419-6e05-44e1-9b78-d55134d3495d from the live domain config.
Nov 15 03:39:21 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] calling os-brick to detach iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f62442d07f0>, {'target_iqn': 'iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bEwvcshF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 03:39:21 user nova-compute[75391]: WARNING os_brick.initiator.connectors.base [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 03:39:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[938b57af-d3e8-422a-8686-c9a9b8e72e6d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 03:39:21 user nova-compute[75391]: No targets found.
Nov 15 03:39:21 user nova-compute[75391]: iSNS:
Nov 15 03:39:21 user nova-compute[75391]: No targets found.
Nov 15 03:39:21 user nova-compute[75391]: STATIC:
Nov 15 03:39:21 user nova-compute[75391]: Target: iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493
Nov 15 03:39:21 user nova-compute[75391]:         Portal: 172.16.0.220:3260,-1
Nov 15 03:39:21 user nova-compute[75391]:                 Iface Name: default
Nov 15 03:39:21 user nova-compute[75391]: FIRMWARE:
Nov 15 03:39:21 user nova-compute[75391]: No targets found.
Nov 15 03:39:21 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 03:39:21 user nova-compute[75391]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 03:39:21 user nova-compute[75391]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75391) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493', 0)] {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8871f3-29c9-4074-9404-6a29f9ab238e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f523e96-4a23-44e9-9939-eba850391366]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493 (non-flash)\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493 (non-flash)
Nov 15 03:39:21 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493 (non-flash)
Nov 15 03:39:21 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f62247d3eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493'): ({'sdb'}, set())}) {{(pid=75391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Removing single pathed devices sdb {{(pid=75391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e126e0f-4dd4-4cad-b270-ad7224ee4324]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cd57af-248b-4584-8acd-fbe65ff7acd1]: (4, ('ok\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Flushing IO for device /dev/sdb {{(pid=75391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d23f69b-7ea4-4680-8ece-4ddcd56027e6]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e4b171-e06a-4cb3-b7a1-1604c06f8f4b]: (4, ('1', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG os_brick.initiator.linuxscsi [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] SCSI volumes sdb have been removed. {{(pid=75391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493')] {{(pid=75391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68fbcea-933e-4500-af2e-d690aefbf27c]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493 -p 172.16.0.220:3260 --logout {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493 -p 172.16.0.220:3260 --logout" returned: 0 in 0.040s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f3c286-3dbc-4c6c-8285-e7f5fb85679f]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493, portal: 172.16.0.220,3260]
Nov 15 03:39:21 user nova-compute[75391]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493, portal: 172.16.0.220,3260] successful.
Nov 15 03:39:21 user nova-compute[75391]:  stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493 -p 172.16.0.220:3260 --op delete {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361ae563-12c0-4c64-b57f-1680bd263493 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85237) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ceb0474-196f-40de-bd82-ed749c29886d]: (4, ('', '')) {{(pid=85237) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.base [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] <== disconnect_volume: return (278ms) None {{(pid=75391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 03:39:21 user nova-compute[75391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Disconnected iSCSI Volume {{(pid=75391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 03:39:22 user nova-compute[75391]: DEBUG nova.objects.instance [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lazy-loading 'flavor' on Instance uuid 5afb8419-6e05-44e1-9b78-d55134d3495d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:39:22 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-b328c6ae-fa21-4b9c-990c-1c7785d9a519 tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.585s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:39:23 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:39:23 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:39:23 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:39:23 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 03:39:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "refresh_cache-5afb8419-6e05-44e1-9b78-d55134d3495d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 03:39:23 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquired lock "refresh_cache-5afb8419-6e05-44e1-9b78-d55134d3495d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 03:39:23 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Forcefully refreshing network info cache for instance {{(pid=75391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 03:39:23 user nova-compute[75391]: DEBUG nova.objects.instance [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lazy-loading 'info_cache' on Instance uuid 5afb8419-6e05-44e1-9b78-d55134d3495d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:39:24 user nova-compute[75391]: DEBUG nova.network.neutron [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Updating instance_info_cache with network_info: [{"id": "bd126cbc-824c-485d-a172-126b763e27fc", "address": "fa:16:3e:62:8a:11", "network": {"id": "943aff4f-4c65-4489-b8ce-bb8c1dd61e9d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-959600161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d565bc9eb1410284c91f0cc78385d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd126cbc-82", "ovs_interfaceid": "bd126cbc-824c-485d-a172-126b763e27fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:39:24 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Releasing lock "refresh_cache-5afb8419-6e05-44e1-9b78-d55134d3495d" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 03:39:24 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Updated the network info_cache for instance {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 03:39:25 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:39:27 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:39:27 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:39:28 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:39:32 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:39:33 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:39:36 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:39:38 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:39:39 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:39:39 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:39:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:39:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:39:39 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:39:39 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:39:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:39:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:39:39 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk --force-share --output=json {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 03:39:40 user nova-compute[75391]: DEBUG oslo_concurrency.processutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 03:39:40 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:39:40 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:39:40 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=8996MB free_disk=24.935806274414062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:39:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:39:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:39:40 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Instance 5afb8419-6e05-44e1-9b78-d55134d3495d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 03:39:40 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:39:40 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:39:40 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:39:40 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:39:40 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:39:40 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:39:43 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:39:48 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:39:49 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:39:49 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:39:52 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:39:53 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:39:58 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:39:59 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_power_states {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:39:59 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Triggering sync for uuid 5afb8419-6e05-44e1-9b78-d55134d3495d {{(pid=75391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 03:39:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "5afb8419-6e05-44e1-9b78-d55134d3495d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:39:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:39:59 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:40:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:40:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:40:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 03:40:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:40:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 03:40:03 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:40:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-faba6d7a-9c3d-4a7d-8283-891705a3965e tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "5afb8419-6e05-44e1-9b78-d55134d3495d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:40:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-faba6d7a-9c3d-4a7d-8283-891705a3965e tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:40:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-faba6d7a-9c3d-4a7d-8283-891705a3965e tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "5afb8419-6e05-44e1-9b78-d55134d3495d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:40:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-faba6d7a-9c3d-4a7d-8283-891705a3965e tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:40:03 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-faba6d7a-9c3d-4a7d-8283-891705a3965e tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:40:03 user nova-compute[75391]: INFO nova.compute.manager [None req-faba6d7a-9c3d-4a7d-8283-891705a3965e tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Terminating instance
Nov 15 03:40:03 user nova-compute[75391]: DEBUG nova.compute.manager [None req-faba6d7a-9c3d-4a7d-8283-891705a3965e tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Start destroying the instance on the hypervisor. {{(pid=75391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 03:40:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:40:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:40:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:40:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:40:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-5a398685-4b9e-4b2b-a7cb-f2d9ce40072e req-d97e248c-3c5a-4d36-9ea9-555261bda3d7 service nova] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Received event network-vif-unplugged-bd126cbc-824c-485d-a172-126b763e27fc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:40:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a398685-4b9e-4b2b-a7cb-f2d9ce40072e req-d97e248c-3c5a-4d36-9ea9-555261bda3d7 service nova] Acquiring lock "5afb8419-6e05-44e1-9b78-d55134d3495d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:40:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a398685-4b9e-4b2b-a7cb-f2d9ce40072e req-d97e248c-3c5a-4d36-9ea9-555261bda3d7 service nova] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:40:04 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-5a398685-4b9e-4b2b-a7cb-f2d9ce40072e req-d97e248c-3c5a-4d36-9ea9-555261bda3d7 service nova] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:40:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-5a398685-4b9e-4b2b-a7cb-f2d9ce40072e req-d97e248c-3c5a-4d36-9ea9-555261bda3d7 service nova] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] No waiting events found dispatching network-vif-unplugged-bd126cbc-824c-485d-a172-126b763e27fc {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:40:04 user nova-compute[75391]: DEBUG nova.compute.manager [req-5a398685-4b9e-4b2b-a7cb-f2d9ce40072e req-d97e248c-3c5a-4d36-9ea9-555261bda3d7 service nova] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Received event network-vif-unplugged-bd126cbc-824c-485d-a172-126b763e27fc for instance with task_state deleting. {{(pid=75391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 03:40:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:40:04 user nova-compute[75391]: INFO nova.virt.libvirt.driver [-] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Instance destroyed successfully.
Nov 15 03:40:04 user nova-compute[75391]: DEBUG nova.objects.instance [None req-faba6d7a-9c3d-4a7d-8283-891705a3965e tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lazy-loading 'resources' on Instance uuid 5afb8419-6e05-44e1-9b78-d55134d3495d {{(pid=75391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 03:40:04 user nova-compute[75391]: DEBUG nova.virt.libvirt.vif [None req-faba6d7a-9c3d-4a7d-8283-891705a3965e tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T03:33:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-191839143',display_name='tempest-SnapshotDataIntegrityTests-server-191839143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-191839143',id=53,image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIqwz4vOKv5g5LujiGjQOa+0ttuQ+9WXnU+qbnHd/+QHdUMHjEOVvv1h6TJRGVDJoVLfr/aKS7qyS+avGSwq0T4yiJMFpQHh+ItpwXhdgElb2Celk284MFex7jbk5NjVg==',key_name='tempest-keypair-1245200549',keypairs=<?>,launch_index=0,launched_at=2023-11-15T03:33:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2d565bc9eb1410284c91f0cc78385d7',ramdisk_id='',reservation_id='r-2q0nqbwy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f31cb507-389e-424c-b4dc-02c610b0b558',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-640033110',owner_user_name='tempest-SnapshotDataIntegrityTests-640033110-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T03:33:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddac74f27abf4da3801187adec2d3fd8',uuid=5afb8419-6e05-44e1-9b78-d55134d3495d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd126cbc-824c-485d-a172-126b763e27fc", "address": "fa:16:3e:62:8a:11", "network": {"id": "943aff4f-4c65-4489-b8ce-bb8c1dd61e9d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-959600161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d565bc9eb1410284c91f0cc78385d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd126cbc-82", "ovs_interfaceid": "bd126cbc-824c-485d-a172-126b763e27fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 03:40:04 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-faba6d7a-9c3d-4a7d-8283-891705a3965e tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Converting VIF {"id": "bd126cbc-824c-485d-a172-126b763e27fc", "address": "fa:16:3e:62:8a:11", "network": {"id": "943aff4f-4c65-4489-b8ce-bb8c1dd61e9d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-959600161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2d565bc9eb1410284c91f0cc78385d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd126cbc-82", "ovs_interfaceid": "bd126cbc-824c-485d-a172-126b763e27fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 03:40:04 user nova-compute[75391]: DEBUG nova.network.os_vif_util [None req-faba6d7a-9c3d-4a7d-8283-891705a3965e tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:8a:11,bridge_name='br-int',has_traffic_filtering=True,id=bd126cbc-824c-485d-a172-126b763e27fc,network=Network(943aff4f-4c65-4489-b8ce-bb8c1dd61e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd126cbc-82') {{(pid=75391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 03:40:04 user nova-compute[75391]: DEBUG os_vif [None req-faba6d7a-9c3d-4a7d-8283-891705a3965e tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:8a:11,bridge_name='br-int',has_traffic_filtering=True,id=bd126cbc-824c-485d-a172-126b763e27fc,network=Network(943aff4f-4c65-4489-b8ce-bb8c1dd61e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd126cbc-82') {{(pid=75391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 03:40:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:40:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd126cbc-82, bridge=br-int, if_exists=True) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:40:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:40:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:40:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0cddfa9f-a0df-449f-9581-40201a8fc2ec) {{(pid=75391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 03:40:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:40:04 user nova-compute[75391]: INFO os_vif [None req-faba6d7a-9c3d-4a7d-8283-891705a3965e tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:8a:11,bridge_name='br-int',has_traffic_filtering=True,id=bd126cbc-824c-485d-a172-126b763e27fc,network=Network(943aff4f-4c65-4489-b8ce-bb8c1dd61e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd126cbc-82')
Nov 15 03:40:04 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-faba6d7a-9c3d-4a7d-8283-891705a3965e tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Deleting instance files /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d_del
Nov 15 03:40:04 user nova-compute[75391]: INFO nova.virt.libvirt.driver [None req-faba6d7a-9c3d-4a7d-8283-891705a3965e tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Deletion of /opt/stack/data/nova/instances/5afb8419-6e05-44e1-9b78-d55134d3495d_del complete
Nov 15 03:40:04 user nova-compute[75391]: INFO nova.compute.manager [None req-faba6d7a-9c3d-4a7d-8283-891705a3965e tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 03:40:04 user nova-compute[75391]: DEBUG oslo.service.loopingcall [None req-faba6d7a-9c3d-4a7d-8283-891705a3965e tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 03:40:04 user nova-compute[75391]: DEBUG nova.compute.manager [-] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Deallocating network for instance {{(pid=75391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 03:40:04 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] deallocate_for_instance() {{(pid=75391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 03:40:05 user nova-compute[75391]: DEBUG nova.network.neutron [-] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Updating instance_info_cache with network_info: [] {{(pid=75391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 03:40:05 user nova-compute[75391]: INFO nova.compute.manager [-] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Took 0.79 seconds to deallocate network for instance.
Nov 15 03:40:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-faba6d7a-9c3d-4a7d-8283-891705a3965e tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:40:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-faba6d7a-9c3d-4a7d-8283-891705a3965e tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:40:05 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-faba6d7a-9c3d-4a7d-8283-891705a3965e tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:40:05 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-faba6d7a-9c3d-4a7d-8283-891705a3965e tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:40:05 user nova-compute[75391]: DEBUG nova.compute.manager [req-1bd6d84c-0dc2-4b85-bcd0-cd3f0098a524 req-4139b4a2-1e61-4f63-a948-bfb56138d4b5 service nova] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Received event network-vif-deleted-bd126cbc-824c-485d-a172-126b763e27fc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:40:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-faba6d7a-9c3d-4a7d-8283-891705a3965e tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.126s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:40:05 user nova-compute[75391]: INFO nova.scheduler.client.report [None req-faba6d7a-9c3d-4a7d-8283-891705a3965e tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Deleted allocations for instance 5afb8419-6e05-44e1-9b78-d55134d3495d
Nov 15 03:40:05 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-faba6d7a-9c3d-4a7d-8283-891705a3965e tempest-SnapshotDataIntegrityTests-640033110 tempest-SnapshotDataIntegrityTests-640033110-project-member] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.982s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:40:06 user nova-compute[75391]: DEBUG nova.compute.manager [req-832f09d4-656c-4208-ad2b-54737d09f92b req-cc169cfd-5396-4d8f-a2ea-432a4b62439f service nova] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Received event network-vif-plugged-bd126cbc-824c-485d-a172-126b763e27fc {{(pid=75391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 03:40:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-832f09d4-656c-4208-ad2b-54737d09f92b req-cc169cfd-5396-4d8f-a2ea-432a4b62439f service nova] Acquiring lock "5afb8419-6e05-44e1-9b78-d55134d3495d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:40:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-832f09d4-656c-4208-ad2b-54737d09f92b req-cc169cfd-5396-4d8f-a2ea-432a4b62439f service nova] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:40:06 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [req-832f09d4-656c-4208-ad2b-54737d09f92b req-cc169cfd-5396-4d8f-a2ea-432a4b62439f service nova] Lock "5afb8419-6e05-44e1-9b78-d55134d3495d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:40:06 user nova-compute[75391]: DEBUG nova.compute.manager [req-832f09d4-656c-4208-ad2b-54737d09f92b req-cc169cfd-5396-4d8f-a2ea-432a4b62439f service nova] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] No waiting events found dispatching network-vif-plugged-bd126cbc-824c-485d-a172-126b763e27fc {{(pid=75391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 03:40:06 user nova-compute[75391]: WARNING nova.compute.manager [req-832f09d4-656c-4208-ad2b-54737d09f92b req-cc169cfd-5396-4d8f-a2ea-432a4b62439f service nova] [instance: 5afb8419-6e05-44e1-9b78-d55134d3495d] Received unexpected event network-vif-plugged-bd126cbc-824c-485d-a172-126b763e27fc for instance with vm_state deleted and task_state None.
Nov 15 03:40:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:40:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:40:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:40:24 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:40:25 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:40:25 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Starting heal instance info cache {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 03:40:25 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Rebuilding the list of instances to heal {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 03:40:25 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Didn't find any instances for network info cache update. {{(pid=75391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 03:40:26 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:40:27 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:40:28 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:40:29 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:40:34 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:40:37 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:40:39 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:40:41 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:40:41 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:40:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:40:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:40:41 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:40:41 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 03:40:42 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:40:42 user nova-compute[75391]: WARNING nova.virt.libvirt.driver [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 03:40:42 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Hypervisor/Node resource view: name=user free_ram=9135MB free_disk=24.955116271972656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 03:40:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 03:40:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 03:40:42 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 03:40:42 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 03:40:42 user nova-compute[75391]: DEBUG nova.compute.provider_tree [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed in ProviderTree for provider: fa8a32f4-c234-4e10-a8fe-db43b3c4c62e {{(pid=75391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 03:40:42 user nova-compute[75391]: DEBUG nova.scheduler.client.report [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Inventory has not changed for provider fa8a32f4-c234-4e10-a8fe-db43b3c4c62e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 03:40:42 user nova-compute[75391]: DEBUG nova.compute.resource_tracker [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Compute_service record updated for user:user {{(pid=75391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 03:40:42 user nova-compute[75391]: DEBUG oslo_concurrency.lockutils [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=75391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 03:40:44 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:40:49 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:40:51 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:40:51 user nova-compute[75391]: DEBUG nova.compute.manager [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 03:40:53 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:40:53 user nova-compute[75391]: DEBUG oslo_service.periodic_task [None req-9b947f87-54ef-4f07-af65-0a295a88e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 03:40:54 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:40:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:40:57 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:40:59 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:41:00 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:41:04 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 03:41:09 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:41:14 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 03:41:19 user nova-compute[75391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}